Sr. Data Engineer will be responsible for developing curated data (data models, data ETL pipelines, views) in a cloud-based environment to support business needs for analytics and reporting. The engineer will assist an existing team with migration from on prem to cloud-based data delivery platform and should have experience in migration of environments. The candidate will provide guidance and support for the set-up of the new environment along with best practices and recommendations based on industry and hands on experience as a data engineer. In addition, the candidate should have experience with standardizing data modeling and design frameworks for analysis, design, building, testing and maintenance. Cloud based data engineering is required and experience using the Azure stack is highly preferred and recommended. Candidates must possess the technical capabilities to extract, retrieve and analyze data with SQL based tools. The engineer should possess strong interpersonal communication skills to be able to bridge the gap between business and technical users to understand and assess requirements and deliver data driven solutions. The role will also involve adhering to data governance standards and practices along with experience developing in an agile environment using Azure boards.
1. Design and architect end-to-end data platform solutions on the Azure cloud platform, considering scalability, reliability, performance, and security.
2. Collaborate with stakeholders to understand business requirements and translate them into technical specifications and data architecture designs.
3. Develop and implement data models, schemas, and database structures to ensure efficient data storage and retrieval.
4. Design and implement data integration solutions, including data ingestion, transformation, and data pipeline orchestration using Azure data services (e.g., Azure Data Factory, Azure Databricks, Azure Logic Apps, Azure Functions).
5. Optimize and tune data solutions for performance, ensuring efficient query execution and data processing.
6. Implement data security and compliance measures, including data encryption, access controls, and data masking techniques.
7. Work closely with data analysts, data scientists, and other stakeholders to understand their data requirements and provide guidance on data availability and accessibility.
8. Collaborate with infrastructure teams to design and implement robust data storage and backup strategies, leveraging Azure storage services.
9. Monitor and troubleshoot data platform solutions to ensure high availability, reliability, and performance.
10. Stay up-to-date with the latest trends and advancements in Azure data services, data engineering, and data architecture, and provide recommendations for adopting new technologies and best practices.3. Strong knowledge of Azure data services, including Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB, Azure Data Lake Storage, and Azure Blob Storage.
Familiarity with data visualization and reporting tools, such as Power BI or Azure Analysis Services, is a plus
Relevant Microsoft Azure certifications, such as Azure Data Engineer Associate or Azure Solutions Architect, are highly desirable.
Retail Customer Service Delivery Driver Location Scottsbluff, NE : This position works closely with wholesale and retail customers to determine... ...stores in a safe and timely manner using Company vans or pick-up trucks. The individual selected for this role will be expected...
...StretchLab is seeking B.S. in Exercise Science, Kinesiology and Athletic Training to join our team for three of our studios in Triangle area- Cary, Morrisville, and Holly Springs, NC. This is an amazing opportunity to gain experience in a new modality that is taking the...
Registered Nurse RN - Large Senior Living CommunityWe are seeking an outstanding Registered Nurse to join our team at Overlake Terrace... ...Nurse provides support to the Director of Health and Wellness and can take many of the responsibilities and tasks of the Director...
...availability to work days, nights, holidays, and weekends! 2 nd : 1:00PM-9:30PM 3 rd : 9:00PM-5:30AM Must be able to work in all warehouse conditions including Freezer, Cooler and Dry! Position Responsibilities: Safely and accurately select customer orders, build...
...DOLA Only - Division of Local Government - Regional Manager - (Reallocation) Print ( Apply ? DOLA Only - Division of Local Government - Regional Manager - (Reallocation) Salary $10,800.00 - $11,163.00 Monthly Location Statewide, CO...