The Azure Data Engineer will be responsible for creating and optimizing our data pipeline, data architecture as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and projects.
Responsibilities and Duties
- Create and maintain optimal data pipeline.
- Assemble large, complex data sets tha`t meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, etc.
- Build analytics tools/dashboards that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics using Tableau.
- Work with stakeholders including the business owners, Data and Design teams to assist with data-related technical issues and support their data needs.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing models/visualizations.
Required Experience and Qualifications
We are looking for a candidate with 2+ years of experience in a Data Engineer role, who has attained a bachelor’s degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience in the following:
- Experience with various data prep/pipeline/integration tools like Alteryx, Azure Data Factory etc.
- In-depth knowledge of relational databases (e.g. Oracle and SQL Server), including data warehousing concepts and best practices
- Proficient is SQL
- Experience in at least one the following languages – R, Python, SCALA
- Experience with Microsoft Azure data services (Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL, Azure Datawarehouse)
- Experience building Alteryx workflows
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL).
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- knowledge with data visualization best practices.
- Minimum 1-year experience in Tableau development
- Experience building Tableau dashboards
- Experience working in an agile or Scrum-based environment
- Ability to test and document end-to-end processes.
Experience working with Microsoft Azure or AWS platform will be preferred
