Principal Data Engineer

Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting.

Role and Responsibilities:

• Using Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting.
• If necessary, create prototypes to validate proposed ideas and solicit input from stakeholders.
• Excellent grasp of and expertise with test-driven development and continuous integration processes.
• Analysis and Design – Converts high-level design to low-level design and implements it.
• Collaborate with Team Leads to define/clarify business requirements, estimate development costs, and finalize work plans.
• Run unit and integration tests on all created code – Create and run unit and integration tests throughout the development lifecycle.
• Benchmark application code proactively to prevent performance and scalability concerns.
• Collaborate with the Quality Assurance Team on issue reporting, resolution, and change management.
• Support and Troubleshooting – Assist the Operations Team with any environmental issues that arise during application deployment in the Development, QA, Staging, and Production environments.
• Assist other teams in resolving issues that may develop as a result of applications or the integration of multiple components.
• Mentor technical staff and manage the technical delivery of significant part of the ecosystem.

Azure Developer Requirements & Skills:

• Understanding of design concepts and architectural basics.
• Knowledge of performance engineering.
• Understanding of quality processes and estimate methods.
• Fundamental grasp of the project domain.
• The ability to transform functional and nonfunctional needs into system requirements.
• The ability to develop and code complicated applications is required.
• The ability to create test cases and scenarios based on specifications.
• Solid knowledge of SDLC and agile techniques.
• Knowledge of current technology and trends.
• Logical thinking and problem-solving abilities, as well as the capacity to collaborate.
• Primary skills: Cloud Platform->Azure Developer->Microsft Azure/PAAS.
• Sought: SQL, Python, PowerBI.
• General Knowledge: PowerApps, Java.
• Bachelor of Science in Computer Science, Engineering, or related technical field.
• 11-20 years of experience in software development with minimum 5 years of cloud computing, and 1+ years in DataBricks, Synapse or Snowflake.