Sr. Data Engineer

As a Senior Data Engineer on the Platform Data Team at Onward Search's FinTech client, your responsibilities include:

• Developing data pipelines to consolidate log data from various backend microservices.
• Expanding existing data pipelines and integrating new data sources to extract valuable insights.
• Creating data quality checks to identify gaps and communicate them to upstream teams.
• Building data quality dashboards for monitoring data integrity.
• Leading high-visibility projects that impact the organization.
• Optimizing queries for improved performance and reduced processing times.

Required Skills:

To excel in this role, you should possess:

• 5+ years of experience in a Senior Data Engineering or Senior Data Science position.
• The ability to understand business requirements deeply and optimize data pipelines accordingly.
• Proficiency in managing and manipulating large datasets, including knowledge of data partitioning and optimization techniques.
• Skill in efficiently integrating data from multiple sources.
• Strong data modeling skills to design adaptable schemas that meet analytical needs.
• Knowledge of data security and privacy best practices.
• Analytical and problem-solving skills for addressing integration and schema evolution challenges.
• Strong communication skills to collaborate with stakeholders and translate business needs into technical tasks.

Technologies:

You will work with the following technologies:

• SQL
• Python
• Snowflake
• Airflow
• dbt
• Experience in command-line usage and Git workflows.

In this role, you'll collaborate closely with Product, Engineering, and Design teams to build and deliver insights that influence the roadmap and enhance user understanding. Your work will be pivotal in supporting risk and compliance initiatives.