Senior Data Engineer

Los Angeles, CA | Freelance | Job ID #60178 |
Posted Last Month
 

Our client, a video game company, is seeking a Senior Data Engineer to join the team.

Responsibilities:

  • Create and promote a technical design and architectural vision for security operations data systems and tooling
  • Work with engineers on the team to manage infrastructure for moving and processing large-scale data
  • Improve log flows efficiency through data processing to reduce the cost of analysis and storage
  • Convert log flows from Logstash to Elastic Common Schema
  • Work with Analysts to determine and implement the best practices for data retention and storage
  • Design and promote standards for security operations data telemetry and processing
  • Help engineers across the team select data technologies for their development needs
  • Be the face of data best-practices to engineers on the team around the product by advocating for data considerations early in the product life cycle and educating teammates on how to get the most out of company data ecosystem

Musts:

  • 2+ years experience working with data systems
  • 2+ years experience with data warehousing, processing, pipelines, infrastructure, and query patterns
  • 2+ years experience with Spark or Hadoop
  • 2+ years experience with open source ETL frameworks such as Airflow, Luigi, or similar
  • 4+ years experience with Python and SQL
  • Bachelor’s degree in Computer Science or related field
  • Experience with systems for data processing (Spark, Flink, Hadoop, Airflow) and storage (S3, Kafka, ElasticSearch, Dynamo, MySQL, or Postgres) is a plus
  • Experience with ELK is a plus
  • Experience reading and optimizing data schema queries for content and performance
  • Experience working in agile project management methodologies (Scrum, Kanban)

Employer Details:

  • Onward Search is an equal opportunity employer, dedicated to a policy of non-discrimination in an employment with regard to race, color, religion, gender, sexual orientation, national origin, age, disability, genetic information, veteran status or any other classification protected by federal, state and local laws and ordinances. Candidates must be at least 18 years old to be considered for employment. EOE/M/F/D/V/SO.
  • In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification document form upon hire.
  • Onward Search offers medical, dental, vision benefits, as well as a 401k program, for all eligible full time temporary assignments.
  • Onward Search is unable to support 1099 / Corp-to-Corp or Independent Contractor arrangements at this time. All freelancers will be paid as W2 employees.
  • Onward Search is a drug-free workplace.
Apply

SHARE THIS JOB

Turn on email alerts for this search

About Onward Search

Onward Search helps connect creative, marketing, and technology talent with top jobs at the nation's most recognized companies and digital agencies. We offer a full range of recruitment and staffing solutions to include freelance / contract, temp-to-perm, and permanent placement.