Data Engineer
Kforce Inc

New York, New York

Posted in Recruitment Consultancy
about 1 month ago


This job has expired.

Job Info


RESPONSIBILITIES:

Kforce has a client that is seeking a Data Engineer in New York, NY.Summary:As a Data Engineer, you will be a part of an early stage team that builds the data transport, collection, and storage, and exposes services that make data a first-class citizen. We are looking for a Data Engineer to build a scalable data platform. Responsibilities:
  • Ownership of our core data pipeline that powers our top-line metrics
  • Use data expertise to help evolve data models in several components of the data stack
  • Help architect, building, and launching scalable data pipelines to support our growing data processing and analytics needs
  • Your efforts will allow access to business and user behavior insights, using huge amounts of data to fuel several teams such as Analytics, Data Science, Marketplace, and many others
  • You will report to a Data Engineering Manager
  • Owner of the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth
  • Evolve data model and data schema based on business and engineering needs
  • Implement systems tracking data quality and consistency
  • Develop tools supporting self-service data pipeline management (ETL)
  • SQL and MapReduce job tuning to improve data processing performance


REQUIREMENTS:

  • 5+ years of relevant professional experience
  • 1+ years of experience with workflow management tools (Airflow, Oozie, Azkaban, UC4)
  • Strong experience with Spark
  • Experience with Hadoop (or similar) Ecosystem (MapReduce, Yarn, HDFS, Hive, Spark, Presto, Pig, HBase, Parquet)
  • Experience working on safety systems
  • Experience working with ADP Live Agent (not a must-have)
  • Strong skills in a scripting language (Python, Ruby, Bash)
  • Good understanding of SQL Engine and able to conduct advanced performance tuning
  • Proficient in at least one of the SQL languages (MySQL, PostgreSQL, SqlServer, Oracle)
  • Comfortable working directly with data analytics to bridge Lyft's business goals with data engineering
Kforce is an Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, protected veteran status, or disability status.


This job has expired.

More jobs for you in Recruitment Consultancy


Recruitment Consultancy

Posted about 17 hours ago

Adams and Associates
Recruitment Consultancy

Posted about 17 hours ago

Adams and Associates
Recruitment Consultancy

Posted about 15 hours ago

Adecco
View Recruitment Consultancy jobs »

New post from our employment blog

Share this job with the community

Click a community link below, and then social share the Data Engineer job.


African American Job Search Logo
Asian Job Search Logo
Disabled Job Seekers Logo
Hispanic Job Exchange Logo
LGBT Job Search Logo
Seniors to Work Logo
US Diversity Job Search Logo
Veteran Job Center Logo