Job details for
Senior Data Engineer

Senior Data Engineer

Job Info

Category: Data
Company Description: Tech Firm Turning Social Media into Actionable Alerts
Salary: Highly Competitive, Depending on Experience
Position Type: Permanent
Job Number: 10633

Job Description

Who you are:

You're an experienced Data Engineer interested in working in both streaming and batch processing environments [Kafka streaming, Kinesis, Spark, SCALA, Java], writing, upgrading and scheduling ETLs that produce meaningful analytic insights for an innovative, data-intensive product.  You excel at integrating data from different sources, you are intellectually curious about analytics frameworks and you are well-versed in the advantages and limitations of various big data architectures and technologies. You are also comfortable using SQL for exploratory analyses and data validation. Importantly, you understand the importance of communication in engineering and how essential it is to appreciate business metrics and business needs when building out new data analytics pipelines. You have a history of mentoring other engineers, you give your time generously and you know when to ask for help.

The opportunity:

You will be a lead data engineer responsible for architecting and building highly-performant and maintainable analytic pipelines with the best of current technologies including both batch and streaming environments. You will write and maintain ETLs and APIs and consult with other teams on how to improve theirs. You will schedule jobs and manage workflows in support of both product and our AI/Data Science pipeline, and you’ll be introduced to our unique ingest and processing pipelines that turn publicly available data into breaking, real-world alerts that are  routed to our customers all over the world. In the first month, you’ll

  • start off by learning the ropes, spending time with different parts of the company to understand how we work.
  • get up to speed on our data processing pipelines and data structures with overview sessions and deep dives with your team.
  • contribute code to production systems.

Within 3 months, you’ll:

  • share responsibility for ETLs and APIs with other members of your team.
  • help to plan new infrastructure features and improvements.
  • begin to take more of a role in helping others understand our analytics strategy.

Within 6 months, you’ll:

  • own an area of the analytics platform.
  • design and implement pipelines that impact multiple teams across the company.
  • be influential in helping plan the next iteration of our analytics platform.
  • bring new ideas to our engineering and analytics processes to help us continuously improve.

Andiamo is an Equal Opportunity Employer

Andiamo provides equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability or genetics. In addition to federal law requirements, Andiamo complies with applicable state and local laws governing nondiscrimination in employment in every location in which the company has facilities. This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

All qualified candidates are encouraged to apply by submitting their resume as an MS word document including a cover letter with a summary of relevant qualifications, highlighting clearly any special or relevant experience.
Arianna Gelwicks

Arianna Gelwicks

Technology Talent Acquisition Specialist

Contact Recruiter

17 State Street, 8th floor
New York, New York 10004

Please Note: All inquiries will be treated with the utmost confidentiality. Your resume will not be submitted to any client company without your prior knowledge and consent.

Contact Us