Senior Data Engineer Job at California Creative Solutions Inc., New York State

RnVscGJHSVNDblVzVXJhaXpHMWQvdVp2eWc9PQ==
  • California Creative Solutions Inc.
  • New York State

Job Description

Position Summary

We are looking for a Senior Data Engineer to expedite our Data Platform Stack to support our developers, database architects, and data analysts on data initiatives. The selected candidate will ensure that optimal data delivery architecture remains consistent throughout ongoing projects in a dynamic environment.

Responsibilities

  • Analyze and interpret complex data sets. Ability to identify data anomalies and resolve data issues.
  • Understand specific business processes and domain concepts and relate them to data subject domains.
  • Collaborate with Data Leads, Data Analysts, and QA Analysts to validate requirements; participate in user requirement sessions.
  • Perform tests and validate data flows and prepare ETL processes according to business requirements.
  • Perform ETL tuning and SQL tuning.
  • Document data flows representing business logic in ETL routines.
  • Design and implement a data conversion strategy from legacy to new platforms.
  • Perform design validation, reconciliation, and error handling in data load processes.
  • Design and prepare technical specifications and guidelines, including ER diagrams and related documents.

Qualifications

  • Must be well-versed in data warehousing concepts, including design patterns (Star schemas, Snowflake design schemas). Must be aware of data modeling concepts, including the data modeling Normal forms.
  • Knowledge of AWS Infrastructure, including S3, SNS, EC2, CloudWatch, and RDS.
  • 7+ years working in ETL/Data transformation projects with one or more related products such as Informatica, Talend, or Microsoft SSIS.
  • 7+ years working in business intelligence and data warehousing initiatives.
  • Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL), as well as working familiarity with a variety of databases like Oracle, MS SQL Server, or Vertica.
  • Good to have:
    • At least 1+ years working with the Matillion ELT tool and Snowflake Database.
    • Experience in building AWS Data Pipelines using Python or Spark, SparkSQL in any Cloud Environment (AWS/Azure/Google).
    • Experience with any of the NoSQL datastores such as Elasticsearch, MongoDB, DynamoDB, or Cassandra.

Education/Experience

  • Bachelor's in Mathematics, Computer Science, or related technical field. Postgraduate degree preferred.
  • Minimum 5 years of relevant experience.

Job Tags

Full time, Part time, Seasonal work,

Similar Jobs

GSS Marine

Master, chief officer, chief engineer, second officer, second engineer Job at GSS Marine

 ...due to the number of vacant positions in our opening. We intend to recruit several seafarers such as Master, chief officer, chief engineer, second engineer, second officer, ETO, Safety officer, Business development manager, QA/QC engineer. Employment Type: Part-Time... 

ROUSH

CDL A Test Driver Job at ROUSH

 ...premium Roush has an immediate need for a full-timeCDL A Test Driver. Get paid to test drive prototype trucks and give feedback to...  ...responsible for evaluating a variety of CDL license required vehicles. The role will drive vehicles on designated routes and report... 

Passages to Recovery

Intake Specialist/ Court Liaison Job at Passages to Recovery

 ...Purpose: The role of intake specialist/court liaison involves conducting comprehensive assessments, providing initial support, and...  ...Serve as the primary point of contact for courts, probation officers, and legal representatives regarding client cases and treatment... 

Daily Jobs

Data Entry Clerk Night Shift Job at Daily Jobs

 ...work schedule, apply today. Responsibilities: - Answer customer concerns via messages, or live chat. - Carry out various data entry tasks with accuracy. - Take part in sales calls based on your experience and comfort level. - Input data into our database system... 

KSDT CPA

Forensic accounting senior associate Job at KSDT CPA

 ...Job Title: Senior Associate/Supervisor Forensic Accounting Location: Miami, FL (Hybrid) About Us: KSDT CPA is a leading CPA firm known for flexibility, a collaborative culture, and leadership opportunities. Were dedicated to providing top-tier services...