Be an early applicantLess than 25 applicants
Diverse Lynx · 3 days ago
Sr Data Engineer
Philadelphia, PA
Full-time
Onsite
Senior Level
10+ years exp
Wonder how qualified you are to the job?
Maximize your interview chancesSoftware Development
Insider Connection @Diverse Lynx
Responsibilities
Hands-on architecture/development of ETL pipelines using our internal framework written in Java.
Hands-on architecture of real-time REST APIs or other solutions for streaming data from Graph using Spark.
Interpret data, analyze results using statistical techniques and provide ongoing reports.
Develop and implement databases, data collection systems, data analytics, and other strategies that optimize statistical efficiency and quality.
Experienced with Databricks.
Acquire data from primary or secondary data sources and maintain databases/data systems.
Identify, analyze, and interpret trends or patterns in complex data sets.
Filter and clean data by reviewing reports and performance indicators to locate and correct problems.
Work with management to prioritize business and information needs.
Locate and define new process improvement opportunities.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Scala Spark, Python, Big Data, Kafka, AWS, Oracle SQL, Hive SQL, Databricks, and Jenkins experience
Hands-on architecture/development of ETL pipelines using Java
Hands-on architecture of real-time REST APIs or other solutions for streaming data from Graph using Spark
Interpret data, analyze results using statistical techniques and provide ongoing reports
Develop and implement databases, data collection systems, data analytics, and other strategies that optimize statistical efficiency and quality
Experienced with Databricks
Acquire data from primary or secondary data sources and maintain databases/data systems
Identify, analyze, and interpret trends or patterns in complex data sets
Filter and clean data by reviewing reports and performance indicators to locate and correct problems
Work with management to prioritize business and information needs
Locate and define new process improvement opportunities
Company
Diverse Lynx
We are a WBENC and NMSDC certified company helping our clients in their Diversity spending on Staffing or Contingent Workforce Services.
1,001-5,000 employees
Funding
Current Stage
Late StageLeadership Team
Sujata Varma
CEO
Recent News
Company data provided by crunchbase
