This job has closed.

Pyramid Consulting, Inc · 1 month ago

Principal Big Data Engineer

Durham, NC

Full-time

Onsite

Lead/Staff

$63/hr - $73/hr

10+ years exp

Pyramid Consulting, Inc. is seeking a highly motivated Principal Big Data Engineer for a contract opportunity with long-term potential. The role involves driving the design and development of external facing API solutions to support fintech partners in achieving their financial objectives.

ConsultingInformation TechnologyLegalProfessional ServicesSoftwareStaffing Agency

Growth Opportunities

H1B Sponsor Likely

Responsibilities

We are seeking a highly motivated Data Engineer to join the Data Aggregation team

Data Aggregation is a growing area and we are looking for a skilled engineer to drive design and development of industry leading external facing API solutions

The comprehensive API / data solutions will seek to bring together retail, clearing and custody capabilities to help external fintech partners with the financial goal planning, investment advice and financial projections capabilities to better serve our clients and more efficiently partner with them to accomplish their financial objectives

Qualification

Apache SparkAWSCassandra/YugaByteETL designDevOps & CI/CDMonitoring & ObservabilityOrchestrationFinancial domain experienceScalaDockerKubernetesTerraformGitSplunkDatadog APMGrafanaCloudWatchControl-M

Required

Bachelor's or Master's Degree in a technology related field (e.g. Engineering, Computer Science, etc.) required with 10 years of working experience

Big Data Processing: Apache Spark (EMR), Scala, distributed computing, performance optimization

Cloud & Infrastructure: AWS (S3, EMR, EC2, Lambda, Step Functions), multi-region DR strategy

Databases: Cassandra/YugaByte (NoSQL), Oracle, PostgreSQL

Snowflake Data Pipeline: ETL design, API integration, batch processing

DevOps & CI/CD: Jenkins, Docker, Kubernetes, Terraform, Git

Monitoring & Observability: Splunk, Datadog APM, Grafana, CloudWatch

Orchestration: Control-M job scheduling, workflow automation

Financial domain experience

Benefits

Health insurance (medical, dental, vision)

401(k) plan

Paid sick leave (depending on work location)

Company

Pyramid Consulting, Inc

Glassdoor4.2

Pyramid Consulting, a global leader in workforce and technology solutions, empowers individuals and organizations to transform and thrive in the most challenging and competitive markets.

Founded in 1996

Alpharetta, Georgia, USA

5001-10000 employees

https://pyramidci.com/

H1B Sponsorship

Pyramid Consulting, Inc has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Represents job field similar to this job

Trends of Total Sponsorships

2025 (178)

2024 (112)

2023 (95)

2022 (62)

2021 (50)

2020 (117)