ConsultNet Technology Services and Solutions · 1 day ago
Big Data Engineer
Rockville, MD
Full-time
Hybrid
Senior Level
5+ years expConsultNet Technology Services and Solutions is a premier national provider of technology talent and solutions. They are seeking an experienced Big Data Engineer to design, build, and optimize large-scale data processing systems, collaborating with various teams to deliver reliable data pipelines that support data-driven decision-making.
Human ResourcesInformation TechnologyStaffing Agency
Responsibilities
Design, develop, and maintain scalable data pipelines using technologies such as Spark, Hadoop, Python, and Scala
Build and optimize data ingestion, transformation, and storage solutions for large-scale datasets
Optimize existing data pipelines for performance, scalability, and reliability
Collaborate with cross-functional teams to translate business requirements into technical solutions
Monitor, troubleshoot, and resolve data pipeline issues in production environments
Implement automated testing and data quality checks across pipelines
Stay current with emerging big data and cloud technologies to continuously improve the platform
Support data scientists and analysts by enabling reliable access to high-quality data
Qualification
Required
Bachelor's degree in Computer Science or a related field, or equivalent experience
5+ years of experience building enterprise-scale data solutions
Strong experience with big data technologies such as Spark, Hadoop, Hive, and Trino
Proficiency in Python or Scala, with solid object-oriented and/or functional programming skills
Strong SQL skills, including complex queries, joins, and window functions
Experience working with large datasets and troubleshooting performance, scalability, and data quality issues
Experience with cloud platforms, preferably AWS (e.g., S3, EMR, Glue, Athena, Lambda)
Familiarity with Agile development practices and CI/CD pipelines
Strong communication skills and ability to work effectively in a fast-paced environment
Preferred
Experience managing production ETL or data pipeline systems
Exposure to AI-assisted development tools (e.g., Copilot, ChatGPT, Q Developer)
Experience with Spark performance tuning and optimization
AWS certifications or equivalent cloud experience
Company
ConsultNet Technology Services and Solutions
ConsultNet is a talent solutions company that helps businesses solve complex challenges by integrating talent, technology, and scalable delivery models.
201-500 employees
H1B Sponsorship
ConsultNet Technology Services and Solutions has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (6)
2024 (6)
2023 (7)
2022 (6)
2021 (6)
2020 (9)
Funding
Current Stage
Growth StageLeadership Team
Marnie Nuttall
Chief Financial Officer
Company data provided by crunchbase