Dexian · 7 hours ago
Big Data Developer
Dexian is a leading provider of staffing, IT, and workforce solutions with over 12,000 employees. They are seeking a Big Data Developer to design, build, and support data pipelines while optimizing large-scale distributed data processing systems.
Responsibilities
Design, build, and support near-real-time and batch data pipelines
Develop and optimize large-scale distributed data processing systems
Work closely with cross-functional teams in an Agile environment
Troubleshoot, tune, and enhance performance of Spark, MapReduce, and SQL workloads
Partner with stakeholders to understand requirements and deliver effective data solutions
Qualification
Required
Strong SQL skills (one or more of MySQL, Hive, Impala, Spark SQL)
Experience with Hadoop/Big Data ecosystems and distributed systems
Hands-on experience with Spark (including Structured Streaming), Sqoop, Kafka, MapReduce
Experience with NoSQL technologies such as HBase, Solr
Exposure to Cloudera (CDP/HDP), ElasticSearch, Kibana
Experience ingesting data from message queues, file shares, REST APIs, and relational databases
Familiarity with data formats such as JSON, CSV, XML
Hands-on programming experience in Scala, Python, Shell scripting (PHP a plus)
Performance tuning experience for Spark, MapReduce, and SQL jobs
Strong proficiency with Linux
Experience with source control (Git, SVN, Bitbucket)
Working knowledge of Jenkins and JAR/package management
Company
Dexian
Dexian provides services for staffing, talent development, and consulting, with a focus on technology, finance, and project management.
H1B Sponsorship
Dexian has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (65)
Funding
Current Stage
Late StageRecent News
2025-11-19
Company data provided by crunchbase