DS Technologies Inc · 2 months ago
Full Stack Developer OpenSearch Development
United States
Full-time
Remote
Mid, Senior LevelDS Technologies Inc is a company that provides innovative, transformative IT services and solutions. They are seeking a Full Stack Developer for OpenSearch Development to design, build, and maintain large-scale data ingestion, transformation, and indexing pipelines, ensuring high-performing and scalable data workflows.
Information Technology & Services
Responsibilities
Design and implement ETL (Extract, Transform, Load) processes to handle complex data ingestion workflows
Develop data pipelines to collect, normalize, and route high-volume log and telemetry data from multiple sources (network, OSS/BSS, application systems)
Migrate existing data sets from Splunk to OpenSearch, ensuring data integrity, consistency, and traceability
Optimize ingestion and query performance through indexing, partitioning, and caching strategies
Configure, manage, and maintain OpenSearch clusters, ensuring scalability, fault tolerance, and performance optimization
Design and implement indexing strategies and mappings for high-volume network data
Implement fine-grained access control, data lifecycle management, and retention policies
Create dashboards and analytics visualizations for operational insights, where applicable
Develop Java-based backend services and utilities that support data ingestion, query processing, and API integrations
Write efficient scripts and automation utilities using Python, Perl, or JavaScript for ETL orchestration and validation
Develop and maintain Kafka producers/consumers for real-time event streaming and data flow into OpenSearch
Write and execute unit, integration, and performance tests to validate data migration and ingestion workflows
Implement CI/CD automation using GitLab pipelines for build, test, and deployment
Deploy services and data pipelines in Linux-based environments, ensuring robust monitoring and rollback capabilities
Troubleshoot data ingestion or indexing issues and optimize for minimal latency and maximum reliability
Establish data governance standards to ensure only relevant and useful data is logged and retained in OpenSearch
Document system architecture, APIs, data schemas, ETL workflows, and deployment pipelines
Work with architects, data scientists, and observability leads to align OpenSearch development with broader platform goals
Contribute to the team’s knowledge base and technical best practices for maintainability and future scalability
Qualification
Required
Programming Languages: Java, Python, JavaScript, Perl
Data Engineering: ETL workflow design, data transformation, and ingestion pipeline management
Search Technologies: OpenSearch (or Elasticsearch), index tuning, query optimization, cluster scaling
Streaming: Kafka (producers, consumers, schema design, delivery guarantees)
Version Control & CI/CD: GitLab
Operating Systems: Linux (shell scripting, deployment automation, monitoring)
Strong analytical and problem-solving abilities for large-scale data systems
Excellent communication and documentation skills to interface with cross-functional teams
Ability to work independently while maintaining tight collaboration with onshore and offshore counterparts
Proven capability to deliver results under tight deadlines in a dynamic environment
Preferred
Migration of large data volumes from Splunk to OpenSearch or similar observability platform transitions
Experience managing 100% network data ingestion pipelines or high-throughput log management systems
Familiarity with data retention and governance best practices for observability data
Understanding of telecom network operations, monitoring, and telemetry data structures
Company
DS Technologies Inc
DS Technologies Inc - SUCCESS IS OUR DUTY At DS Technologies, we’re more than just a technology provider – we’re your strategic partner in navigating the digital revolution.
Founded in 2018
51-200 employees
H1B Sponsorship
DS Technologies Inc has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (2)
2024 (2)
2022 (5)
2021 (4)
Funding
Current Stage
Growth StageCompany data provided by crunchbase