IbleSoft Inc. · 2 months ago
Sr. Big Data Analyst / Developer
Doral, FL
Full-time
Onsite
Mid, Senior Level
3+ years expIbleSoft Inc. is looking for a Sr. Big Data Analyst / Developer to build an enterprise data warehouse for integrating and analyzing important organizational data. The role involves developing analytics pipelines, writing complex queries, and collaborating with cross-functional teams to enhance data quality and system performance.
Enterprise SoftwareSoftware
Responsibilities
Develop batch and streaming analytics pipelines using Apache Spark and Scala programming to materialize and refine the event results and improve its processing time
Write advanced Hive, Spark SQL queries against data warehouses utilizing large datasets
Built object-oriented and functional Scala programs with Apache Spark clean and transform features that performs aggregations to integrate to machine learning models
Ensure that all feature deliverable’s meet quality objectives in functionality, methodologies, performance, stability, security, accessibility and data quality
Design and develop advanced analytics software components using Apache Spark, Scala, AWS and Hadoop Ecosystem and integrate it with various machine learning models that are architected for re-use
Design, document, and develop complex data extracts, applications and ad-hoc queries as requested by internal and external customers using Hive and Scala transformations
Develop Hive scripts and EMR (Elastic Map Reduce) mappings using Amazon Web Services EMR to integrate data from different sources and apply required transformations before loading to target databases
Manage the implementation of statistical data quality procedures on new data sources by applying rigorous iterative data analytics to improve scaling and system performance
Develop ETL code in various databases like snowflake computing and Denoda
Work on performance tuning and resource optimization of databases like SQL Server to improve the overall performance of the system
Develop and maintain data engineering best practices and contribute to Insights on data analytics and visualization concepts, methods and techniques to make the system robust and compatible to adhere the changes in data requirements in future
Work closely with other Data Scientists, analysts, designers and project teams to identify new areas of research
Analyze the production data issues to find the root cause and provide permanent fix to avoid similar issues in future
Creates and maintains Big Data Analytic pipeline engine specifications and process documentation to produce the required data deliverables (data transformation/actions, data profiling, source to target maps, ETL flows)
Collaborate with business analysts and stake holders to understand the business requirements and ensure the quality of data
Create solutions to real world problems and verify the results of the work deployed
Prepare project and system related documentation consistent with standards and procedures outlined in the data architecture approach including data quality, security and availability requirements
Work with DBA’s and QA team to move the code developed to production environment using GIT version control and BitBucket
Work with cross-functional teams, such as Product management, Platform, Operations and Mobile device engineering to elaborate on functional requirements/designs of the mobile wireless analytics modules, based on the product level requirements and designs
Use Jira or confluence for defect tracking and documentation
Implement unit test cases for various modules and coordinated with QA team for production deployments/releases
Participate in Daily Sprint Meetings; Coordinate with other team members in understanding the requirements and provide best analysis for continuing with the development
Qualification
Required
Master 's degree in Computer Science Engineering, Information Technology, Computer Applications, any other related field
3-9 years of experience
Benefits
All employees of Iblesoft, Inc. are automatically enrolled in the employee referral program of the company.
Referral fee of $1,000 will be paid if referred candidate is hired by the company.
Company
IbleSoft Inc.
Iblesoft Inc. is a full service software development, global resource placement and business-consulting firm based in Doral, FL.
51-200 employees
H1B Sponsorship
IbleSoft Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2024 (9)
2023 (34)
2022 (7)
2021 (48)
2020 (50)
Funding
Current Stage
Growth StageRecent News
Company data provided by crunchbase