INSPYR Solutions ยท 1 week ago
Data Engineer
Wonder how qualified you are to the job?
Information TechnologyProfessional Services
Actively Hiring
Insider Connection @INSPYR Solutions
Responsibilities
Design, develop, and maintain scalable data pipelines and infrastructure.
Collaborate with data scientists and analysts to understand data requirements and implement solutions.
Develop and optimize SQL queries for data extraction, transformation, and loading (ETL) processes.
Implement data quality checks and monitoring to ensure data accuracy and consistency.
Work with stakeholders to gather requirements and prioritize tasks.
Troubleshoot and resolve issues related to data processing and pipeline performance.
Utilize version control systems, such as Git and GitHub, for managing codebase and collaborating with team members.
Implement best practices for data engineering, including data governance, security, and compliance.
Stay current with industry trends and emerging technologies in data engineering and analytics.
Document data pipelines, processes, and workflows for knowledge sharing and future reference.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Bachelor's degree in Computer Science, Engineering, or related field.
Proven experience as a Data Engineer or similar role.
Strong programming skills in Python, with experience in data processing libraries such as Pandas, NumPy, and PySpark.
Proficiency in SQL and database management systems (e.g., PostgreSQL, MySQL, SQL Server).
Experience with workflow orchestration tools, such as Apache Airflow.
Familiarity with version control systems, particularly Git and GitHub.
Experience working with large-scale data platforms and distributed computing frameworks (e.g., Hadoop, Spark).
Solid understanding of data modeling, schema design, and data warehousing concepts.
Excellent problem-solving and analytical skills.
Strong communication and collaboration abilities.
Preferred
Master's degree in Computer Science, Engineering, or related field.
Certification in relevant technologies (e.g., AWS Certified Big Data - Specialty).
Experience with containerization and orchestration technologies (e.g., Docker, Kubernetes).
Knowledge of streaming data processing technologies (e.g., Kafka, Apache Flink).
Experience with cloud platforms (e.g., AWS, Azure, Google Cloud Platform).
Benefits
Comprehensive medical benefits
Competitive pay
401(k)
Retirement plan
Company
INSPYR Solutions
INSPYR Solutions is a information technology staffing service providers.
Funding
Current Stage
Late StageLeadership Team
Recent News
Company data provided by crunchbase