44 applicantsPosted by Agency
This job has closed.
Beacon Hill Staffing Group ยท 1 week ago
AWS Cloud Engineer
Remote
Contract
Remote
Mid Level
3+ years exp
Wonder how qualified you are to the job?
Staffing Agency
Insider Connection @Beacon Hill Staffing Group
Responsibilities
Collaborate with data engineering, business analysts, and development teams to design, develop, test, and maintain robust and scalable data pipelines from Workday to AWS Redshift.
Architect, implement, and manage end-to-end data pipelines, ensuring data accuracy, reliability, data quality, performance, and timeliness.
Provide expertise in Redshift database optimization, performance tuning, and query optimization.
Assist with design and implementation of workflows using Airflow.
Perform data profiling and analysis to troubleshoot data-related challenges/issues and build solutions to address those concerns.
Proactively identify opportunities to automate tasks and develop reusable frameworks.
Work closely with version control team to maintain a well-organized and documented repository of codes, scripts, and configurations using Git/Bitbucket.
Provide technical guidance and mentorship to fellow developers, sharing insights into best practices, tips, and techniques for optimizing Redshift-based data solutions.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Advanced hands-on experience designing AWS data lake solutions.
Experience integrating Redshift with other AWS services, such as DMS, Glue, Lambda, S3, Athena, Airflow.
Proficiency in Python programming with a focus on developing efficient Airflow DAGs and operators.
Experience with Pyspark and Glue ETL scripting including functions like relationalize, performing joins and transforming dataframes with pyspark code.
Competency developing CloudFormation templates to deploy AWS infrastructure, including YAML defined IAM policies and roles.
Experience with Airflow DAG creation.
Familiarity with debugging serverless applications using AWS tooling like Cloudwatch Logs & Log Insights, Cloudtrail, IAM.
Ability to work in a highly complex python object-oriented platform.
Strong understanding of ETL best practices, data integration, data modeling, and data transformation.
Proficiency in identifying and resolving performance bottleneck and fine-tuning Redshift queries.
Familiarity with version control systems, particularly Git, for maintaining a structured code repository.
Strong coding and problem-solving skills, and attention to detail in data quality and accuracy.
Ability to work collaboratively in a fast-paced, agile environment and effectively communicate technical concepts to non-technical stakeholders.
Preferred
Docker
Airflow Server Administration
Parquet file formats
AWS Security
Jupyter Notebooks
API Best Practices, API Gateway, Route Structuring and standard API authentication protocols including tokens
Git, Git flow best practices
Release management and DevOps
Shell scripting
AWS certifications related to data engineering or databases are a plus.
Experience with DevOps technologies and processes.
Experience with complex ETL scenarios, such as CDC and SCD logics, and integrating data from multiple source systems.
Experience in converting Oracle scripts and Stored Procedures to Redshift equivalents.
Experience working with large-scale, high-volume data environments.
Exposure to higher education, finance, and/or human resources data is a plus.
Proficiency in SQL programming and Redshift stored procedures for efficient data manipulation and transformation.
AWS certifications related to data engineering or databases are a plus.
Company
Beacon Hill Staffing Group
Beacon Hill Staffing Group is a Staffing and Recruiting company.
1,001-5,000 employees
H1B Sponsorship
Beacon Hill Staffing Group has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Trends of Total Sponsorships
2023 (57)
2022 (62)
2021 (73)
2020 (77)
Funding
Current Stage
Late StageLeadership Team
Amber Leslie
Executive Assistant to CEO
Amy Van Sicklin
Chief Culture Officer
Recent News
2023-12-22
Company data provided by crunchbase
