City of New York · 9 hours ago
Data Engineer
Manhattan, NY
Full-time
Onsite
Mid, Senior Level
$75K/yr - $128K/yr
4+ years expThe City of New York is seeking a highly skilled Data Engineer to support the Enterprise Data Science and Engineering Unit. The role involves architecting and maintaining scalable data pipelines, managing data warehouses, and collaborating with analysts to provide actionable insights for the Department of Sustainable Delivery.
GovernmentLegalPublic Relations
Responsibilities
Architect, implement, and maintain scalable data pipelines using Apache NiFi for ETL and real-time data integration
Design, optimize, and manage Snowflake data warehouses, including schema design, performance tuning, and security controls
Administer Linux-based cloud environments (Azure, AWS, or GCP), including automation of deployments, patching, and monitoring
Develop and maintain CI/CD workflows for data engineering solutions
Collaborate with data scientists and analysts to deliver high-quality, production-ready datasets and analytics solutions
Implement robust data governance, lineage, and auditing practices
Troubleshoot and resolve issues across the data platform, including connectivity, performance, and security
Mentor Agency staff and contribute to technical best practices and documentation
Perform other data engineering tasks as assigned to support a dynamic and fast-paced team
Qualification
Required
A baccalaureate degree from an accredited college in computer science, engineering or a related field and four years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering
A baccalaureate degree from an accredited college and eight years of satisfactory full-time experience related to datacenter engineering and operations, cloud engineering and operations, complex IT infrastructure engineering
Education and/or experience which is equivalent to '1' or '2' above
architect, implement, and maintain scalable data pipelines using Apache NiFi for ETL and real-time data integration
design, optimize, and manage Snowflake data warehouses, including schema design, performance tuning, and security controls
administer Linux-based cloud environments (Azure, AWS, or GCP), including automation of deployments, patching, and monitoring
develop and maintain CI/CD workflows for data engineering solutions
collaborate with data scientists and analysts to deliver high-quality, production-ready datasets and analytics solutions
implement robust data governance, lineage, and auditing practices
troubleshoot and resolve issues across the data platform, including connectivity, performance, and security
mentor Agency staff and contribute to technical best practices and documentation
perform other data engineering tasks as assigned to support a dynamic and fast-paced team
Preferred
3+ years hands-on experience architecting and operating Apache NiFi flows in production
3+ years of advanced Snowflake experience, including data sharing, security, and performance optimization
Strong Linux administration skills in cloud environments experience with shell scripting and automation tools
Fluency in Python, SQL
Experience integrating NiFi with cloud storage, databases, and APIs
Familiarity with infrastructure-as-code (Terraform, Ansible) for cloud resource management
Experience with Git-based workflows, including branching, merging, pull requests, and version control best practices
Experience with monitoring, alerting, and logging solutions for data platforms
Knowledge of secure data handling, including TLS/SSL, role-based access, and compliance standards
Cloud certification (Azure, AWS, or GCP) highly desirable
Excellent organizational and interpersonal skills and ability to work cross-functionally
Ability to effectively prioritize and execute tasks in a high-pressure environment
Ability to understand and gather client requirements as well as provide a solution that meets or exceeds client expectations
Benefits
Public Service Loan Forgiveness
Company
City of New York
City of New York, often called as New York City, is the most populous city in United States.
10001+ employees
Funding
Current Stage
Late StageLeadership Team
Carl G Esposito
Chief Information Security Officer
Dawn Miller
Senior Advisor to the Chief Climate Officer
Recent News
The Real Deal
2026-01-02
bloomberglaw.com
2026-01-02
2025-12-26
Company data provided by crunchbase