hackajob · 3 hours ago
Principal Software Engineer (Data)- Onsite 4 days X week
New York, NY
Full-time
Onsite
Lead/Staff
$195K/yr - $292K/yr
15+ years expHackajob is collaborating with Comcast to connect exceptional tech professionals with a Principal Software Engineer role. This position involves designing and overseeing technology architecture and solutions for managing structured and unstructured data, while ensuring data quality and developing strategies for data acquisition and storage.
Artificial Intelligence (AI)Generative AIHuman ResourcesRecruitingSoftware
Responsibilities
Manages development of data structures and pipelines aligned to established standards and guidelines to organize, collect, standardize and transform data that helps generate insights and address reporting needs
Focuses on ensuring data quality during ingest, processing as well as final load to the target tables
Guides creation of standard ingestion frameworks for structured and unstructured data as well as checking and reporting on the quality of the data being processed
Creates standard methods for end users / downstream applications to consume data including but not limited to database views, extracts and Application Programming Interfaces
Develops and maintains information systems (e.g., data warehouses, data lakes) including data access Application Programming Interfaces
Participates in the implementation of solutions via data architecture, data engineering, or data manipulation on both on-prem platforms like Kubernetes and Teradata as well as Cloud platforms like Databricks
Determines the appropriate storage platform across different on-prem (minIO and Teradata) and Cloud (AWS S3, Redshift) depending on the privacy, access and sensitivity requirements
Understands the data lineage from source to the final semantic layer along with the transformation rules applied to enable faster troubleshooting and impact analysis during changes
Collaborates with technology and platform management partners to optimize data sourcing and processing rules to ensure appropriate data quality as well as process optimization
Creates establishes and oversees design standards and assurance processes for software, systems and applications development to ensure compatibility and operability of data connections, flows and storage requirements
Reviews internal and external business and product requirements for data operations and activity and suggests changes and upgrades to systems and storage to accommodate ongoing needs
Develops strategies for data acquisition, archive recovery, and database implementation
Manages data migrations/conversions and troubleshooting data processing issues
Understands the data sensitivity, customer data privacy rules and regulations and applies them consistently in all Information Lifecycle Management activities
Guides critical issue resolution and shares knowledge such as trends, aggregate, quantity volume regarding specific data sources
Consistent exercise of independent judgment and discretion in matters of significance
Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary
Other duties and responsibilities as assigned
Qualification
Required
15 Years + relevant work experience
Data Engineering skills
Collaboration skills
Big Data skills
Preferred
Bachelor's Degree
Some combination of coursework and experience, or extensive related professional experience
Benefits
Best-in-class Benefits
Array of options, expert guidance and always-on tools
Company
hackajob
The AI-native tech hiring platform trusted by enterprises, scale-ups, and 1M+ tech professionals worldwide.
51-200 employees
Funding
Current Stage
Growth StageTotal Funding
$33MKey Investors
Volition CapitalDowning VenturesTechstars
2023-05-03Series B· $25M
2018-10-25Series A· $6.7M
2017-03-31Seed· $0.58M
Leadership Team
Mark Chaffey
CEO
Phil Kell
VP - Marketplace
Recent News
2025-10-23
2025-09-26
2025-09-12
Company data provided by crunchbase