Smart IT Frame LLC · 12 hours ago
AWS Data Engineer (Consent Management)
United States
Full-time
Remote
Senior Level
5+ years expSmart IT Frame LLC is seeking an AWS Data Engineer specializing in Consent Management. The role involves designing and building scalable data transformation pipelines, maintaining data architecture, and ensuring the smooth operation of data pipelines while collaborating with cross-functional teams.
Business DevelopmentConsultingInformation TechnologyRecruiting
Hiring Manager
Shubh S Gupta
Responsibilities
Design and build robust, scalable data transformation pipelines using SQL, DBT, and Jinja templating
Develop and maintain data architecture and standards for Data Integration and Data Warehousing projects using DBT and Amazon Redshift
Monitor and ensure the smooth operation of data pipelines between OneTrust (OT) application and external data platforms (ESPs, CRMs, etc.)
Collaborate with cross-functional teams to gather requirements and deliver dimensional data models that serve as a single source of truth
Assist in the ongoing data integration tasks (e.g., connectors, APIs) between OT and various business systems
Own the full stack of data modeling in DBT to empower analysts, data scientists, and BI engineers
Enhance and maintain the analytics codebase, including DBT models, SQL scripts, and ERD documentation
Familiarize regulatory compliance guidelines across different geographical areas (CCPA, GDPR) and integrate them into current and new pipelines for consent collection
Ensure data quality, governance alignment, and operational readiness of data pipelines
Apply software engineering best practices such as version control, CI/CD, and code reviews
Optimize SQL queries for performance, scalability, and maintainability across large datasets
Implement best practices for SQL performance tuning, including partitioning, clustering, and materialized views
Build and manage infrastructure as code using AWS CDK for scalable and repeatable deployments. Integrate and automate deployment workflows using AWS CodeCommit, CodePipeline, and related DevOps tools
Support Agile development processes and collaborate with offshore teams
Qualification
Required
Bachelor's or Master's (preferred) degree in a quantitative or technical field such as Statistics, Mathematics, Computer Science, Information Technology, Computer Engineering or equivalent
5+ years of experience in data engineering and analytics on modern data platforms
3+ years' extensive experience with DBT or similar data transformation tools, including building complex & maintainable DBT models and developing DBT packages/macros
Deep familiarity with dimensional modeling/data warehousing concepts and expertise in designing, implementing, operating, and extending enterprise dimensional models
Understand change data capture concepts
Experience working with AWS Services (Lambda, Step Functions, MWAA, Glue, Redshift)
Hands-on experience with AWS CDK, CodeCommit, and CodePipeline for infrastructure automation and CI/CD
Python proficiency or general knowledge of Jinja templating in Python and/or PySpark
Agile experience and willingness to work with extended offshore teams and assist with design and code reviews with customer
A great teammate and self-starter, strong detail orientation is critical in this role
Preferred
Familiarity with OneTrust or similar consent management platforms is a plus
Company
Smart IT Frame LLC
Smart IT Frame is a leading NMSDC-certified staffing partner, founded in 2012 and headquartered in Somerset, New Jersey.
501-1000 employees
H1B Sponsorship
Smart IT Frame LLC has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2025 (11)
2024 (9)
2023 (11)
2022 (8)
2021 (9)
2020 (9)
Funding
Current Stage
Late StageLeadership Team
Murali Kulala
Chief Executive Officer
Recent News
2025-07-01
2025-06-30
Tech Startups - Startups and Technology news
2025-06-27
Company data provided by crunchbase