Orion Groups · 1 day ago
GCP Data Engineer
United States
Full-time
Remote
Senior Level
$130K/yr - $140K/yr
5+ years exp
Maximize your interview chancesInformation Technology & Services
Insider Connection @Orion Groups
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Design, develop, and implement scalable, high-performance data solutions on GCP.
Curate and manage a comprehensive data set detailing user permissions and group memberships.
Redesign and implement the existing data pipeline to improve scalability and reduce processing time.
Ensure that changes to data access permissions are reflected in the Tableau dashboard within 24 hours.
Collaborate with technical and business users to share and manage data sets across multiple projects.
Utilize GCP tools and technologies to optimize data processing and storage.
Re-architect the data pipeline that builds the BigQuery dataset used for GCP IAM dashboards to make it more scalable.
Run and customize DLP scans.
Build bidirectional integrations between GCP and Collibra.
Explore and potentially implement Dataplex and custom format-preserving encryption for de-identifying data for developers in lower environments.
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
5+ years of experience in an engineering role using Python, Java, Spark, and SQL.
5+ years of experience working as a Data Engineer in GCP.
Proficiency with Google’s Identity and Access Management (IAM) API.
Experience with GCP platform development tools such as Pub/Sub, Cloud Storage, Bigtable, BigQuery, Dataflow, Dataproc, and Composer.
Strong experience working with real-time streaming applications and batch-style large-scale distributed computing applications using tools like Spark, Kafka, Flume, Pub/Sub, and Airflow.
Metadata extraction pipeline design and creation between raw and transformed datasets.
Coding skills in Scala.
Knowledge in Hadoop, cloud platforms and surrounding ecosystems.
Bachelor’s degree in Computer Science, Information Technology, Mathematics, or a related field, or equivalent work experience.
Preferred
Experience working in a healthcare environment.
Company
Orion Groups
Orion Groups Consulting and Staffing, based in Dallas-Fort Worth Texas, has established a trusted relationship among clients in the Hospitals and Healthcare, Financial Services and Transportation Industries nationwide.
51-200 employees
Funding
Current Stage
Growth StageLeadership Team
Courtney Jones
Co-Founder and Chief Executive Officer
Richard Jones
Co-Founder, Orion Groups
Company data provided by crunchbase
