155 applicants

Company

Original Job Post

Brillio · 2 days ago

ETL Automation Tester

United States

Full-time

Onsite

Senior Level

8+ years exp

Wonder how qualified you are to the job?

Maximize your interview chances

AnalyticsArtificial Intelligence (AI)

H1B Sponsorship

Insider Connection @Brillio

Discover valuable connections within the company who might provide insights and potential referrals, giving your job application an inside edge.

Responsibilities

Implement ETL & Data Quality automation testing with hands-on experience.

Utilize SQL, Python, PySpark, Airflow for testing.

Work on Cloud implementation experience on GCP services like BigQuery, Dataproc, Google cloud storage, Composer, Looker or equivalent services on AWS / Azure.

Handle file formats such as csv, orc, parquet, JSON, xml.

Perform data profiling using Python libraries like pandas, numpy, scipy, matplotlib, plotly, seaborn.

Implement Data Quality Validations on Data Lake and Data Warehouse.

Utilize data science libraries like Great Expectations, ydata-profiling, lux, DataProfiler, scikit-learn.

Work with technologies like Druid, HIVE SQL, HDFS, Flink, NoSQL like MongoDB or Cassandra.

Consume data via APIs, and work with Logging, Monitoring, Notification tools like new relic, Grafana, Prometheus.

Implement DevOps, CI/CD using Git, Jenkins.

Possess Telecom domain knowledge.

Qualification

Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.

ETLData QualityAutomation TestingSQLPythonPySparkAirflowCloud ImplementationGCPBigQueryDataprocGoogle Cloud StorageComposerLookerAWSAzureFile FormatsCSVORCParquetJSONXMLData ProfilingPython LibrariesPandasNumpyScipyMatplotlibPlotlySeaborn

Required

8+ years of hands-on experience in implementing ETL & Data Quality automation testing

Strong hands on experience using SQL, Python, PySpark, Airflow

Cloud implementation experience on GCP services - BigQuery, Dataproc, Google cloud storage, Composer, Looker OR equivalent services on AWS / Azure

Handling File formats: csv, orc, parquet, JSON, xml

Data profiling skills using Python libraries viz. pandas, numpy, scipy, matplotlib, plotly, seaborn

Preferred

Implementation of Data Quality Validations on Data Lake and Data Warehouse

Data profiling and data science libraries viz., Great Expectations, ydata-profiling, lux, DataProfiler, scikit-learn

Other technologies like; Druid, HIVE SQL, HDFS, Flink, NoSQL like MongoDB or Cassandra

Data consumption via APIs

Logging, Monitoring, Notification tools like - new relic, Grafana, Prometheus

DevOps, CI/CD using Git, Jenkins

Telecom domain knowledge

Company

Brillio

Glassdoor

3.9

Brillio is a technology consulting and technology services company focused on the implementation of digital technologies.

Founded in 2014

Santa Clara, California, USA

5,001-10,000 employees

http://www.brillio.com

H1B Sponsorship

Brillio has a track record of offering H1B sponsorships. Please note that this does not guarantee sponsorship for this specific role. Below presents additional info for your reference. (Data Powered by US Department of Labor)

Distribution of Different Job Fields Receiving Sponsorship

Trends of Total Sponsorships

2023 (230)

2022 (297)

2021 (228)

2020 (339)