Lorven Technologies Inc. ยท 4 hours ago
Lead Python Developer
United States
Full-time
Remote
Senior Level, Lead/Staff
Maximize your interview chancesInformation TechnologySoftware
Hiring Manager
Prakash S
Insider Connection @Lorven Technologies Inc.
Get 3x more responses when you reach out via email instead of LinkedIn.
Responsibilities
Designing, building, and maintaining robust data ingestion pipelines
Ensuring seamless integration of data from various sources
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
Advanced proficiency in Python, particularly with libraries such as NumPy and Pandas for data manipulation and analysis.
Strong experience with Parquet files, including reading, writing, and optimizing for performance and storage efficiency.
Ability to set up and manipulate Python data structures such as lists, strings, dictionaries, and tuples.
Familiarity with data exploration, visualization, and comparing metrics of large CSV and Parquet files, including partitioned Parquet files.
Strong skills in joins, merges, pivot tables, grouping, and window functions in Python or SQL.
Strong understanding of GIT, including git push and git clone for collaborative development.
Experience with Linux commands and shell scripting for data operations.
Proven experience in building and managing data ingestion pipeline scripts, including batch and real-time processing.
Demonstrated ability to handle complex data pipeline architecture with excellent debugging skills.
Prior experience leading a technical team and mentoring junior engineers.
Preferred
Good experience with object-oriented programming patterns, multithreading, and multiprocessing.
Experience developing Spark applications using Python, including familiarity with Apache Spark (Spark SQL, Spark Streaming, DataFrames, RDD, PySpark).
Excellent verbal and written communication skills, with the ability to convey technical concepts to non-technical stakeholders.
Company
Lorven Technologies Inc.
Lorven Technologies, Inc. is a highly recognized provider of professional technology consultancy in the US.
Founded in 2001
51-200 employees
H1B Sponsorship
Lorven Technologies Inc. has a track record of offering H1B sponsorships. Please note that this does not
guarantee sponsorship for this specific role. Below presents additional info for your
reference. (Data Powered by US Department of Labor)
Distribution of Different Job Fields Receiving Sponsorship
Represents job field similar to this job
Trends of Total Sponsorships
2023 (22)
2022 (55)
2021 (16)
2020 (22)
Funding
Current Stage
Growth StageLeadership Team
Bala Shan
CEO & President
Company data provided by crunchbase
