Legalist · 2 days ago
Senior Software Engineer
Wonder how qualified you are to the job?
Maximize your interview chances
Financial Services
Insider Connection @Legalist
Responsibilities
Help to design and implement the architecture of a large-scale data pipeline system
Design, implement, and maintain various components of ELT data processing infrastructure
Collaborate with product and business teams to understand/anticipate requirements for greater functionality and impact in data processing systems
Lead development of data architecture best practices, standards, design review processes, and creation of repeatable design documents
Scale architectural design work through data engineering, data governance, and solutions architecture
Develop and maintain all aspects of a data processing pipeline end to end (Extract, Load, Transform, Monitor, Document)
Clean and wrangle data from multiple disparate structured and semi-structured sources
Utilize cloud environments like GCP, AWS, containerization tools like Docker, and orchestration tools like Kubernetes
Understand different types of databases (Postgres, Redis, Google Datastore, Google Bigtable, etcd)
Apply computer science basics: Algorithm, OOP, SQL, ORM, Recursion, Memoization, Caching, Common Design Patterns
Qualification
Find out how your skills align with this job's requirements. If anything seems off, you can easily click on the tags to select or unselect skills to reflect your actual expertise.
Required
4+ Years experience with Python for automation and data wrangling
Production experience in high-throughput distributed system
Familiarity with data warehousing concepts, tools and monitoring highly recommended (Airbyte, DBT, Bigquery, Redshift)
Ability to develop and maintain all aspects of a data processing pipeline end to end (Extract, Load, Transform, Monitor, Document)
Experience cleaning and wrangling data from multiple disparate structured and semi structured sources including (HTML, XML, REST, GraphQL, PDF, JSON, and spreadsheets.)
Experience with cloud environments like GCP, AWS, as well as containerization tools like Docker and orchestration such as kubernetes or others.
Familiarity with message brokers such as Kafka, RabbitMQ, Google Pub/Sub
Good understanding of different types of databases (Postgres, Redis, Google Datastore, Google Bigtable, etcd)
Mastery of computer science basics: Algorithm, OOP, SQL, ORM, Recursion, Memoization, Caching, Common Design Patterns
Preferred
Experience with microservices architecture would be a plus.
Experience with DevOps
Experience with reporting tools such as Power BI, Grafana, Tableau
Benefits
Focus on personal career growth and development, with options for professional training
Flexibility with working hours, focus is on output and professional performance
Flexibility with working location, again focus is on output and quality of work
Brand new technology and industry best practices
Strategic experimentation and innovation is welcomed and appreciated
Company
Legalist
Legalist is an institutional alternative asset management firm. The firm uses data-driven technology to invest in credit assets at scale.