Data Scientist

Springer Capital is a cross-border asset management firm specializing in real estate investment banking between China and the USA. We are offering a remote internship for aspiring data engineers interested in data pipeline development, data integration, and business intelligence. The internship offers flexible start and end dates. A short quiz or technical task may be required as part of the selection process. 

Responsibilities: 

▪ Design, build, and maintain scalable data pipelines for structured and unstructured data sources 

▪ Develop ETL processes to collect, clean, and transform data from internal and external systems 

▪ Support integration of data into dashboards, analytics tools, and reporting systems 

▪ Collaborate with data analysts and software developers to improve data accessibility and performance 

▪ Document workflows and maintain data infrastructure best practices 

▪ Assist in identifying opportunities to automate repetitive data tasks 

Senior Data Engineer Job Description

Overview

The Senior Data Engineer will design, develop, and maintain scalable data pipelines and

infrastructure to support data-driven decision-making and advanced analytics. This role requires deep

expertise in data engineering, strong problem-solving skills, and the ability to collaborate with

cross-functional teams to deliver robust data solutions.

Key Responsibilities

Data Pipeline Development: Design, build, and optimize scalable, secure, and reliable data

pipelines to ingest, process, and transform large volumes of structured and unstructured data.

Data Architecture: Architect and maintain data storage solutions, including data lakes, data

warehouses, and databases, ensuring performance, scalability, and cost-efficiency.

Data Integration: Integrate data from diverse sources, including APIs, third-party systems,

and streaming platforms, ensuring data quality and consistency.

Performance Optimization: Monitor and optimize data systems for performance, scalability,

and cost, implementing best practices for partitioning, indexing, and caching.

Collaboration: Work closely with data scientists, analysts, and software engineers to

understand data needs and deliver solutions that enable advanced analytics, machine

learning, and reporting.

Data Governance: Implement data governance policies, ensuring compliance with data

security, privacy regulations (e.g., GDPR, CCPA), and internal standards.

Automation: Develop automated processes for data ingestion, transformation, and validation

to improve efficiency and reduce manual intervention.

Mentorship: Guide and mentor junior data engineers, fostering a culture of technical

excellence and continuous learning.

Troubleshooting: Diagnose and resolve complex data-related issues, ensuring high

availability and reliability of data systems.

Required Qualifications

Education: Bachelor’s or Master’s degree in Computer Science, Engineering, Data Science,

or a related field.

Experience: 5+ years of experience in data engineering or a related role, with a proven track

record of building scalable data pipelines and infrastructure.

Technical Skills:

Proficiency in programming languages such as Python, Java, or Scala.

Expertise in SQL and experience with NoSQL databases (e.g., MongoDB, Cassandra).

Strong experience with cloud platforms (e.g., AWS, Azure, GCP) and their data services

(e.g., Redshift, BigQuery, Snowflake).

Hands-on experience with ETL/ELT tools (e.g., Apache Airflow, Talend, Informatica) and

data integration frameworks.

Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and distributed

systems.

Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes) is a

plus.

Soft Skills:

Excellent problem-solving and analytical skills.

Strong communication and collaboration abilities.

Ability to work in a fast-paced, dynamic environment and manage multiple priorities.

Certifications (optional but preferred): Cloud certifications (e.g., AWS Certified Data Analytics,

Google Professional Data Engineer) or relevant data engineering certifications.

Preferred Qualifica

Experience with real-time data processing and streaming architectures.

Familiarity with machine learning pipelines and MLOps practices.

Knowledge of data visualization tools (e.g., Tableau, Power BI) and their integration with data

pipelines.

Experience in industries with high data complexity, such as finance, healthcare, or

e-commerce.

Work Environment

Location: Hybrid/Remote/On-site (depending on company policy).

Team: Collaborative, cross-functional team environment with data scientists, analysts, and

business stakeholders.

Hours: Full-time, with occasional on-call responsibilities for critical data systems.

What We’re Looking For:

• Strong experience in Python (5+ years).
• Hands-on experience with any database (SQL or NoSQL).
• Experience with frameworks like Flask, FastAPI, or Django.
• Knowledge of ORMs, API development, and unit testing.
• Familiarity with Git and Agile methodologies.
• Familiarity with the Kafka tool (Added Advantage)

• 6+ years Experienced in building data pipelines and deployment pipelines for machine learning models
• 4+ years’ experience with ML/AI toolkits such as Tensorflow, Keras, AWS Sagemaker, MXNet, H20, etc.
• 4+ years’ experience developing ML/AI models in Python/R
• Must have leadership abilities to lead a project and team.
• Must have leadership skills to lead and deliver projects, be proactive, take ownership, interface with business, represent the team and spread the knowledge.
• Strong knowledge of statistical data analysis and machine learning techniques (e.g., Bayesian, regression, classification, clustering, time series, deep learning).
• Should be able to help deploy various models and tune them for better performance.
• Working knowledge in operationalizing models in production using model repositories, API s and data pipelines.
• Experience with machine learning and computational statistics packages.
• Experience with Data Bricks, Data Lake.
• Experience with Dremio, Tableau, Power Bi.
• Experience working with spark ML, spark DL with Pyspark would be a big plus!
• Working knowledge of relational database systems like SQL Server, Oracle.
• Knowledge of deploying models in platforms like PCF, AWS, Kubernetes.
• Good knowledge in Continuous integration suites like Jenkins.
• Good knowledge in web servers (Apache, NGINX).
• Good knowledge in Git, Github, Bitbucket.
• Working knowledge in operationalizing models in production using model repositories, APIs and data pipelines.
• Java, R, and Python programming experience.
• Should be very familiar with (MS SQL, Teradata, Oracle, DB2).
• Big Data – Hadoop.
• Expert knowledge using BI tools e.g.Tableau
• Experience with machine learning and computational statistics packages.

About us:

Arista Networks was founded to pioneer and deliver software driven cloud networking solutions for large datacenter storage and computing environments. Arista's award-winning platforms, ranging in Ethernet speeds from 10 to 400 gigabits per second, redefine scalability, agility and resilience. Arista has shipped more than 20 million cloud networking ports worldwide with CloudVision and EOS, an advanced network operating system. Committed to open standards, Arista is a founding member of the 25/50GbE consortium. Arista Networks products are available worldwide directly and through partners.

About the job

Arista Networks is looking for world-class software engineers to join our Extensible Operating System (EOS) software development team.As a core member of the EOS team, you will be part of a fast-paced,high caliber team-building features to run the world's largest data center networks.Your software will be a key component of Arista's EOS, Arista's unique, Linux-based network operating system that runs on all of Arista's data center networking products.

The EOS team is responsible for all aspects of the development and delivery of software meant to run on the various Arista switches.You will work with your fellow engineers and members of the marketing team to gather and understand the functional and technical requirements for upcoming projects.You will help write functional specifications, design specifications, test plans, and the code to bring all of these to life.You will also work with customers to triage and fix problems in their networks. Internally, you will develop automated tests for your software, monitor the execution of those tests, and triage and fix problems found by your tests.At Arista, you will own your projects from definition to deployment, and you will be responsible for the quality of everything you deliver.

This role demands strong and broad software engineering fundamentals, and a good understanding of networking including capabilities like L2, L3, and fundamentals of commercial switching HW.Your role will not be limited to a single aspect of EOS at Arista, but cover all aspects of EOS.

Responsibilities:

• Write functional specifications and design specifications for features related to forwarding traffic on the internet and cloud data centers.
• Independently implement solutions to small-sized problems in our EOS software, using the C, C++, and python programming languages.
• Write test plan specifications for small-sized features in EOS, and implement automated test programs to execute the cases described in the test plan.
• Debug problems found by our automated test programs and fix the problems.
• Work on a team implementing, testing, and debugging solutions to larger routing protocol problems.
• Work with Customer Support Engineers to analyze problems in customer networks and provide fixes for those problems when needed in the form of new software releases or software patches.
• Work with the System Test Engineers to analyze problems found in their tests and provide fixes for those problems.
• Mentor new and junior engineers to bring them up to speed in Arista’s software development environment.
• Review and contribute to the specifications and implementations written by other team members.
• Help to create a schedule for the implementation and debugging tasks, update that schedule weekly, and report it to the project lead.

Qualifications:

• BS Computer Science/Electrical Engineering/Computer Engineering 3-10 years experience, or MS Computer Science/Electrical Engineering/Computer Engineering + 5 years experience, Ph.D. in Computer Science/Electrical Engineering/Computer Engineering, or equivalent work experience.
• Knowledge of C, C++, and/or python.
• Knowledge of UNIX or Linux.
• Understanding of L2/L3 networking including at least one of the following areas is desirable:

1. IP routing protocols, such as RIP, OSPF, BGP, IS-IS, or PIM.
2. Layer 2 features such as 802.1d bridging, the 802.1d Spanning Tree Protocol, the 802.1ax Link Aggregation Control Protocol, the 802.1AB Link Layer Discovery Protocol, or RFC 1812 IP routing.

• Ability to utilize, test, and debug packet forwarding engine and a hardware component’s vendor provided software libraries in your solutions.
• Infrastructure functions related to distributed systems such as messaging, signalling, databases, and command line interface techniques.
• Hands on experience in the design and development of ethernet bridging or routing related software or distributed systems software is desirable.
• Hands on experience with enterprise or service provider class Ethernet switch/router system software development, or significant PhD level research in the area of network routing and packet forwarding.
• Applied understanding of software engineering principles.
• Strong problem solving and software troubleshooting skills.
• Ability to design a solution to a small-sized problem, and implement that solution without outside help.Able to work on a small team solving a medium-sized problem with limited oversight.

Resources:

• Arista's Approach to Software with Ken Duda (CTO): https://youtu.be/TU8yNh5JCyw
• Additional information and resources can be found at https://www.arista.com/en/

We are hiring for a Software Engineer Team Lead - Backend, to join our education-focused fintech lending startup, GrayQuest. Our core product is a combination of a lending product, a rewards product and an insurance product to redefine the education fees payment across the country.

• Participate in all stages of the Software Development Lifecycle
• Develop back-end components, services, and APIs. Support integration of user-facing elements, and collaborate closely with the design and front-end development team.
• Write elegant, effective, and scalable code while maintaining the highest level of coding standards.
• Take complete ownership of projects and ensure timely deliveries
• Ability to debug, refine, review, and deploy code
• Work closely with the QA team to test, and document project features.
• Ability to interact with all stakeholders. Understand business requirements, and effectively convert them into technical specifications
• Mentor junior developers and participate in peer Review

Requirements:

• Demonstrable experience as a Python Developer (3+ years)
• Strong knowledge of Python frameworks (Django Rest, Flask)
• Experience working on REST APIs
• Strong knowledge of SQL and JavaScript
• Experience with Amazon Web Services (AWS)
• Working knowledge of React
• Familiarity with Agile development methodology
• Good understanding of task breakup, milestone definition, and work delegation.
• Past experience of working in a fintech/financial services domain or a consumer internet startup will be preferable but not required
• Work experience in early-stage startups (0 ->1) is a big plus
• Bachelors or equivalent degree from premier institutes is a plus
• Most importantly, the biggest skill we look for our prospective candidates is "Learnability" - how quickly can you learn. 

Why is this a great opportunity for the right candidate:

1. Work with a young dynamic core team backed by marquee investors from the financial services space
2. Work on a product/business that has achieved product market fit and take it to scale
3. Equity compensation and competitive market salaries
4. Work environment that prioritizes talent, hustle and dedication
   
   

We will also ensure we give a preference to applicants who directly email us with their background/context and why they think they should be a strong candidate for this position at GrayQuest. Email us at work (at the rate) grayquest (dot) com and cc Sonal (at the rate)grayquest (dot) com