Data Engineer at Swiggy · Gurugram · 4 - 6 years · ₹14L - ₹30L / yr · Profitable · Posted 26 Jul 2023
Sr. Data Engineer
Company Profile:
Bigfoot Retail Solutions [Shiprocket] is a logistics platform which connects Indian eCommerce SMBs with logistics players to enable end to end solutions.
Our innovative data backed platform drives logistics efficiency, helps reduce cost, increases sales throughput by reducing RTO and improves post order customer engagement and experience.
Our vision is to power all logistics for the direct commerce market in India
including first mile, linehaul, last mile, warehousing, cross border and O2O.
Position: Sr.Data Engineer
Team : Business Intelligence
Location: New Delhi
Job Description:
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Key Responsibilities:
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across national boundaries through multiple data centres and AWS regions.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications for Data Engineer
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Swiggy
About
About the Company:
India's #1 Customer Experience Platform For Direct Commerce Empowering over 2.5 Lakh eCommerce Sellers.
Shiprocket is India's leading e-commerce enablement platform, revolutionizing the way businesses handle logistics and fulfillment. Founded in 2012, the company has evolved into a comprehensive technology-driven platform that empowers over 250,000 sellers who generate more than $2.5B in annual GMV. Shiprocket provides end-to-end solutions including shipping, fulfillment, and technology integration services, making it easier for businesses of all sizes to manage their e-commerce operations efficiently.
About the Founders:
Shiprocket was co-founded by Saahil Goel and Gautam Kapoor. Saahil Goel, serving as the CEO, brings extensive expertise with his MBA and MS degrees from the University of Pittsburgh. Under their leadership, the company has transformed from a small business with big dreams into a unicorn, driven by their vision to democratize e-commerce for entrepreneurs across India.
About Funding:
Shiprocket's funding journey reflects its remarkable growth story. The company has raised over $357 million across 14 funding rounds 4. A significant milestone was achieved in August 2022 when it attained unicorn status with a valuation of $1.3 billion. The company continues to attract investor confidence, with its most recent funding round of $26 million in December 2024, demonstrating strong market faith in its business model and growth potential.
About Milestones/Achievements:
Shiprocket has achieved several remarkable milestones in its journey:
- Reached unicorn status in 2022 with a $1.3 billion valuation 5
- Demonstrated strong financial growth with a 21% increase in operating revenue for FY24, reaching ₹1,316 crore 6
- Successfully expanded its service portfolio to include Shiprocket Fulfillment, Shiprocket Capital, and Shiprocket Engage 360
- Built a network serving 250,000+ active sellers across India 1
- Achieved operational profitability in the first two quarters of FY25 7
- Established itself as a comprehensive e-commerce enablement platform with multiple product offerings and technology integrations
Candid answers by the company
Shiprocket is one of India's largest data-driven logistics aggregation platforms. They provide end-to-end logistics and fulfillment solutions for e-commerce businesses and D2C brands, helping them manage their shipping and fulfillment operations efficiently.
Company social profiles
Similar jobs (10)
Java
Spring BootJob Description:
- Location - Bangalore / Mumbai
- Notice period - Immediate to serving up to - oct 1st week
- Exp. - must be 5 -12 yrs
- Experience in Core Java 5.0 and above, CXF, Spring.
- Extensive experience in developing enterprise-scale n-tier applications for financial domain. Should possess good architectural knowledge and be aware of enterprise application design patterns.
- Should have the ability to analyze, design, develop and test complex, low-latency client-facing applications.
- Good Experience into Microservices , Data structures , Oops , Algorithms, multithreading etc
- Good development experience with RDBMS, preferably Sybase database.
- Good knowledge of multi-threading and high-volume server-side development.
- Experience in sales and trading platforms in investment banking/capital markets.
- Basic working knowledge of Unix/Linux.
- Experience into High /Low level designing.
- Excellent problem solving and coding skills in Java.
- Strong interpersonal, communication and analytical skills.
- Should have the ability to express their design ideas and thoughts.
JavaSpring Boot
Python
Angular (2+)Should have strong hands on experience of 8-10 yrs in Java Development.
Should have strong knowledge of Java 11+, Spring, Spring Boot, Hibernate, Rest Web Services.
Strong Knowledge of J2EE Design Patterns and Microservices design patterns.
Should have strong hand on knowledge of SQL / PostGres DB. Good to have exposure to Nosql DB.
Should have strong knowldge of AWS services (Lambda, EC2, RDS, API Gateway, S3, Could front, Airflow.
Good to have Python ,PySpark as a secondary Skill
Should have ggod knowledge of CI CD pipleline.
Should be strong in wiriting unit test cases, debug Sonar issues.
Should be able to lead/guide team of junior developers
Should be able to collab with BA and solution architects to create HLD and LLD documents
PCCSE (Prisma certified cloud security engineer) with 5 years of experience.
On site engineers with ability to work in 24-7 support environments.
JavaSpring BootAs a Backend Engineer you will be responsible for creating REST APIs which are used to drive the User Interface. Given the nature of the application, these APIs need to be very efficient and high performing. This requires optimizing queries for faster execution and introducing database changes that may be required. We are looking for individuals with great attention to detail, who are genuine, confident, committed and not only passionate about technology, but excited to work in a fun and friendly start-up environment. The ideal candidate will be passionate about technology and GETTING IT DONE.
Responsibilities:
- Develop, test, implement and maintain application software
- Take part in software and architectural development activities
- Debug application issues and helping support respond to client queries
- Participate in application development meetings
- Provide accurate estimates, clearly communicate status of tasks and identification of risks
- Commitment to accomplishing the task at hand and identify the fastest and most reliable way to solve a problem
- Performance tuning of application code at different service levels
- Interact with customers of the application and help address issues reported
Requirements:
- Bachelor's degree in Computer Science or equivalent
- 3+ years of experience with Java and Spring frameworks.
- Having good knowledge in a scripting language like python is a plus
- Experience with Spring and Hibernate/ ORM
- Understanding of relational database and normal forms
- Understanding of NoSQL / RDBMS (Mongo or Postgres) and ability to write optimized and high performing queries
- Strong understanding of Java concurrency, concurrency patterns, experience building thread safe code
- Experience building RESTful web services
- Strong written and verbal communication skills
- Strong interpersonal skills and time management skills
- Strong problem solving and analytical skills
- Experience with GIT as a VCS, Unix based systems
- Experience with NoSQL Database is a plus
- Following are a set of 'good to have' skills React AWS Bitbucket, JIRA
React.js
Javascript
Redux/Flux
HTML/CSSJob title: React.js Developer
Location: Gurugram (Onsite)
Notice: Immediate joiner
Responsibilities:
• Meeting with the development team to discuss user interface ideas and applications.
• Reviewing application requirements and interface designs.Identifying web-based user interactions.
• Developing and implementing highly responsive user interface components using react concepts.
• Writing application interface codes using JavaScript following react.js workflows.
• Troubleshooting interface software and debugging application codes.
• Developing and implementing front-end architecture to support user interface concepts.
• Monitoring and improving front-end performance.
• Documenting application changes and developing updates.
Requirements:
• Bachelor’s degree in computer science, information technology, or a similar field.
• Previous experience working as a react.js developer.
• In-depth knowledge of JavaScript, CSS, HTML, and front-end languages.
• Knowledge of REACT tools including React.js, Webpack, Enzyme, Redux, and Flux.
• Experience with user interface design.
• Knowledge of performance testing frameworks including Mocha and Jest.
• Experience with browser-based debugging and performance testing software.
• Excellent troubleshooting skills.
• Good project management skills.
- Basic knowledge of Data Structure and Algorithm required
● The individual will be responsible for developing manual test scripts.
● Responsible for executing automated and manual test cases.
● Responsible for tracking and logging defects during execution.
● Generate reports such as defect analysis report, project status report, etc.
● Should be able to understand customer/end user's requirements and should own the issue till
closure.
● Actively participate in requirement analysis and test design.
● Work with product team/designer on front end side UI design.
● Identify opportunities for continuous improvement.
● Provide proactive advice and feedback throughout the software testing lifecycle for prevention
and early correction of quality problem.
● Demonstrate relationship building and teamwork skills within all levels of the organization in a
collaborative effort
● Must be adaptable in a changing environment and be effective in many different business
settings.
Required skills
● 2 - 5 years' experience testing Web and Mobile Applications (either manual or automated)
● Good knowledge in Web/REST API testing
● Experience working on Agile based projects
● Good experience in writing clear and thorough test plans and test cases
● Good understanding of Software testing lifecycle
● Should have expertise in various test development and design methodologies
● A high standard of written and verbal English Desirable skills
● Working knowledge on REST API.
● Understanding of web and Mobile app design standards.
Nice-to-have
● 1+ year(s) experience writing automated test scripts (not record/replay)
● Experience in the design of great user experiences
● Knowledge of Postman or similar for WebAPI testing
● Robotic process automation (RPA) tool experience using UIPATH/Automation Anywhere/Blue
Prism
Ruby on Rails (ROR)
RubyReact.jsTechnical qualifications
- 2+ years of working experience in delivering web applications.
- Strong experience in Ruby on Rails, API design and architecture.
- Strong experience in databases like MongoDB/PostgreSQL/MySQL.
- Strong understanding of object-oriented programming(OOPs) concepts, data structures, algorithms, APIs, web services, SQL concepts.
- Experience in any JS frameworks like Express. js/Node. js/AngularJS/ReactJS.
- Understanding of version control tools - Git/SVN.
- Supportive in providing clean, maintainable code.
- Empathize with client needs and architect custom solutions.
- Brownie points for knowledge in Golang.
Python
Django
Amazon Web Services (AWS)Notice Period: Immediate to 15 Days
Key skills: Python development, AWS, Lambda Experience into Python developers(with design and development experience) not people with the machine learning experience. AWS Mandate experience required.
React.jsJavascript
NodeJS (Node.js)Job Description
As a senior full-stack developer, you will contribute to our end-to-end supply chain platform. You'll work with all key stakeholders to deliver scalable, maintainable code and deliver amazing user experiences. We are building a design and process-centric culture where you'll play a key role in the implementation of the foundation of all our systems. Up for a challenge?
You are:
- A self-starter with a sense of what it takes to be successful as a team
- An agile - welcome change, do as little as possible and embrace continuous delivery
- Conscious about how quality is carried through from the UI to all layers underneath
- Passionate about design as a foundation of great user experience
- Opinionated, but flexible to accommodate the big picture
Responsibilities
- Analyze requirements, provide estimates and deliver code in an agile setup
- Stay on top of all owned work and raise red flags as early as possible
- Define the architecture, best practices, and coding standards for a full-stack development
- Support continuous technical improvement by investigating alternatives and technologies and present them for architectural review
- Motivate team members, coach junior members, and extend goodwill to other employees
Qualifications
Must have
- Prior startup experience, preferably with war stories to share
- 3-5 years of software industry experience
- Solid understanding of software design, development, testing, and problem-solving
- Expertise in coding efficient, high quality, and modularized software
- Expertise in React.js and related ecosystem
- Experience with GraphQL and other modern JS ecosystems
- Expertise in common design patterns and anti-patterns Javascript
- Experience with service-oriented architecture and microservices
- Expertise in relational and non-relational databases and expertise in at least one database system
- Experience with planning, execution, and maintenance of test infrastructure for backend workflows
- Knowledge of AWS
- Knowledge of Unix shell and source control systems and tools such as git
- Strong technical leadership skills
- Strong communication skills
- Technical mentoring skills
Great to have
- Experience with CI/CD and setting up a monitoring infrastructure
- Experience with Flutter
- Interest in blockchain and computer vision-related ML systems
- Experience working on high traffic systems
- Bachelor’s degree in Computer Science or a related discipline
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon