Data Engineer
at world’s fastest growing consumer internet company
Data Engineer JD:
- Designing, developing, constructing, installing, testing and maintaining the complete data management & processing systems.
- Building highly scalable, robust, fault-tolerant, & secure user data platform adhering to data protection laws.
- Taking care of the complete ETL (Extract, Transform & Load) process.
- Ensuring architecture is planned in such a way that it meets all the business requirements.
- Exploring new ways of using existing data, to provide more insights out of it.
- Proposing ways to improve data quality, reliability & efficiency of the whole system.
- Creating data models to reduce system complexity and hence increase efficiency & reduce cost.
- Introducing new data management tools & technologies into the existing system to make it more efficient.
- Setting up monitoring and alarming on data pipeline jobs to detect failures and anomalies
What do we expect from you?
- BS/MS in Computer Science or equivalent experience
- 5 years of recent experience in Big Data Engineering.
- Good experience in working with Hadoop and Big Data technologies like HDFS, Pig, Hive, Zookeeper, Storm, Spark, Airflow and NoSQL systems
- Excellent programming and debugging skills in Java or Python.
- Apache spark, python, hands on experience in deploying ML models
- Has worked on streaming and realtime pipelines
- Experience with Apache Kafka or has worked with any of Spark Streaming, Flume or Storm
Focus Area:
R1 |
Data structure & Algorithms |
R2 |
Problem solving + Coding |
R3 |
Design (LLD) |
Similar jobs
JOB DESCRIPTION
We are looking for an MVC developer who has hands-on experience of Web API and SQL servers and will be able to develop and support existing applications. The main scope of work will include everything from back-end to client-side code, using optimal and efficient technologies, frameworks, and patterns. Your primary responsibilities will be to research the perfect solution and develop the same for the project. Therefore, you must be skilled at requirement understanding, problem-solving, solution design, and high-quality coding.
SKILLS REQUIRED
· Proficiency in C#
· Experience using .NET 4.5+
· Experience in developing MVC, WEB API applications
· Good knowledge of Entity Framework 6.* | ADO.NET
· Proficient knowledge of MSSQL
· Database design including indexes and data integrity
· Implementing enterprise application patterns
· Familiarity with the client-side framework jQuery | Angular
PERKS AND BENEFITS
· Punctuality bonus of 15 days’ salary
· Employee of the month 5 days’ salary
· Phone and Internet bills
· Surprise birthday gifts
· Refreshment trips
· Events and games
Job Title: |
Senior software Development Engineer |
Department: |
Android - Technology |
Based at: |
Bangalore |
Reports to: |
Engineering Manager |
Experience: |
2.5 years to 4 years |
Required Qualification: |
B.tech from Top tier college |
Company Overview:
At Porter, we are passionate about improving productivity. We want to help businesses, large and small, optimize their last-mile operations and empower them to unleash the growth of their core functions. Last mile delivery logistics is one of the biggest and fastest growing sectors of the economy with a market cap upwards of 50 billion USD and a growth rate exceeding 15% CAGR.
Porter is the fastest growing leader in this sector with operations in major cities, a fleet size exceeding 1L registered and 50k active driver partners and a customer base with 3.5M being monthly active. Our industry-best technology platform has raised over 150 million USD from investors including Sequoia Capital, Kae Capital, Mahindra group, LGT Aspada, Tiger Global and Vitruvian Partners.
We are addressing a massive problem and going after a huge market. We’re trying to create a household name in transportation and our ambition is to disrupt all facets of supply chain. At Porter, we’re here to do the best work of our lives.
If you want to do the same and love the challenges and opportunities of a fast paced work environment, then we believe Porter is the right place for you.
Company URL: https://porter.in/">https://porter.in/
|
Porter has multiple mobile apps used by our consumers - app used by our customers to place on-demand orders, app used by our drivers to service those orders, and app used by fleet owners to manage their vehicles on our platform. Each of these apps is frequently iterated over to improve functionality and experience. In such a fast paced environment, we expect our mobile developers to develop and maintain these complex apps with a heavy focus on code design to keep the code easily extensible and maintainable.
Responsibilities:
● Participate in the product life cycle to understand directly from the Product Team the expected behavior of the apps and the use cases being implemented. ● Participate in design discussions with heavy focus on modeling entities and interactions, following architectural patterns like MVP, MVVM, Clean Architecture, etc. ● Collaborate with cross-functional teams - backend teams for finalizing APIs, design team for UI / UX, QA team for testing, etc. ● Participate in iteration planning to give effort estimates. ● Write clean, readable, maintainable and performant code following well established design principles. ● Write Unit Tests and Integration Tests to ensure correctness. ● Track, debug and fix bugs & crashes escalated. ● Ensure the apps are performant - no memory leaks, no frame drops, battery usage, etc. ● Explore and evaluate new technologies, tools and SDKs as may be necessary to improve the entire development pipeline. ● Work with cross-platform technologies, like Kotlin Multiplatform, to ensure consistency of features and code reuse across Android / iOS platforms.
Technologies:
● Languages: Kotlin, Java, SQL ● Frameworks: RIBs, Kotlin Multiplatform, Spek ● Architectures: MVVM, MVP, Clean Architecture, etc ● Libraries: Kotlin Coroutines, RxJava, Dagger2, Ktor, Jetpack, etc ● Integrations: AWS services, Payment Gateways (Razorpay, etc), Google Maps, Firebase, etc Products & Systems Overview You will be contributing to products concerning both customers and partner drivers. ● Customer App:
● Partner App:
● Fleet Owner Apps:
Qualification Prerequisites
● Experience: >= 2 years in Android development ● Proficiency with Android framework and Kotlin. ● Experience in designing, writing and maintaining a large complex app code base. ● Experience with design patterns like MVP, MVVM, Clean Architecture, etc. ● Experience with reactive & asynchronous programming using RxJava / Coroutines / Flows |
should be able to do mock-up designing, prototyping and wireframing
Should be able to create mobile and application designs
- Handling customer queries on Web Chat, E-mails and Social Media
- Educate current and potential customers with product and service information
- Maintain accurate customer records
- Identify and escalate priority issues to the Team Leader and Ops Team
- Actively participate in team meetings
- Handle all queries in a polite, professional manner
- Probe and troubleshoot customer queries, and provide a suitable and satisfactory solution.
- Educate customers on services and processes.
- Escalate any issues to the Team Leader.
- Achieve agreed KPIs and Objectives.
- Adhere strictly to shift schedules.
- Adhere to laid down internal policies, procedures and processes.
- Work collaboratively with the team.
- Candidates from voice/non- voice both will be fine.
Experience with the SAAS model will be an added advantage.Ecommerce background will be an added advantage.Communication skills should be good in verbal and written communication.
Candidates should be based out of Kolkata only.
If you are very good at communication, Customer-centric and patiently listening then this role is a good match for you!
Candidates must have flexibility working in Night shift as we mainly have USA-based clients to cater to.
Salary-Negotiable
5 Days work week.
2 Rotational week off.
We are providing a Work from Office opportunity.
- Must have at least 1 years experience in front-end development.
- Knowledge of Javascript /React Native / Redux .
- Loves writing code, actively experimenting along with learning new things.
- Passionate about Frontend Development and continually follow the platform & innovations.
- Have an eye for good UI/UX -Proficient with algorithms and data structures. -Keen on problem solving and able to perform in a start-up culture with challenging deadlines
Job Description We are looking for Full Stack Engineer who can turn ideas into extremely reliable, beautifully written code that other people – or you, six months into the future – will find easy to comprehend and modify. You have mastered more than one technology stack in your life, and you are comfortable with the idea of mastering several more. You're competent at high levels and low levels. Technology is a means and not the ends for you. Responsibilities Lead and build team to deliver best product(s). Work closely with client as they build features, functionality and applications to make system best. Develop visioning skills and ability to see the big picture Implement and contribute to engineering practices and processes Help your team decide what technologies to use. Every engineer is able to propose better ways to do things Skills and Qualifications Back End : NodeJS and / or PHP Front End : ReactJs, Angular and / or PHP Experience of full stack web development, JavaScript, HTML5, CSS3 and TypeScript. DevOps knowledge is a plus Ability to clearly communicate technical issues to laymen and to translate their feedback An inclination to contribute to the creative process A devotion to delivering the best possible user experience Technology expertise with insights about technology trends and solutions Team-player, flexible and able to work in a fast-paced environment Experience with MySQL, and/or Cassandra, MongoDB desired
fulfill the job duties, certifications, years of experience, degree)
• 3 - 5 years’ experience in a highly technical role at hyper-growth startup or fast-paced
company
• Extensive background designing, developing, testing, deploying, maintaining, and
improving software
• Demonstrable experience architecting scalable and cost effective solutions to ensure
and support the customer growth
• Experience mentoring junior engineers in all aspects of planning, development and
testing
• Demonstrated ability to translate business goals and initiatives into technical
requirements
• Strong understanding of system design and architecture.
• Interest in engaging with latest technologies and evaluating strategies to keep the
Novo technology stack up to date
• Excellent written and verbal communication skills with the ability to collaborate with
both technical and non-technical teams effectively.
• Work across our tech stack which includes:
o Node.js and Go for our application code
o React for our frontend code
o GraphQL for communication between systems
o Docker for running our services
o PostgreSQL for persistent data storage
Nice To Have, but Not Required:
• Experience with Go programming language
• Experience working in a startup en
Experience and Education
• Bachelor’s degree in engineering or equivalent.
Work experience
• 4+ years of infrastructure and operations management
Experience at a global scale.
• 4+ years of experience in operations management, including monitoring, configuration management, automation, backup, and recovery.
• Broad experience in the data center, networking, storage, server, Linux, and cloud technologies.
• Broad knowledge of release engineering: build, integration, deployment, and provisioning, including familiarity with different upgrade models.
• Demonstratable experience with executing, or being involved of, a complete end-to-end project lifecycle.
Skills
• Excellent communication and teamwork skills – both oral and written.
• Skilled at collaborating effectively with both Operations and Engineering teams.
• Process and documentation oriented.
• Attention to details. Excellent problem-solving skills.
• Ability to simplify complex situations and lead calmly through periods of crisis.
• Experience implementing and optimizing operational processes.
• Ability to lead small teams: provide technical direction, prioritize tasks to achieve goals, identify dependencies, report on progress.
Technical Skills
• Strong fluency in Linux environments is a must.
• Good SQL skills.
• Demonstratable scripting/programming skills (bash, python, ruby, or go) and the ability to develop custom tool integrations between multiple systems using their published API’s / CLI’s.
• L3, load balancer, routing, and VPN configuration.
• Kubernetes configuration and management.
• Expertise using version control systems such as Git.
• Configuration and maintenance of database technologies such as Cassandra, MariaDB, Elastic.
• Designing and configuration of open-source monitoring systems such as Nagios, Grafana, or Prometheus.
• Designing and configuration of log pipeline technologies such as ELK (Elastic Search Logstash Kibana), FluentD, GROK, rsyslog, Google Stackdriver.
• Using and writing modules for Infrastructure as Code tools such as Ansible, Terraform, helm, customize.
• Strong understanding of virtualization and containerization technologies such as VMware, Docker, and Kubernetes.
• Specific experience with Google Cloud Platform or Amazon EC2 deployments and virtual machines.c