Sr. Data Engineer
Company Profile:
Bigfoot Retail Solutions [Shiprocket] is a logistics platform which connects Indian eCommerce SMBs with logistics players to enable end to end solutions.
Our innovative data backed platform drives logistics efficiency, helps reduce cost, increases sales throughput by reducing RTO and improves post order customer engagement and experience.
Our vision is to power all logistics for the direct commerce market in India
including first mile, linehaul, last mile, warehousing, cross border and O2O.
Position: Sr.Data Engineer
Team : Business Intelligence
Location: New Delhi
Job Description:
We are looking for a savvy Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. The Data Engineer will support our software developers, database architects, data analysts and data scientists on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects. They must be self-directed and comfortable supporting the data needs of multiple teams, systems and products. The right candidate will be excited by the prospect of optimizing or even re-designing our company’s data architecture to support our next generation of products and data initiatives.
Key Responsibilities:
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets that meet functional / non-functional business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS ‘big data’ technologies.
- Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
- Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
- Keep our data separated and secure across national boundaries through multiple data centres and AWS regions.
- Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
- Work with data and analytics experts to strive for greater functionality in our data systems.
Qualifications for Data Engineer
- Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
- Experience building and optimizing ‘big data’ data pipelines, architectures and data sets.
- Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
- Strong analytic skills related to working with unstructured datasets.
- Build processes supporting data transformation, data structures, metadata, dependency and workload management.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- We are looking for a candidate with 5+ years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field. They should also have experience using the following software/tools:
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
- Experience with AWS cloud services: EC2, EMR, RDS, Redshift
- Experience with stream-processing systems: Storm, Spark-Streaming, etc.
- Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
Subodh Popalwar
Software Engineer, Memorres
About Shiprocket
About
Company social profiles
Similar jobs
Codemonk is looking for a sales intern to assist in various stages of the sales funnel, including creating awareness of new offerings, generating leads, and retaining customers.
The ideal intern will be a great fit for our energetic and creative team. You’ll gain hands-on experience working on challenging, meaningful projects with guidance from a mentor and other members of our team.
Responsibilities
- Research and generate lists of potential customers, new markets, and customer needs.
- Provide input on customer briefs, presentations, and sales literature
- Help develop client relationships and retain existing accounts
- Assist in evaluating new sponsorship opportunities
- Learn and apply consultative sales techniques
- Achieve assigned sales targets.
- Build long-term relationships with new and existing customers.
- Keep records of sales, revenue, invoices etc.
- Promote the company’s products/services addressing or predicting client’s objectives. Additionally, author company collaterals for the sales pitch.
- Build a sales lead pipeline, proactively reach out to clients and align discussions with the Management.
- Prepare sales contracts ensuring adherence to law-established rules and guidelines.
- Determine cross-selling opportunities among different business units.
- Establish best practices and operating procedures for converting leads to revenue.
Requirements
- Bachelor's degree in business management or administration, marketing, Strategy or Business related field. The degree isn’t mandatory as long as you can prove you have the necessary skills to ace the responsibility.
- Excellent interpersonal and communication skills
- Ability to work in a fast-paced team environment
- The ability to travel as needed.
- Excellent analytical, problem-solving and management skills.
- Exceptional negotiation and decision-making skills.
- Strong business acumen.
- Detail-oriented.
Benefits
- Work on increasingly challenging and engaging real-world projects
- Gain hands-on experience in each stage of the sales funnel
- Collaborate with experienced sales professionals
- Work closely with a mentor who has over 10 years of experience in the field
- Attend meetings, events, and other networking opportunities
- Compensation available
Good to have
- Proficiency in all Microsoft Office applications, Email etiquette, B2B Knowledge, Knowledge about Enterprise, CRM, LinkedIn.
Ø Candidate should have civil diploma.
Ø Candidate should have 3-4 year experience.
Ø Must have knowledge of security sector.
Ø Manage all site work of Gurgaon location.
Ø Manage the allocation of resources, including labor materials and equipment.
Ø Communicate effectively with clients, contractors and other stakeholders to ensure project expectations .
Ø Maintain accurate records of progress, costs and quality control measures.
Ø Ensure projects are completed on time, within budget, and to the required quality standards.
Ø Must have knowledge of AutoCAD & Drawing.
Ø Proper handling all site fencing work.
Docker
Kubernetes
Amazon Web Services (AWS)
JenkinsDevOps Lead Engineer
We are seeking a skilled DevOps Lead Engineer with 8 to 10 yrs. of experience who handles the entire DevOps lifecycle and is accountable for the implementation of the process. A DevOps Lead Engineer is liable for automating all the manual tasks for developing and deploying code and data to implement continuous deployment and continuous integration frameworks. They are also held responsible for maintaining high availability of production and non-production work environments.
Essential Requirements (must have):
• Bachelor's degree preferable in Engineering.
• Solid 5+ experience with AWS, DevOps, and related technologies
Skills Required:
Cloud Performance Engineering
• Performance scaling in a Micro-Services environment
• Horizontal scaling architecture
• Containerization (such as Dockers) & Deployment
• Container Orchestration (such as Kubernetes) & Scaling
DevOps Automation
• End to end release automation.
• Solid Experience in DevOps tools like GIT, Jenkins, Docker, Kubernetes, Terraform, Ansible, CFN etc.
• Solid experience in Infra Automation (Infrastructure as Code), Deployment, and Implementation.
• Candidates must possess experience in using Linux, Jenkins, and ample experience in Configuring and automating the monitoring tools.
• Strong scripting knowledge
• Strong analytical and problem-solving skills.
• Cloud and On-prem deployments
Infrastructure Design & Provisioning
• Infra provisioning.
• Infrastructure Sizing
• Infra Cost Optimization
• Infra security
• Infra monitoring & site reliability.
Job Responsibilities:
• Responsible for creating software deployment strategies that are essential for the successful
deployment of software in the work environment and provide stable environment for delivery of
quality.
• The DevOps Lead Engineer is accountable for designing, building, configuring, and optimizing
automation systems that help to execute business web and data infrastructure platforms.
• The DevOps Lead Engineer is involved in creating technology infrastructure, automation tools,
and maintaining configuration management.
• The Lead DevOps Engineer oversees and leads the activities of the DevOps team. They are
accountable for conducting training sessions for the juniors in the team, mentoring, career
support. They are also answerable for the architecture and technical leadership of the complete
DevOps infrastructure.
Javaimplementation, coordination of development, advice on
testing and post-go-live production support services
• Perform delivery plan creation, plan monitoring, and status
reporting
• Manage development and delivery of technology solutions
Ensure that technology solutions are fit-for-purpose and
aligned with architectural principles, standards, and roadmaps.
• Ensure there is the implementation of world-class coding and
development standards, ensuring solutions are suitably assured
and of quality across that brand teams.
• Provide support and mentoring to technical team leads,
including talent and succession planning.
• Responsible for the quality and technical approach was taken by
teams
technology standards, principles, architecture roadmaps,
service management standards, and customer experience
framework. Furthermore, to support the development and
definition of technical standards and approach.
Good communication & people managerial skills
• Problem-solving, decision-making, and conflict-resolution ability
• Create and maintain a professional culture within the team,
where individuals take ownership and focus on delivering
excellence, quality, and value for the customer and business.
Amazon Web Services (AWS)Kubernetes
Git- Preferred experience in development associated with Kafka or big data technologies understand essential Kafka components like Zookeeper, Brokers, and optimization of Kafka clients applications (Producers & Consumers). -
Experience with Automation of Infrastructure, Testing , DB Deployment Automation, Logging/Monitoring/alerting
- AWS services experience on CloudFormation, ECS, Elastic Container Registry, Pipelines, Cloudwatch, Glue, and other related services.
- AWS Elastic Kubernetes Services (EKS) - Kubernetes and containers managing and auto-scaling -
Good knowledge and hands-on experiences with various AWS services like EC2, RDS, EKS, S3, Lambda, API, Cloudwatch, etc.
- Good and quick with log analysis to perform Root Cause Analysis (RCA) on production deployments and container errors on cloud watch.
Working on ways to automate and improve deployment and release processes.
- High understanding of the Serverless architecture concept. - Good with Deployment automation tools and Investigating to resolve technical issues.
technical issues. - Sound knowledge of APIs, databases, and container-based ETL jobs.
- Planning out projects and being involved in project management decisions. Soft Skills
- Adaptability
- Collaboration with different teams
- Good communication skills
- Team player attitude
DockerKubernetesAmazon Web Services (AWS)Job Description
Please connect me on Linkedin or share your Resume on shrashti jain
• 8+ years of overall experience and relevant of at least 4+ years. (Devops experience has be more when compared to the overall experience)
• Experience with Kubernetes and other container management solutions
• Should have hands on and good understanding on DevOps tools and automation framework
• Demonstrated hands-on experience with DevOps techniques building continuous integration solutions using Jenkins, Docker, Git, Maven
• Experience with n-tier web application development and experience in J2EE / .Net based frameworks
• Look for ways to improve: Security, Reliability, Diagnostics, and costs
• Knowledge of security, networking, DNS, firewalls, WAF etc
• Familiarity with Helm, Terraform for provisioning GKE,Bash/shell scripting
• Must be proficient in one or more scripting languages: Unix Shell, Perl, Python
• Knowledge and experience with Linux OS
• Should have working experience with monitoring tools like DataDog, Elk, and/or SPLUNK, or any other monitoring tools/processes
• Experience working in Agile environments
• Ability to handle multiple competing priorities in a fast-paced environment
• Strong Automation and Problem-solving skills and ability
• Experience of implementing and supporting AWS based instances and services (e.g. EC2, S3, EBS, ELB, RDS, IAM, Route53, Cloudfront, Elasticache).
•Very strong hands with Automation tools such Terraform
• Good experience with provisioning tools such as Ansible, Chef
• Experience with CI CD tools such as Jenkins.
•Experience managing production.
• Good understanding of security in IT and the cloud
• Good knowledge of TCP/IP
• Good Experience with Linux, networking and generic system operations tools
• Experience with Clojure and/or the JVM
• Understanding of security concepts
• Familiarity with blockchain technology, in particular Tendermint
Google AnalyticsWe at InVideo.io are looking for young, ambitious and talented people to work with us on our mission to become the best Online video editor in the world.
As an SEO executive you'll be expected to drive top of the funnel growth via various strategies designed by us. To be successful, you'll need a good command over English (both written and spoken) and excellent negotiation skills. You'll undergo a 1 week training program in using various tools enabling you to be successful.
InVideo.io is based in Mumbai but we are operating remotely and have employees from different cities in India and abroad. The role of SEO executive is remote (i.e. you can work from home).
We are looking for candidates who meet the above requirement and can start immediately.
Python
PHP
Javascript
NodeJS (Node.js)
MongoDBKRAs:
- Liaise with business/departmental stakeholders, understanding requirements
- Making project plan and enhancement feature release roadmap
- Working hands-on for product enhancements
- Producing, testing and debugging code
Job brief:
We are looking for a Senior Solution Engineer to lead and implement solution enhancements. You will work with top management to define solution requirements and take the lead on technical aspect of the project.
In this role, you should be able to work independently with little supervision. You should have excellent organization and problem-solving skills. If you also have hands-on experience in technology development and agile methodologies, we’d like to meet you.
Your goal will be to enhance and develop high-quality technology solutions that is aligned with user needs and business goals.
Responsibilities
- Develop high-quality technology design and architecture
- Identify, prioritize and execute tasks in the software development life cycle
- Develop tools and applications by producing clean, efficient code
- Automate tasks through appropriate tools and scripting
- Review and debug code, perform validation and verification testing
- Identify 3rd party integration opportunity and engage with 3rd party team on technology and business aspect and drive successful integration
- Develop technology solutions by studying information needs; conferring with users; studying systems flow, data usage, and work processes; investigating problem areas; following the software development lifecycle
- Determine operational feasibility by evaluating analysis, problem definition, requirements, solution development, and proposed solutions
- Demonstrates solutions by developing documentation, flowcharts, layouts, diagrams, charts, code comments and clear code
- Protect operations by keeping information confidential
- Provide information by collecting, analysing, and summarizing development and service issues.
Skillset requirements:
- Knowledge of selected programming languages (e.g. Python, C++) and the Java/J2EE platform
- In-depth knowledge of relational databases (e.g. PostgreSQL, MySQL) and NoSQL databases (e.g. MongoDB)
- Java/JEE, Spring, JSON, XML, NoSQL Database(MongoDB, Cassandra), Distributed System, RDBMS, ePub3, MVC frameworks, Design Patterns, Javascript, JQuery, JSON
- Ability to use version control software such as GIT and SVN
- Experience as an applications programmer on large-scale data base management systems
- Experience writing SQL queries for SQL Server or another Relational Database is required
- Experience in LAMP (Linux, Apache, MySQL, PHP/Python/Perl) and/or server-side Java programming with Web 1.0 MVC frameworks and experience in JEE technologies like Servlets, JSPs, EJBs, Web Services, JMS, JAXB.
- Design, develop and implement unit and scenario testing for existing code base and for new functionality under development
- High scalability projects involving cloud-based infrastructure design and implementation
- Good understanding of Web Services protocols such as REST, SOAP and API design for extensibility and portability
- Experience debugging distributed systems with high data loads
- Deep understanding of distributed data model
- Solid understanding of the Software as a Service (SaaS) model in the online environment
Mindset requirements:
- Solution mindset
- Teamwork
- Analytical & Critical Thinking
- Attention to details
C++
HTML/CSS
React.jsNodeJS (Node.js)
Follow CutshortSubodh Popalwar
Software Engineer, Memorres