Big Data Engineer
at Altimetrik
Big Data Engineer: 5+ yrs.
Immediate Joiner
- Expertise in building AWS Data Engineering pipelines with AWS Glue -> Athena -> Quick sight
- Experience in developing lambda functions with AWS Lambda
- Expertise with Spark/PySpark – Candidate should be hands on with PySpark code and should be able to do transformations with Spark
- Should be able to code in Python and Scala.
- Snowflake experience will be a plus
- We can start keeping Hadoop and Hive requirements as good to have or understanding of is enough rather than keeping it as a desirable requirement.
Similar jobs
- Responsible for designing, storing, processing, and maintaining of large-scale data and related infrastructure.
- Can drive multiple projects both from operational and technical standpoint.
- Ideate and build PoV or PoC for new product that can help drive more business.
- Responsible for defining, designing, and implementing data engineering best practices, strategies, and solutions.
- Is an Architect who can guide the customers, team, and overall organization on tools, technologies, and best practices around data engineering.
- Lead architecture discussions, align with business needs, security, and best practices.
- Has strong conceptual understanding of Data Warehousing and ETL, Data Governance and Security, Cloud Computing, and Batch & Real Time data processing
- Has strong execution knowledge of Data Modeling, Databases in general (SQL and NoSQL), software development lifecycle and practices, unit testing, functional programming, etc.
- Understanding of Medallion architecture pattern
- Has worked on at least one cloud platform.
- Has worked as data architect and executed multiple end-end data engineering project.
- Has extensive knowledge of different data architecture designs and data modelling concepts.
- Manages conversation with the client stakeholders to understand the requirement and translate it into technical outcomes.
Required Tech Stack
- Strong proficiency in SQL
- Experience working on any of the three major cloud platforms i.e., AWS/Azure/GCP
- Working knowledge of an ETL and/or orchestration tools like IICS, Talend, Matillion, Airflow, Azure Data Factory, AWS Glue, GCP Composer, etc.
- Working knowledge of one or more OLTP databases (Postgres, MySQL, SQL Server, etc.)
- Working knowledge of one or more Data Warehouse like Snowflake, Redshift, Azure Synapse, Hive, Big Query, etc.
- Proficient in at least one programming language used in data engineering, such as Python (or Scala/Rust/Java)
- Has strong execution knowledge of Data Modeling (star schema, snowflake schema, fact vs dimension tables)
- Proficient in Spark and related applications like Databricks, GCP DataProc, AWS Glue, EMR, etc.
- Has worked on Kafka and real-time streaming.
- Has strong execution knowledge of data architecture design patterns (lambda vs kappa architecture, data harmonization, customer data platforms, etc.)
- Has worked on code and SQL query optimization.
- Strong knowledge of version control systems like Git to manage source code repositories and designing CI/CD pipelines for continuous delivery.
- Has worked on data and networking security (RBAC, secret management, key vaults, vnets, subnets, certificates)
- 3+ year of experience in Development in JAVA technology.
- Strong Java Basics
- SpringBoot or Spring MVC
- Hands on experience on Relationl Databases (SQL query or Hibernate) + Mongo (JSON parsing)
- Proficient in REST API development
- Messaging Queue (RabitMQ or Kafka)
- Microservices
- Any Caching Mechanism
- Good at problem solving
Good to Have Skills:
- 3+ years of experience in using Java/J2EE tech stacks
- Good understanding of data structures and algorithms.
- Excellent analytical and problem solving skills.
- Ability to work in a fast paced internet start-up environment.
- Experience in technical mentorship/coaching is highly desirable.
- Understanding of AI/ML algorithms is a plus.
Key responsibilities:
1. Use a personalized and need-based selling approach to consult and convert prospective customers into paid customers for Byju's premium
2. Understand the core learning needs of students through conversations with parents and align program offerings accordingly via phone, email, and text
3. Address customer objections in a consultative manner to successfully close sales
Who can apply
1. Candidates fluent in English & Hindi languages
2. Candidates willing to work from the office
3. Candidates should have a laptop
4. Candidates below the age of 30
5. No regular students allowed
Salary
Probation: Duration: 3 months
Salary during probation: ₹16,000 /month
After probation:
Annual CTC: ₹ 7,00,000 - 8,00,000 /year
About Hive
Hive is the leading provider of cloud-based AI solutions for content understanding,
trusted by the world’s largest, fastest growing, and most innovative organizations. The
company empowers developers with a portfolio of best-in-class, pre-trained AI models, serving billions of customer API requests every month. Hive also offers turnkey software applications powered by proprietary AI models and datasets, enabling breakthrough use cases across industries. Together, Hive’s solutions are transforming content moderation, brand protection, sponsorship measurement, context-based ad targeting, and more.
Hive has raised over $120M in capital from leading investors, including General Catalyst, 8VC, Glynn Capital, Bain & Company, Visa Ventures, and others. We have over 250 employees globally in our San Francisco, Seattle, and Delhi offices. Please reach out if you are interested in joining the future of AI!
About Role
Our unique machine learning needs led us to open our own data centers, with an
emphasis on distributed high performance computing integrating GPUs. Even with these data centers, we maintain a hybrid infrastructure with public clouds when the right fit. As we continue to commercialize our machine learning models, we also need to grow our DevOps and Site Reliability team to maintain the reliability of our enterprise SaaS offering for our customers. Our ideal candidate is someone who is
able to thrive in an unstructured environment and takes automation seriously. You believe there is no task that can’t be automated and no server scale too large. You take pride in optimizing performance at scale in every part of the stack and never manually performing the same task twice.
Responsibilities
● Create tools and processes for deploying and managing hardware for Private Cloud Infrastructure.
● Improve workflows of developer, data, and machine learning teams
● Manage integration and deployment tooling
● Create and maintain monitoring and alerting tools and dashboards for various services, and audit infrastructure
● Manage a diverse array of technology platforms, following best practices and
procedures
● Participate in on-call rotation and root cause analysis
Requirements
● Minimum 5 - 10 years of previous experience working directly with Software
Engineering teams as a developer, DevOps Engineer, or Site Reliability
Engineer.
● Experience with infrastructure as a service, distributed systems, and software design at a high-level.
● Comfortable working on Linux infrastructures (Debian) via the CLIAble to learn quickly in a fast-paced environment.
● Able to debug, optimize, and automate routine tasks
● Able to multitask, prioritize, and manage time efficiently independently
● Can communicate effectively across teams and management levels
● Degree in computer science, or similar, is an added plus!
Technology Stack
● Operating Systems - Linux/Debian Family/Ubuntu
● Configuration Management - Chef
● Containerization - Docker
● Container Orchestrators - Mesosphere/Kubernetes
● Scripting Languages - Python/Ruby/Node/Bash
● CI/CD Tools - Jenkins
● Network hardware - Arista/Cisco/Fortinet
● Hardware - HP/SuperMicro
● Storage - Ceph, S3
● Database - Scylla, Postgres, Pivotal GreenPlum
● Message Brokers: RabbitMQ
● Logging/Search - ELK Stack
● AWS: VPC/EC2/IAM/S3
● Networking: TCP / IP, ICMP, SSH, DNS, HTTP, SSL / TLS, Storage systems,
RAID, distributed file systems, NFS / iSCSI / CIFS
Who we are
We are a group of ambitious individuals who are passionate about creating a revolutionary AI company. At Hive, you will have a steep learning curve and an opportunity to contribute to one of the fastest growing AI start-ups in San Francisco. The work you do here will have a noticeable and direct impact on the
development of the company.
Thank you for your interest in Hive and we hope to meet you soon
6+ years of experience developing on Shopify’s eCommerce platform including customization of various themes using Liquid
● 6+ years of experience in front-end technologies including JavaScript, AJAX, HTML, CSS, SCSS, and GraphQL.
● Superb troubleshooting & debugging skills.
● Interest in staying current and applying the most current best practices.
● Able to work effectively in a fluid, fast-paced environment. ● Experience working with many cross functional partners to drive complex projects forward. ● Experience working with agile teams and making rapid decisions in a dynamic and disruptive environment.
● A disciplined approach to testing and quality assurance.
● Positive Attitude, high energy, and love for broadening web development skill set. ● Proficient in co-coordinating with teams and clients across different time zones. ● Familiar with JIRA, ConfluenceKnowledge in other ecommerce platforms such as BigCommerce orCommercetools is big plus
At Prolifics, we are currently implementing multiple solutions on Senior Software Engineer (SAP ABAP)and we are looking to hire talented SAP ABAP for our development center in India. This position would be based out of location and is a permanent position.
If you are looking for a high growth company with rock-solid stability, if you thrive in the energetic atmosphere of high-profile projects, we want to talk to you today! Let’s connect and explore possibilities of having you onboard the Prolifics team!
Job Title: Senior Software Engineer (SAP ABAP)
Primary skills: 5+ Years into SAP ABAP
Location: Hyderabad
Educational Qualification: B. Tech/BE/MTech/MCA/M.Sc.
Job Description:
- Should have 6+ years of experience in SAP ABAP Development
- Responsible to review ABAP programs for performance and recommend necessary changes for performance improvement
- Should be able to build necessary utilities/programs to conduct performance testing
- Should be able to work with customer independently for day to day to activities
- Good to have functional knowledge in SAP SD/MM
If you are interested to know more, please send an updated copy of your resume to vinay.manne at prolifics.com
About Us:
Prolifics Corporation Limited is a Global Technology Solutions Provider with presence across North America (USA and Canada), Europe (UK and Germany), Middle East & Asia. In India, we have off shore development centers: 3 in Hyderabad & 1 in Pune.
For more than 40 years, Prolifics has transformed enterprises of all sizes including over 100 Fortune 1000 companies by solving their complex IT challenges. Our clients include Fortune 50 and Fortune 100 companies across a broad range of industries including Financial Services, Insurance, Government, Healthcare, Telecommunications, Manufacturing and Retail. We rank consistently in Dream Companies to Work For and Dream Employer of the Year ranking from World HRD Congress, ranked 7 in 2019.
We encourage you to visit us on www.prolifics.com or follow us on Twitter, LinkedIn, Facebook, YouTube and other social media to know more about us.
Job Description:
- Resource should be proficient in analyzing, designing and developing applications based on the requirements provided by business counterparts
- Developing and maintaining applications developed in Java, J2EE, Struts and Spring and possessing 3-layer architecture
- Good knowledge in Spring Boot, Hibernate, Angular JS, Docker, VUE JS and AWS
- Applications development or maintenance using ORM tools such as Hibernate
- Database management which includes DB design and maintenance, mostly related to 2016 and Oracle 19c, DB2
- Should have knowledge in Unix / Linux OS.
- Should have good knowledge in Shell scripting language
- Strictly adhere to the internal SDLC process quality standards set but the organization and providing the drive to the team to achieve the KPI and SLA targets
- Flexible to work in extended time
- Candidate should have good experience on Java / J2EE, Springboot, Hibernate / JPA, Oracle query, Web Services and Rabbit MQ.
- Should have minimum of 3 to 5 years of experience. Should be able to work on enhancement, maintenance and production support.
- Good to have hands-on experience on DEVOPS & API development.
people never feel the need to carry cash or cards again. We believe India is at the cusp of a new
mobile revolution, which will change the way we manage our money on the go. We see ourselves
facilitating this change, through technology and dogged customer centricity.
At PhonePe, we take extra care to make sure you give your best at work, Everyday! And creating the
right environment for you is just one of the things we do. We empower people and trust them to do
the right thing. Here, you own your work from start to finish, right from day one.Being enthusiastic
about tech is a big part of being at PhonePe.
If you like building technology that impacts millions, ideating with some of the best minds in the
country and executing on your dreams with purpose and speed, join us!
Role
As a senior software engineer,
● You will build Robust and scalable web-based applications
● You will need to think of platforms & reuse
● Build abstractions and contracts with separation of concerns for a larger scope
● Drive problem solving skills for high-level business and technical problems.
● Do high level design with guidance; Functional modelling, break-down of a module
● Do incremental changes to architecture: impact analysis of the same
● Do performance tuning and improvements in large scale distributed systems
● Mentor young minds and foster team spirit
● Breaks down execution into phases to bring predictability to overall execution
● Work closely with Product Manager to derive capability view from features/solutions
● Lead execution of medium sized projects
● Work with broader stakeholders to track impact of projects/features and proactively
iterate to improve them
As a senior software engineer, you must have
● Extensive and expert programming experience in at least one general programming
language (e.g. Java, C, C++) & tech stack to write maintainable, scalable, unit-tested
code.
● Experience with multi-threading and concurrency programming
● Extensive experience in object oriented design skills, knowledge of design patterns, and
huge passion and ability to design intuitive module and class-level interfaces
● Excellent coding skills – should be able to convert design into code fluently
● Knowledge of Test Driven Development
● Good understanding of databases (e.g. MySQL) and NoSQL (e.g. HBase, Elasticsearch,
Aerospike etc)
● Strong desire to solving complex and interesting real world problems
● Experience with full life cycle development in any programming language on a Linux
platform
● Go-getter attitude that reflects in energy and intent behind assigned tasks
● Worked in startup like environment with high levels of ownership and commitment
● BTech, MTech, or PhD in Computer Science or related technical discipline (or
equivalent).
● Experience in building highly scalable business applications, which involve
implementing large complex business flows and dealing with huge amount of data.
● 5+ years of experience in the art of writing code and solving problems for large Scale.
● Open communicator who shares thoughts and opinions frequently, listens intently and
takes constructive feedback
As a senior software engineer, good to have
● Ability to drive design and architecture of multiple subsystems
● Ability to break-down larger/fuzzier problems into smaller ones in the scope of the
product
● Understanding of the industry’s coding standards and an ability to create appropriate
technical documentation.