About the Role
The Dremio India team owns the development of the cloud infrastructure and services that power Dremio's Data Lake Engine. With focus on query performance optimization, supporting modern table formats like Iceberg, Deltalake and Nessie, this team provides endless opportunities to to define the products for next generation of data analytics.
In this role, you will get opportunities to impact high performance system software and scalable SaaS services through application of continuous performance management. You will plan, design, automate, execute the runs followed by deep analysis and identification of key performance fixes in collaboration with developers. Open and flexible work culture combined with providing employees ownership of the work they do will help you develop as a leader. The inclusive culture of the company will provide you a platform to bring fresh ideas and innovate.
Responsibilities
- Deliver end to end performance testing independently using agile methodologies
- Prepare performance test plans, load simulators and test harnesses to thoroughly test the products against the approved specifications
- Translate deep insight of architecture, product & usage into an enhanced automated performance measurement & evaluation framework to support continuous performance management.
- Evaluate & apply the latest tools, techniques and research insights to drive improvements into a world-class data analytics engine
- Collaborate with other engineering and customer success functions to simulate customer data and usage patterns, workloads to execute performance runs, identify and fix customer issues and make sure that customers get highly performant, optimized and scalable Dremio experience
- Analyze performance bottlenecks, root cause issues, file defects, follow up with developers, documentation and other teams on the resolution.
- Publish performance benchmark report based on test runs in accordance with industry standards
- Regularly communicate leadership team with an assessment of the performance, scalability, reliability, and robustness of products before they are exposed to customers
- Analyze and debug performance issues in customer environments.
- Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
- Actively participate in code and design reviews to maintain exceptional quality and deepen your understanding of the system architecture and implementation
Basic Requirements
- B.Tech/M.Tech/Equivalent in Computer Science or a related technical field
- 8+ years of performance automation engineering experience on large scale distributed systems
- Proficiency in any of Java/C++/Python/Go and automation frameworks
- Hands on experience in integration performance automation using CI/CD tools like Jenkins
- Experience in planning and executing performance engineering tasks to completion and taking ownership of performance epics during a set of sprints.
- Experience in designing, implementing, executing and analyzing automated performance tests for complex, production system software.
- Experience in analyzing performance bottlenecks in system, performing root cause analysis, and following issue resolution workflow to tune the system to provide optimized performance
- Ability to derive meaningful insights from the collected performance data, articulate performance findings effectively with senior team members to evaluate design choices.
- Experience with database systems internals, query optimization, understanding and tuning query access plans, and query execution instrumentation.
- Hands on experience of working projects on AWS, Azure and Google Cloud Platform
- Understanding of distributed file systems like S3 or ADLS or HDFS and HIVE
- Ability to create reusable components to automate repeatable, manual activities
- Ability to write technical reports and summary and present to leadership team
- Passion for learning and delivering using latest technologies
- Excellent communication skills and affinity for collaboration and teamwork
- Passion and ability to work in a fast paced and agile development environment.
Preferred Qualification
- Hands on experience of multi-threaded and asynchronous programming models
- Hands on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, storage systems
About Dremio
Similar jobs
This position is contractual. The appointment will be for a period of one year. Interested candidates should fill-up a Google Form within 30th July, 2024 (midnight) with the Link: https://forms.gle/VifhWi6yGZxbmUsN7
Job responsibilities:
i) Develop and implement communication and public engagement strategies that align with the institution's goals and objectives and promote the institution's work and impact.
ii) Conduct regular analysis and reporting on the effectiveness of communication and public engagement strategies and adjust them as needed
iii) Assist with other administrative tasks as and when needed
Hiring Senior Graphic Designers & Visualizers for a full-time position at Thane (w), Ghodbunder
Candidate applying must have 3-4 years of working experience at any Digital Marketing Company or Advertising Agency. Candidates residing at Thane or Navi Mumbai shall be given first preference
Job role includes:
- Managing graphic designs from conception to delivery for Digital Marketing
- Generating fresh concepts
- Meeting Deadlines
- Designing graphic content, illustrations, and infographics
NOTE: This job opening is not for Junior Profiles
- Data Engineer
Required skill set: AWS GLUE, AWS LAMBDA, AWS SNS/SQS, AWS ATHENA, SPARK, SNOWFLAKE, PYTHON
Mandatory Requirements
- Experience in AWS Glue
- Experience in Apache Parquet
- Proficient in AWS S3 and data lake
- Knowledge of Snowflake
- Understanding of file-based ingestion best practices.
- Scripting language - Python & pyspark
CORE RESPONSIBILITIES
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST HTTP API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services. You will need to understand your part of business logic and implement it using the language supported by the base data platform
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
- Develop an infrastructure to collect, transform, combine and publish/distribute customer data.
- Define process improvement opportunities to optimize data collection, insights and displays.
- Ensure data and results are accessible, scalable, efficient, accurate, complete and flexible
- Identify and interpret trends and patterns from complex data sets
- Construct a framework utilizing data visualization tools and techniques to present consolidated analytical and actionable results to relevant stakeholders.
- Key participant in regular Scrum ceremonies with the agile teams
- Proficient at developing queries, writing reports and presenting findings
- Mentor junior members and bring best industry practices
QUALIFICATIONS
- 5-7+ years’ experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
- Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
-
Urgent Opening for Corporate Gifting Executive Profile
Location: Navi Mumbai
Job Description:
- Coordinating between clients & warehouses/respective teams to ensure smooth delivery of customised gifting orders - personal or corporate.
- Plan for and manage inventory across all channels - e-commerce, retail & third party portals.
- Work on gifting catalogue, client leads and end to end customer servicing
- Showcases leadership qualities, is focused, self motivated & punctual.
- Displays ownership and fulfils projects within timelines
- Locate new vendors and have innovative ideas for gifting
- Work in tandem with all teams within the organisation to ensure smooth functioning of the requirements
- Work on multiple projects at once and is able to meet set deadlines.
- Willing to travel to store locations within and even outside the city if required to set up gifting items at retail stores and participate in visual merchandising.
Youtube videos, start their own podcast channels, perform stand-up comedy, write nail-biting mystery stories, and become confident and fearless speakers.
PlanetSpark is on its journey to becoming the global leader in the large and untapped communication skills segment. We are Series A funded by some top VCs and are on a 30% month-on-month growth curve. We have our footprint in India, the Middle East, North America, and Australia. Come join a passionate team of
over 900 young and energetic members and 1300+ expert and handpicked teachers on this roller coaster ride to build the most loved brand for kids who will move the world!
What would you be building:
You would be working on global consumer-facing products at a fast-growing startup that would give you
great exposure to all different aspects of full-stack development. You will work on:
· Learning Product: Creating the world’s first and most comprehensive live learning product to help kids
become confident communicators
· Teacher Product: Ever thought of how millions of Uber drivers are managed completely by technology?
You now have the chance to build technology that will manage the entire lifecycle of thousands of teachers
across the globe.
· Sales Product: PlanetSpark uses its own CRM. What this means is that the entire sales team of 500+
people use our custom-made products to drive sales. You will have the ability to design the most
sophisticated CRM by directly working with the business teams.
Roles and Responsibilities
As a Ruby on Rails developer, you will be a part of a close-knit team of 10x engineers who will get complete
accountability of designing the next-generation products of the company.
Some of the responsibilities include:
- Architect and install new infrastructure
- Design and build reusable and efficient ruby code
- Plan and implement new features
- Integrate data sources and databases in one system
- Identify the bugs and propose the solution for problems
- Work directly with the business and design teams
- Be involved in the complete product lifecycle – from design to development to deployment and feedback
- Work on a wide variety of features
- Get complete accountability of product development
Growth Path
- As a developer in a funded product company, you will find immense avenues of growth, in the form of knowledge, exposure to different technology, exposure to different products, career progression, and aggressive monetary growth based on performance.
- All 10x engineers will get unparalleled career growth and will outperform their batchmates by two times.
- You will have a structured growth path
- Work on small tasks in month 1
- Work on a complete feature in the next few months
- Get complete accountability of a product in 3 to 6 months
- Lead a product stream in 6 months to 1 year
- Lead a development team
- Designing and building sophisticated and highly scalable apps using Flutter
- Building custom packages in Flutter using the functionalities and APIs already available in native Android and iOS
- Designing highly scalable, testable code
- Discovering and fixing programming bugs
Desired Candidate Profile
What you need to have:- Understanding of good Object Oriented Design principles such as SOLID
- Familiarity with Design Patterns
- Experience with Clean Architecture
- Experience with Dart/Flutter packages and APIs: bloc, flutter_bloc, Streams, rxDart
- Experience in Native Mobile app development Kotlin and Swift
Work as a member of a team responsible for developing a large-scale, highly available and fault-tolerant SaaS based Leasing & Asset management solution in the commercial real estate space in accordance with established processes. You will apply your knowledge of building scalable, distributed applications and have the opportunity to work with technologies & frameworks such as Ruby on Rails, NodeJS, ReactJS, Heroku, AWS, Postgres DB
Essential Functions include but are not limited to the following.
You will be expected to:
- Contribute to all phases in the software lifecycle – requirements analysis, solution design, development, and deployment
- Maintain high quality standards for the work undertaken and be responsible for the quality of deliverables.
- Ensure assigned projects are developed in accordance with established engineering processes, adhering to scope, schedule constraints and agile project plans
- Guide/mentor the less experienced team members
- Participate in code reviews
- Work effectively as part of a distributed team
- Document the features worked by him/her
Key technical expertise areas expected for this role:
- Strong programming skills in Ruby with clear understanding of Object-Oriented and Functional programming.
- Experience working with Ruby on Rails framework
- Experience on REST API Programming preferably based on a Microservices Architecture
- Good Understanding of Databases (Postgres) and proficiency in database schema designing & writing efficient SQL Queries.
- Strong troubleshooting skills
- Demonstrable ability to learn new programming languages and frameworks quickly
- Experience with distributed systems with specific focus on security and scalability
- Experience with modern cloud technologies such as AWS
Additional areas that would add value:
- Experience working with Cloud Service providers & platforms like AWS, Heroku
- Strong understanding of Design Patterns & their application in system design
- Test Driven & Behavior Driven Development
- Automated Unit/Integration testing
- Using DevOps & Infrastructure tooling such as GoCD/Jenkins, Git
- Frontend web development with JavaScript frameworks like React
- Experience working on projects, preferably in the real estate domain
- Experience working with Virtualization and Containerization technologies including Docker, Kubernetes.
- Experience working in Agile Scrum/Kanban methodologies
- Experience working with Linux and Shell scripting
Education:
- Bachelors or Master’s in Computer Science or related fields