(Hadoop, HDFS, Kafka, Spark, Hive)
Overall Experience - 8 to 12 years
Relevant exp on Big data - 3+ years in above
Salary: Max up-to 20LPA
Job location - Chennai / Bangalore /
Notice Period - Immediate joiner / 15-to-20-day Max
The Responsibilities of The Senior Data Engineer Are:
- Requirements gathering and assessment
- Breakdown complexity and translate requirements to specification artifacts and story boards to build towards, using a test-driven approach
- Engineer scalable data pipelines using big data technologies including but not limited to Hadoop, HDFS, Kafka, HBase, Elastic
- Implement the pipelines using execution frameworks including but not limited to MapReduce, Spark, Hive, using Java/Scala/Python for application design.
- Mentoring juniors in a dynamic team setting
- Manage stakeholders with proactive communication upholding TheDataTeam's brand and values
A Candidate Must Have the Following Skills:
- Strong problem-solving ability
- Excellent software design and implementation ability
- Exposure and commitment to agile methodologies
- Detail oriented with willingness to proactively own software tasks as well as management tasks, and see them to completion with minimal guidance
- Minimum 8 years of experience
- Should have experience in full life-cycle of one big data application
- Strong understanding of various storage formats (ORC/Parquet/Avro)
- Should have hands on experience in one of the Hadoop distributions (Hortoworks/Cloudera/MapR)
- Experience in at least one cloud environment (GCP/AWS/Azure)
- Should be well versed with at least one database (MySQL/Oracle/MongoDB/Postgres)
- Bachelor's in Computer Science, and preferably, a Masters as well - Should have good code review and debugging skills
Additional skills (Good to have):
- Experience in Containerization (docker/Heroku)
- Exposure to microservices
- Exposure to DevOps practices - Experience in Performance tuning of big data applications
Subodh Popalwar
Software Engineer, Memorres
Similar jobs
PythonSpecific Responsibilities
- Minimum of 2 years Experience in Google Big Query and Google Cloud Platform.
- Design and develop the ETL framework using BigQuery
- Expertise in Big Query concepts like Nested Queries, Clustering, Partitioning, etc.
- Working Experience of Clickstream database, Google Analytics/ Adobe Analytics.
- Should be able to automate the data load from Big Query using APIs or scripting language.
- Good experience in Advanced SQL concepts.
- Good experience with Adobe launch Web, Mobile & e-commerce tag implementation.
- Identify complex fuzzy problems, break them down in smaller parts, and implement creative, data-driven solutions
- Responsible for defining, analyzing, and communicating key metrics and business trends to the management teams
- Identify opportunities to improve conversion & user experience through data. Influence product & feature roadmaps.
- Must have a passion for data quality and be constantly looking to improve the system. Drive data-driven decision making through the stakeholders & drive Change Management
- Understand requirements to translate business problems & technical problems into analytics problems.
- Effective storyboarding and presentation of the solution to the client and leadership.
- Client engagement & management
- Ability to interface effectively with multiple levels of management and functional disciplines.
- Assist in developing/coaching individuals technically as well as on soft skills during the project and as part of Client Project’s training program.
- 2 to 3 years of working experience in Google Big Query & Google Cloud Platform
- Relevant experience in Consumer Tech/CPG/Retail industries
- Bachelor’s in engineering, Computer Science, Math, Statistics or related discipline
- Strong problem solving and web analytical skills. Acute attention to detail.
- Experience in analyzing large, complex, multi-dimensional data sets.
- Experience in one or more roles in an online eCommerce or online support environment.
- Expertise in Google Big Query & Google Cloud Platform
- Experience in Advanced SQL, Scripting language (Python/R)
- Hands-on experience in BI tools (Tableau, Power BI)
- Working Experience & understanding of Adobe Analytics or Google Analytics
- Experience in creating and debugging website & app tracking (Omnibus, Dataslayer, GA debugger, etc.)
- Excellent analytical thinking, analysis, and problem-solving skills.
- Knowledge of other GCP services is a plus
• Server installation, configuration, and maintenance.
• Recommending, upgrading, and maintaining current Linux systems.
• Database administration (MySQL)
• Network configuration, and system security
• Linux mail server.
• Ability to work on weekends and holidays.
Required Skills
• Good English language skills.
• Strong interpersonal communication skills; interacting positively with upper management.
• Independent problem-solving, self-direction.
• Comfortable with most aspects of operating system administration; for example, the configuration of mail systems, system installation, and configuration, printer systems, fundamentals of security, installing third-party software.
• Has a solid understanding of a LINUX-based operating system; understands paging and swapping, inter-process communication, devices and what device drivers do, filesystem concepts (inode, clustering, logical partitions).
• Familiarity with fundamental networking/distributed computing environment concepts; understands routing concepts.
• Ability to write scripts in some administrative language (Shell, Perl, Python).
.NET
AngularJS (1.x)
Angular (2+)
JavascriptOverview:
Role: Software Development - Other
Industry Type: IT Services & Consulting
Department: Engineering - Software & QA
Role Category: Software Development
Responsibilities
• Hands-on developer who can breakdown a large/complex problem, quickly
derive an efficient design, document and implement the core framework.
• Demonstrated appreciation for code performance, scalability, and extensibility.
• Understands big picture/business cases behind individual requirements and attempts to
offer lower cost solutions.
• Oversees requirement, project planning, design reviews, and feature
implementation.
• Develop and maintain effective automated unit test coverage of new and existing code.
• Write quality, testable, maintainable, and well-documented code.
Qualification:
•Ready to relocate to Ahmedabad, Gujarat
•Solid understanding of object-oriented programming (OOP).
•Web API and MVC Framework.
•C# with .NET or .NET Core.
•Good MS SQL experience and database development using T-SQL.
•Familiarity with common developer tools GIT, SVN, or TFS.
• JavaScript frameworks such as jQuery / Angular framework / React js.
•Excellent written and verbal communication skills in English.
Key Skills
• Angular
• MVC Framework
• CSS
• .Net
• JavaScript
• HTML
• JavaScript Framework
Perks and Benefits
• Rewards and Recognition.
• Flexible working hours.
• Exposure to international market
Experience - 8+
We are interested in hiring a dedicated and hardworking individual as a Telecaller to join our https://resources.jobsoid.com/job-descriptions/industry/sales">Sales Department.
Your main goal is to boost our sales by reaching out to the existing customers as well as potential customers. As a Telecaller, you are responsible for handling sales over the phone entirely. You are also responsible for solving questions in regard to the product or service provided by the company.
In addition to this, you should collect desired information from the clients and maintain healthy relations with them. You are required to understand the customer’s requirements and demands and close the sales deal efficiently. You are also required to write down important information provided by the customer and follow up with them regularly.
As an ideal candidate, you should be an excellent communicator along with convincing abilities. Great report-writing skills, amazing negotiation skills, and phenomenal telephone etiquette are essential for this position.
If you are ready to take up these duties and responsibilities of Telecaller, then apply right away. We will love to meet you.
Responsibilities
-
Answering phones and explaining the product and services offered by the company.
-
Contacting existing customers as well as prospective customers using scripts.
-
Obtaining customer information and other relevant data.
-
Asking questions to the customer and understanding their specifications.
-
Resolving queries and issues related to the products and services.
-
Making recordings of all the sales phone calls and sales deals.
-
Taking and professionally processing product orders.
-
Maintaining the database of customers on a regular basis.
-
Suggesting solutions based on customers’ needs and requirements.
Requirements
-
High school diploma or equivalent.
-
Work experience as a Telecaller, https://resources.jobsoid.com/job-descriptions/sales/telemarketer">TeleMarketer, or a similar role in the Sales Department.
-
Professional certification sales and marketing will be an advantage.
-
Great interpersonal skills.
-
Exceptional oral and written communication skills.
-
Strong organizational skills.
-
Ability to work in a team or individually as and when required.
-
Ability to manage and handle multiple tasks.
-
Outstanding problem-solving skills.
-
Exceptional attention to detail.
-
Hard-working individual.
-
Good time management abilities.
-
Strong decision-making skills.
-
Ability to tolerate stress and pressure.
What's Ditto?
Ditto is a new offering from Finshots. We want to help millennials make better financial decisions. And we are starting with Insurance. With Ditto, you don't just compare insurance. You understand it. Narrow down choices. Avoid pitfalls and make better decisions.
Finshots is one of the leading financial newsletters with over 500K subscribers.
What do we do at Ditto?
- We explain health insurance and term(life) insurance in a language you can understand.
- We are an insurtech company primarily selling Health and Term Life Insurance policies.
Who's backing us?
We are funded by Zerodha- India's largest stockbroker
What are we looking for?
We are looking for a Senior UI/UX Designer to join our Tech team.
Responsibilities:
- Execute the design projects across the entire product life cycle. You set the design tone for the entire product by working in close collaboration with product, engineering, and business teams.
- Take a user-centred design approach and rapidly test and iterate your designs.
- Create wireframes specifications with interaction flows for website and mobile site.
- Create sketches, graphics, templates, layouts, themes, typography, and visual standards for the app/website.
- Test the design flows, screen mockups with the QA team to ensure all minute details are covered. Partner with front-end engineers on UI implementation.
- Bring consistency to our UX at all touchpoints.
- Meet multiple deadlines, prioritise work, and keep projects moving forward.
Requirements:
- 3+ years of relevant experience as a Senior UX/UI designer.
- Minimum 3 years of experience in designing core experiences for consumer-facing products.
- Portfolio or work samples showcasing design aptitude, creativity, depth of thought and the ability to solve complex design problems.
- Proficient in working with Figma or other design tools.
- Strong understanding of common UX patterns and UI patterns, Information Architecture, Prototyping.
Perks:
- Flexible working hours
- Comprehensive health insurance coverage for self and family
Application Link: https://joinditto.freshteam.com/jobs/GuGuj2l3wnSw/senior-ui-ux-designer
We are looking for Test Engineer: 4+years (2+ years of Test Automation)
Role: Automation Testing
Location: India
No. of Positions: 2
Work Type: Permanent
Location: Remote (within India)
NOTE: WE'RE LOOKING FOR IMMEDIATE JOINERS ONLY!
Responsibilities of a test automation developer include:
Designing and writing test automation scripts
Using test automation frameworks
Working with QA analysts and software developers to find solutions
Work with the Release Engineering team to create and maintain an automated nightly build verification (“smoke”) test.
Additional Skills:
Applicants must have experience with software testing tools Selenium with Eclipse IDE.
Programming languages: Java
We are Financial services, so Mathematical aptitude and strong problem-solving skills will be an advantage.
Java
NodeJS (Node.js)Python
Android Development
iOS App Development.NET
C#- A strong sense of ownership
- Exceptional technical skills
- Ability to understand the problem and craft the right solution
- Strong software architecture skills
- Dedicated to completing projects of the highest standards, on time
- Passionate about the work they undertake
QUALIFICATIONS:
To be considered for this position you must possess the following qualifications:
- A minimum of 3.5 years of industry experience
- Previous experience working with a team on a large, complex project
- Excellent communication skills (verbal and written skills in the English language)
SKILLS:
Please find the below mandatory skills required for Senior .Net resources, kindly source accordingly.
- Strong in C#.Net
- MVC (Min 2 Yrs)
- Web API (Min 1 Yr)
- Good in SQL and DB operations
- Should have used latest features of C#.Net
Database:
- Entity Frameworks (LINQ) (Min 1 Yr)
- ADO.Net (SQL)
Java
C++Be Part Of Building The Future
Dremio is the Data Lake Engine company. Our mission is to reshape the world of analytics to deliver on the promise of data with a fundamentally new architecture, purpose-built for the exploding trend towards cloud data lake storage such as AWS S3 and Microsoft ADLS. We dramatically reduce and even eliminate the need for the complex and expensive workarounds that have been in use for decades, such as data warehouses (whether on-premise or cloud-native), structural data prep, ETL, cubes, and extracts. We do this by enabling lightning-fast queries directly against data lake storage, combined with full self-service for data users and full governance and control for IT. The results for enterprises are extremely compelling: 100X faster time to insight; 10X greater efficiency; zero data copies; and game-changing simplicity. And equally compelling is the market opportunity for Dremio, as we are well on our way to disrupting a $25BN+ market.
About the Role
The Dremio India team owns the DataLake Engine along with Cloud Infrastructure and services that power it. With focus on next generation data analytics supporting modern table formats like Iceberg, Deltalake, and open source initiatives such as Apache Arrow, Project Nessie and hybrid-cloud infrastructure, this team provides various opportunities to learn, deliver, and grow in career. We are looking for innovative minds with experience in leading and building high quality distributed systems at massive scale and solving complex problems.
Responsibilities & ownership
- Lead, build, deliver and ensure customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product.
- Work on distributed systems for data processing with efficient protocols and communication, locking and consensus, schedulers, resource management, low latency access to distributed storage, auto scaling, and self healing.
- Understand and reason about concurrency and parallelization to deliver scalability and performance in a multithreaded and distributed environment.
- Lead the team to solve complex and unknown problems
- Solve technical problems and customer issues with technical expertise
- Design and deliver architectures that run optimally on public clouds like GCP, AWS, and Azure
- Mentor other team members for high quality and design
- Collaborate with Product Management to deliver on customer requirements and innovation
- Collaborate with Support and field teams to ensure that customers are successful with Dremio
Requirements
- B.S./M.S/Equivalent in Computer Science or a related technical field or equivalent experience
- Fluency in Java/C++ with 8+ years of experience developing production-level software
- Strong foundation in data structures, algorithms, multi-threaded and asynchronous programming models, and their use in developing distributed and scalable systems
- 5+ years experience in developing complex and scalable distributed systems and delivering, deploying, and managing microservices successfully
- Hands-on experience in query processing or optimization, distributed systems, concurrency control, data replication, code generation, networking, and storage systems
- Passion for quality, zero downtime upgrades, availability, resiliency, and uptime of the platform
- Passion for learning and delivering using latest technologies
- Ability to solve ambiguous, unexplored, and cross-team problems effectively
- Hands on experience of working projects on AWS, Azure, and Google Cloud Platform
- Experience with containers and Kubernetes for orchestration and container management in private and public clouds (AWS, Azure, and Google Cloud)
- Understanding of distributed file systems such as S3, ADLS, or HDFS
- Excellent communication skills and affinity for collaboration and teamwork
- Ability to work individually and collaboratively with other team members
- Ability to scope and plan solution for big problems and mentors others on the same
- Interested and motivated to be part of a fast-moving startup with a fun and accomplished team
Follow CutshortSubodh Popalwar
Software Engineer, Memorres