Monday, June 11, 2012

How-to: using talend open studio for big data tutorial-1

Big data has been a hot-topic now, and Talend is very popular in the open source ETL community. however, there was not enough support for big data. recently, talend released a new product with the open source support called Talend Open Studio for Big Data. you can download it and play in your environment, it has built-in support for Big data. I will put several test cases here , then you can get an impression what does the product offer.
image
1. FROM DB to HDFS

for the db purpose , I just use the row generator to simulate the rows in db, put some simple logic to create one row serious with 3 columns, ID, name and level,

image

        Then drag and drop the hdfsoutput coponent to the surface, connect the major output of the row generator to the hdfs. for the hdfs, just specify the name node address, and the folder to hold the file
image
    then click to run the job, it will create a file for you which contains all the rows we generated in a CSV format.
image

remember to pickup the right version of you hadoop environment, and when done, you can tell the time taken to transfer the rows between two systems.
image

Once we export the data from traditional db to hdfs, we can run hive query to get the results , that’s the next case to test.

449 comments:

«Oldest   ‹Older   401 – 449 of 449
Russian Artist Hub said...

Make a grand entrance at your event in India with our exquisite Red Carpet Welcome Girl. Add sophistication and charm as our elegant hostess welcomes guests in style. Russian Artist Hub offers a touch of glamor to elevate the ambiance—visit our website to enhance your occasion with this classy gesture!

Fajil Hura said...

Embark on a journey through India's rich tapestry with Golden Triangle Tour Packages, a cultural trifecta of Delhi, Agra, and Jaipur. Discover diverse experiences with North India Tour Packages, showcasing majestic landscapes and historical marvels. Alternatively, indulge in the vibrant hues of traditions and landscapes with South India Tour Packages. Immerse yourself in India's cultural kaleidoscope through these tailored adventures.

European Konnect said...

Embark on a remarkable adventure with a Europe Journey Package from European Konnect. Explore breathtaking landscapes, iconic cities, and diverse cultures with expertly planned itineraries. Enjoy premium accommodations, guided tours, and seamless travel arrangements. Make your European dream trip a reality. Book now for an unforgettable and hassle-free experience across the continent!

Skyway Tour said...

Himachal Honeymoon Package offers a romantic escape to the breathtaking landscapes of Shimla, Manali, and Dharamshala. Enjoy snow-capped mountains, serene valleys, and cozy stays. Skyway Tour ensures a perfect blend of adventure and tranquility, making your honeymoon unforgettable. Create cherished memories amidst nature’s beauty with our exclusive packages!

European Konnect said...

Explore the charm of romance with Europe Honeymoon Packages from European Konnect. Discover iconic cities, breathtaking landscapes, and unforgettable moments tailored for newlyweds. Whether it's Paris, Venice, or Santorini, your dream honeymoon awaits with seamless planning and luxurious experiences designed by European Konnect. Let love bloom in Europe!

Mason Wood said...

Exactly what I was thinking! I had my book edited and published through Oxford Book Writers and couldn’t be happier with the results.

Lucy Miller said...

Loved the point about how children’s books should teach without preaching. At bluemount publisher, we work with authors who create imaginative and meaningful stories for kids.

Pamela Smith said...

Such a thoughtful read. I’m currently finalizing my book and got help from Writers Bloom . Their formatting and publishing service is fantastic.

Kelvin Stuart said...

Super helpful content. We got our Wikipedia page done professionally via Make Me Noteable , and it really elevated our credibility.

Elbert Paul said...

Eminent Publishers transformed my rough manuscript into a polished, professional e-book. Can't thank them enough!

Go Rajasthan Travel said...

Discover the perfect blend of history and modernity with Delhi Tour Packages by Go Rajasthan Travel. Visit iconic landmarks like Red Fort, Qutub Minar, and India Gate. Go Rajasthan Travel crafts personalized Delhi Tour Packages to help you explore the vibrant culture, heritage, and charm of the capital city.

Book Publishing LLC said...

Good read. If anyone here is interested in publishing their work, check out Book Publishing LLC . I used them for my audiobook and loved the results.

American Website Agency said...

This post reminded me how important a strong website is. American Website Agency helped me create a mobile-friendly, high-speed site with built-in SEO.

Harper Book Writers said...
This comment has been removed by the author.
Harper Book Writers said...
This comment has been removed by the author.
Harper Book Writers said...

Thanks for sharing this valuable info. As someone who recently published a book, I owe a lot to Haper Book Writers for their expert guidance throughout the process.

Paramount Book Publishing said...

I appreciate this information. For anyone looking to publish professionally, Paramount Book Publishing offers everything under one roof—writing, formatting, SEO, and even audiobook production.

TrademarkedInc said...

I’ve worked with a few services, but TrademarkedINC is by far the most reliable. They made the trademark registration process painless.

Davinci Designers said...

Really interesting take. Branding is key, and with help from Davinci Designers , businesses can create powerful identities that stand out.

BNN Publication said...

This blog is so inspiring! If you’re working on your own writing journey, I recommend looking into BNN Publication — they’ve helped me polish and publish my work with ease.

Book Pubs said...

I agree — writing is just half the battle. That’s why I turned to Book Pubs . Their editing and marketing team made a big difference in my book launch.

Book Pubs said...
This comment has been removed by the author.
Book Pubs said...
This comment has been removed by the author.
Book Pubs said...
This comment has been removed by the author.
Tribune Publisher said...

Thanks for the tips! I recently worked with Tribune Publisher to launch my debut novel – they handled everything, even the trailer and marketing. Highly recommend.

Sunshine Publishers said...

I love when blogs highlight the power of storytelling. Sunshine Book Publishers helped turn my scattered ideas into a well-structured, professionally published book. Highly recommend their services!

Crypto Millionaire Clubs said...
This comment has been removed by the author.
Crypto Millionaire Clubs said...

If you’re launching a token, marketing is key. Crypto Millionaire Clubs helped us get legit coverage and build organic buzz that turned into real investments.

Anonymous said...

It’s inspiring to see how the publishing industry has evolved. For a modern approach with traditional values, check out Universal Book Shelf .

Anonymous said...
This comment has been removed by the author.
Optima Travels said...

Plan the perfect getaway with exciting Goa Tour Packages offering sun, sand, and vibrant nightlife. Short on time? Choose a Same Day Agra Tour to witness architectural marvels. Don’t miss the iconic symbol of love with our Taj Mahal Tour Packages , designed for a seamless and memorable travel experience.

Stacey Mitchell said...

Great blog post! If you're writing your first book, let Congress of Authors handle the heavy lifting. Their all-in-one publishing services are amazing.

Publish My Audiobook said...

I appreciate how you broke this down. Also, authors looking to expand into audio should check out Publish My Audiobook. Great value and expert service.

Harper Publishing LLC said...

For anyone interested in writing or publishing, Harper Publishers LLC provides unmatched support and expertise throughout the journey.

Best Sellers LLC said...

A good book deserves a great cover. Best Sellers LLC made sure mine stood out on every platform. 10/10 for design!

Ladybird Publishers said...

I’ve been following your blog for a while now. Just wanted to share that Ladybird Publishers helped me self-publish my debut novel, and I couldn’t be happier with the results!

SEO Pro Masters said...

Super helpful tips here. I also recently got a boost in my rankings thanks to SEO Pro Masters. Their attention to detail is unmatched.

Author Centrals said...

If anyone reading this is overwhelmed with the publishing process, Author Centrals can take you from rough draft to final product, including audiobooks and cover design.

Charter Publishers said...

What an eye-opener! For new writers needing a hand, Charter Publishers can help turn rough drafts into published works with real commercial potential.

Anonymous said...
This comment has been removed by the author.
Anonymous said...

Super insightful! And if you're wondering how to go from manuscript to market, Western Book Publisher can handle every step of the process. Lifesavers!

Norma Smith said...

Solid advice. To complement what’s mentioned here, I recommend Logo Design Studios for all-in-one solutions: domain registration, website maintenance, and stunning video animations.

Ask Visa and Immigration Services said...

Ask Visa and Immigration Services helps professionals find exciting opportunities for Jobs in Russia with reliable visa and documentation support. Our experienced team ensures a smooth application process, guiding you at every step. Trust Ask Visa Services to make your journey towards securing Jobs in Russia easy, efficient, and stress-free.

jennifer.starke96 said...

Great insights here. If anyone’s planning a new book or brand launch, I’d strongly suggest Ladybird Illustrator for illustration and design.

Melissa Kelvin said...

Thanks for the guidance! I’d also suggest using Arkham House Publishers if you're looking for comprehensive book publishing services. They’re truly professionals.

Elbert Paul said...

Thanks for sharing this. For those looking to launch a digital product,The Digital Beez can help with both web app development and UX design.

Ignite Speech said...

Ignite Speech provides the Best Hearing Aid Services in Odisha, offering cutting-edge hearing solutions and expert care. Our certified audiologists ensure customized fittings and ongoing support for all ages. Choose Ignite Speech for trusted, affordable, and effective hearing care through the Best Hearing Aid Services in Odisha tailored to your needs.

Skyway Tour said...

Explore the majestic beauty of the Himalayas with Leh Ladakh Tour Packages that offer unforgettable adventures and serene landscapes. Whether it's thrilling bike rides or peaceful monasteries, Skyway Tour ensures a seamless and memorable travel experience. Discover nature at its best with expertly crafted itineraries and personalized service.

Oms99 said...

Looking for a reliable solution for enhanced performance? Trust Buy Avana 100mg Tablets Online for effective and fast results. This medication is popular for its quick action and long-lasting effect. For a smooth and secure purchase experience, choose Oms99, a trusted platform offering quality and discreet delivery services across India.

«Oldest ‹Older   401 – 449 of 449   Newer› Newest»
 
Locations of visitors to this page