Not even wrong

Stonebraker et al, The End of an Architectural Era (It’s Time for a Complete Rewrite):

"Because RDBMSs can be beaten by more than an order of magnitude on the standard OLTP benchmark, then there is no market where they are competitive. As such, they should be considered as legacy technology more than a quarter of a century in age, for which a complete redesign and re-architecting is the appropriate next step"

Stonebraker et al, MapReduce A major step backwards:

"As both educators and researchers, we are amazed at the hype that the MapReduce proponents have spread about how it represents a paradigm shift in the development of scalable, data-intensive applications. MapReduce may be a good idea for writing certain types of general-purpose computations, but to the database community, it is:

  1. A giant step backward in the programming paradigm for large-scale data intensive applications
  2. A sub-optimal implementation, in that it uses brute force instead of indexing 
  3. Not novel at all -- it represents a specific implementation of well known techniques developed nearly 25 years ago
  4. Missing most of the features that are routinely included in current DBMS
  5. Incompatible with all of the tools DBMS users have come to depend on   "

The problem is that comparing MapReduce to a DBMS is apples and oranges. They simply don't do the same thing, and that's aside from the fact that DBMSes are working on relational data whereas tools like MapReduce/Hadoop are working on semi-structured data; or that (R)DBMSes don't handle the data volumes technology like MapReduce can.

I see Joe Gregorio called the comparison a category error, but the thing to wonder is why people who know databases inside out are making basic reasoning errors. In that vein it's worth bearing in mind that Stonebraker is backing a "column-store" database architecture. If you believe Wikipedia's article that says BigTable is a colum store, then ideally you'd see a comparison between DBMS technology to BigTable, or just say, 'I wouldn't build MapReduce on top of a Column Store'*. 

The one thing I agree on is that MapReduce is not new. Carriero and Gelernter's "How to Write Parallel Programs" is about research work that goes back to the 1980s:

"We can envision parallelism in terms of a program's result, a program's agenda 
of activities or of an ensemble of specialists that collectively constitute the program. 
We begin with an analogy.

Suppose you want to build a house. Parallelism - using many people on the job - is 
the obvious approach. But there are several different ways in which parallelism might 
enter.

First, we might envision parallelism by starting with the finished product, the result. [...] 
In sum each worker is assigned to produce one piece of the result [...] This is the result 
parallel approach.

At the other end of the spectrum we might envision parallelism by starting with the crew 
of workers who will do the building. [...] In sum, each worker is assigned to perform one 
specified kind of work [...] This is the specialist parallel approach.

Finally, we might envision parallelism in terms of an agenda of activities that must be 
completed in building a house. [...] In sum, each worker is assigned to pick a task from 
the agenda and do that task - and repeat, until the job is done [...] This is the agenda 
parallel approach.

The boundaries between the three paradigms can sometimes be fuzzy, and we will 
often mix elements of several paradigms in getting a particular job done [...] It's 
nonetheless an  essential point that these three paradigms represent three  clearly 
separate ways of thinking about the problem."

in their terms, MapReduce is a design pattern for 'result parallel' programming. What is new is that it works outside a research lab on very big data sets (since we're talking about industrial application, novelty isn't the point, utility is).

According to the article the MapReduce style is being backported into the universities so grads be can be trained up:

"For example, IBM and Google have announced plans to make a 1,000 processor cluster available to a few select universities to teach students how to program such clusters using a software tool called MapReduce. Berkeley has gone so far as to plan on teaching their freshman how to program using the MapReduce framework."

This is probably the most interesting thing the article has to say. I recall Yahoo staff stating that available skills are an issue for leveraging Hadoop/HFS. So a complete rewrite isn't enough; an entire generation of developers and data specialists have to be trained up on this paradigm; another generation has to be convinced otherwise that an RDBMS is the only serious option for data management.  Conceivably the result parallel model becomes as dominant a paradigm for data processing for the next 20 years as RDBMS/SQL has been for the last 20, but who knows.

 

* or point at PIG

  • January 18, 2008
  • Posted by: dehora

Tags:

16 Comments


    I don't think Map-Reduce is intended to keep track of say, airplane seats, that are being sold by agents all over the world. The Map-Reduce system is apparently the way that Google handles the huge textual inputs from scanning the web. From this, they apparently generate huge indexes by using map-reduce, to support the massive full-text search that is the Google search product. The classical, and crucial, issues of referential integrity, ACID, and so on, simply don't come up. If Google drops a web site or two, only to recover it in few days, who will know? If the Bank of America drops your bank account, it's a different matter.

    Different inputs, different persistence times, different outputs, different latencies, different reliability constraints.

    Different Persistence
    January 20, 2008 at 9:45 a.m.

    "If Google drops a web site or two, only to recover it in few days, who will know? If the Bank of America drops your bank account, it's a different matter."

    Agree; most web systems prefer to be available. I like to use Cockburn's scale here; uses it for establishing the right process formalism:

    http://en.wikipedia.org/wiki/Cockburn...

    I think you can use something similar for determining what consistency guarantees the data should give you. Nonetheless the Consistency/Availability/Partitioning theorem will always apply. So if you must distribute, and must have ACID, you cannot always be available.

    Bill de hOra
    January 20, 2008 at 5:23 p.m.

    It's fast and fun,<A href="http://www.power-leveling-fast.com/" title="be recommended by a lot of old players">Aion Power Leveling</A> - <A href="http://www.power-leveling-fast.com/" title="Good Time!">Wow Power Leveling</A> - <A href="http://www.power-leveling-fast.com/" title="At our website 100% customer satisfaction is our mission.">Warhammer power leveling</A>.<A href="http://www.powerleveling-services.com/" title="Good item!">Aion Power Leveling</A> -<A href="http://www.powerleveling-services.com/" title="Good item!">Aion Gold</A>

    Aion Power Leveling
    November 30, 2009 at 5:33 a.m.

    Thank you! I would now go on here every day!
    http://www.infls.com

    We are supply all kinds brand goods:

    Shoes: Jordan, Nike,http://www.tougg.com Prada, Puma, LV, Timberland, Pual Smith, D&G, Supra, Adidas, Yeezy, ATO, CR etc.

    Clothing: Coat, Jacket, T-shirt, Suit, Sweater, Jeans, Bikini, Jersey etc.

    Handbags: Coach, Berberry, Balenciaga, http://www.bayugg.comJuicy, LV, ED-Hardy, MIUMIU, Chanel, Chole etc.

    Accessories: Belts, Sunglasses, Hats, Necktie,http://www.tougg.com Scarf, Jewelry etc.

    As the commodities we supply are of excellent quality http://www.aheadtrade.com and low price,

    we have won a very good reputation from our clients all over the world.

    If you are interested in any of our products, please don't hesitate to contact with me by email.

    I trust that through our cooperation we shall be able to conclude some transactions with you in the near future.

    Website: http://www.mbtshoe.co.uk
    http://www.aheadtrade.com
    http://www.bayugg.com
    http://www.tougg.com

    Best regards!

    UGG
    March 1, 2010 at 7:46 a.m.

    RcN3ff0 <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com <a href="http://test.com"> test </a> http://test.com

    test
    March 4, 2010 at 1:11 p.m.

    What a new <a href="http://www.life-bloger.com"title="life">life</a>! thank you.

    fef
    March 8, 2010 at 10:11 a.m.

    Really awesome on <a href="http://www.environmentalusa.org"environment="environment">brand</a>!

    we
    March 8, 2010 at 10:32 a.m.

    100309SLLQY
    Woman will begin with bailey button uggs certainties, she shall end in ugg classic cardy sale doubts,but if he will be content to begin with louis vuitton handbags sale doubts, he shall end in certainties. Determined to act prada handbags 2009 Decisivly and to bear the consequences.In this cheap coach handbags world, hesitation can not access to success. Laziness as a lock,which bolts you out of the storehouse of mui mui handbags information and makes you an intellectual starveling.Early to guess handbags sale bed and early to rise jimmy choo handbags makes a man healthy,wealthy,and wise. http://www.hideboots.com/products_new...

    guess handbags sale
    March 9, 2010 at 6:19 a.m.

    <p><a href="http://www.ghdssite.com/"><strong>cheap GHD hair straighteners</strong></a></p>
    <p><a href="http://www.ghdssite.com/"><strong>GHD straighteners wholesale</strong></a></p>
    <p><a href="http://www.ghdssite.com/"><strong>GHD styler</strong></a></p>
    <p><a href="http://www.ghdssite.com/"><strong>GHD IV styler</strong></a></p>
    <p><a href="http://www.ghdssite.com/ghd-babyliss-hair-straighteners-p-17.html"><strong>GHD Babyliss Hair Straighteners </strong></a></p>

    GHD straighteners
    March 9, 2010 at 6:47 a.m.

    http://www.onlypuma.com puma shoes
    http://www.onlypuma.com/mens-puma-sf-... Puma - SF Drift Cat
    http://www.onlypuma.com/mens-puma-bay... Puma Baylee Future Cat II
    http://www.onlypuma.com/mens-puma-dos... Puma Doshu Combat Shoes
    http://www.onlypuma.com/mens-puma-flu... Men's Puma Fluxion II
    http://www.onlypuma.com/mens-puma-fut... Puma Future Cat GT Ferrari
    http://www.onlypuma.com/mens-puma-fut... Men's Puma Future Cat Lo Engine
    http://www.onlypuma.com/mens-puma-fut... Puma Future Cat Low
    http://www.onlypuma.com/mens-puma-laz... Puma Lazy Insect
    http://www.onlypuma.com/mens-puma-sf-... Puma SF Trionfo Low
    http://www.onlypuma.com/mens-puma-spe... Puma Speed Cat
    http://www.onlypuma.com/mens-puma-spe... Puma Speed Cat Big
    http://www.onlypuma.com/mens-puma-tri... Puma Trionfo Lo L II
    http://www.onlypuma.com/mens-puma-tri... Puma Trionfo Low BAYLEE
    http://www.onlypuma.com/mens-speed-ca... Speed Cat Big
    http://www.onlypuma.com/puma-ducati-t... Puma Ducati Testastretta
    http://www.onlypuma.com/puma-kimi-rai... Puma Kimi Raikkonen shoes
    http://www.onlypuma.com/womens-puma-b... Puma Basket Brights
    http://www.onlypuma.com/womens-puma-b... Puma Baylee Future Cat
    http://www.onlypuma.com/womens-puma-d... Puma Drift Cat
    http://www.onlypuma.com/womens-puma-e... Puma Engine Cat Low
    http://www.onlypuma.com/womens-puma-e... PUMA Espera Patent FS
    http://www.onlypuma.com/womens-puma-f... Puma Ferro Tessuto Shoes
    http://www.onlypuma.com/womens-puma-f... Puma Future Cat Lo
    http://www.onlypuma.com/womens-puma-f... Puma Future Cat Low
    http://www.onlypuma.com/womens-puma-r... Puma Repli Cat
    http://www.onlypuma.com/womens-puma-s... Puma SF Drift Cat
    http://www.onlypuma.com/womens-puma-s... Puma Speed Cat Big
    http://www.onlypuma.com/womens-puma-s... Puma Speed Cat Suede

    puma shose on line
    March 9, 2010 at 7:20 a.m.

    100311SLTH
    There are things to be said about such UGG Bailey Button matters, and they are important things, but they belong to a different UGG Classic Cardy order from the things that I wish to say. My UGG Classic Short purpose is to suggest a cure for the ordinary Chloe Leather Handbags day-to-day unhappiness from Ugg Classic Tall which most people in civilised countries suffer, and which Gucci Handbags Sale is all the more unbearable bscause,having no obviious external Ugg Classic Agrly Knit cause, it appears inescapable. http://www.ladyugs.com/specials.html

    UGG Gucci
    March 11, 2010 at 3:35 a.m.

    http://www.nowghd.com/limited-edition... A woman seldom asks advice before she has bought her wedding clothes. I married beneath me. All women do. Any intelligent woman who reads the marriage contract, and then goes into it, deserves all the consequences. http://www.nowghd.com/ghd-babyliss-ha...

    ghdyacoo
    March 11, 2010 at 7:32 a.m.

    http://www.onboots.com
    http://www.onboots.com
    http://www.onboots.com
    http://www.onboots.com
    http://www.onboots.com
    http://www.onboots.com
    http://www.onboots.com/kids-timberlan...
    http://www.onboots.com/mens-timberlan...
    http://www.onboots.com/mens-timberlan...
    http://www.onboots.com/mens-timberlan...
    http://www.onboots.com/mens-timberlan...
    http://www.onboots.com/mens-timberlan...
    http://www.onboots.com/mens-timberlan...
    http://www.onboots.com/womens-timberl...
    http://www.onboots.com/womens-timberl...
    http://www.onboots.com/womens-timberl...
    http://www.onboots.com/specials.html
    --------------------------------------------------------------------------------------------------------------------------------
    http://www.onlypuma.com
    http://www.onlypuma.com/mens-puma-sf-...
    http://www.onlypuma.com/mens-puma-bay...
    http://www.onlypuma.com/mens-puma-dos...
    http://www.onlypuma.com/mens-puma-flu...
    http://www.onlypuma.com/mens-puma-fut...
    http://www.onlypuma.com/mens-puma-fut...
    http://www.onlypuma.com/mens-puma-fut...
    http://www.onlypuma.com/mens-puma-laz...
    http://www.onlypuma.com/mens-puma-sf-...
    http://www.onlypuma.com/mens-puma-spe...
    http://www.onlypuma.com/mens-puma-spe...
    http://www.onlypuma.com/mens-puma-tri...
    http://www.onlypuma.com/mens-puma-tri...
    http://www.onlypuma.com/mens-speed-ca...
    http://www.onlypuma.com/puma-ducati-t...
    http://www.onlypuma.com/puma-kimi-rai...
    http://www.onlypuma.com/womens-puma-b...
    http://www.onlypuma.com/womens-puma-b...
    http://www.onlypuma.com/womens-puma-d...
    http://www.onlypuma.com/womens-puma-e...
    http://www.onlypuma.com/womens-puma-e...
    http://www.onlypuma.com/womens-puma-f...
    http://www.onlypuma.com/womens-puma-f...
    http://www.onlypuma.com/womens-puma-f...
    http://www.onlypuma.com/womens-puma-r...
    http://www.onlypuma.com/womens-puma-s...
    http://www.onlypuma.com/womens-puma-s...
    http://www.onlypuma.com/womens-puma-s...

    Timberland boots on line
    March 12, 2010 at 3:33 a.m.

    100312SLLQY
    There is no royal road to science, and only those St Louis Rams jerseys who do not dread the fatiguing climb of gaining its numinous summits. To do whatever needs to be done to preserve this last and greatest bastion of freedom. We cannot always build Tennessee Titans jerseys the future for our youth, but we can build our youth for the future. If you would know the value of money, go and try to borrow some. To really understand a man we must judge him Los Angeles Lakers jerseys in misfortune. We have no more right to consume happiness without producing it than to consume wealth without Dallas Cowboys jerseys producing it.In delay there lies no plenty, Then come kiss me, sweet and twenty, Youth's a stuff that will not endure.Never leave that until tomorrow, which you can do today.Ordinary people merely think how Pittsburgh Penguins jerseys they shall spend their time; A man of talent tries to use it.. http://www.alihello.com/

    Tennessee Titans jerseys
    March 12, 2010 at 3:36 a.m.

    <p>Welcome to <a href="http://www.christianlouboutinshoesdirect.com/">Christian Louboutin</a> , the world’s premier luxury brand of authentic boots, shoes and slippers.<br>We guarantee you’ll want to get naked in your <a href="http://www.christianlouboutinshoesdirect.com/">Christian Louboutin Shoes</a> ! Christian Louboutin uses only the highest-grade material available.Our Louboutin UK is now available in stylish new colors and patterns that will add life to your wardrobe.<br>Our company carry on various Christian,inc <a href="http://www.christianlouboutinshoesdirect.com/">Christian Shoes</a><strong> </strong>and <a href="http://www.christianlouboutinshoesdirect.com/">Louboutin</a>.</p>

    liran313315715
    March 15, 2010 at 3:11 a.m.

    <a href="http://www.netdotmall.com/category-17-b0_-wholesale-Jordan-shoes.html">wholesale Jordan shoes</a>
    <a href="http://www.cmonc.com/category-41-b0_-wholesale-Chanel-Bags.html">wholesale Chanel handbags</a>
    <a href="http://www.cmonc.com/category-338-b0_-wholesale-Men-s-VERSACE-T-Shirts.html">wholesale VERSACE T-Shirts</a>
    <a href="http://www.netdotmall.com/category-7-b0_-wholesale-True-Religion.html">wholesale True Religion Jeans</a>
    <a href="http://www.cmonc.com/category-47-b0_-wholesale-Men-s-ARMANI-T-Shirts.html">wholesale ARMANI T-Shirts</a>
    <a href="http://www.netdotmall.com/category-344-b0_-wholesale-Ed-hardy.html">wholesale Ed hardy Jeans</a>
    <a href="http://www.cmonc.com/category-480-b0_-wholesale-Men-s-D-G-T-Shirts.html">wholesale D &amp; G T-Shirts</a>
    <a href="http://www.netdotmall.com/category-326-b0_-wholesale-Laguna-Beach.html">Laguna Beach Jeans</a>
    <a href="http://www.cmonc.com/category-61-b0_-wholesale-Men-s-Affliction-T-Shirts.html">wholesale Affliction T-Shirts</a>
    <a href="http://www.netdotmall.com/category-287-b0_-wholesale-Christian-Audigier.html">wholesale Christian Audigier Jeans</a>
    <a href="http://www.cmonc.com/category-481-b0_-wholesale-Men-s-LACOSTE-T-Shirts.html">wholesale LACOSTE T-Shirts</a>
    <a href="http://www.netdotmall.com/category-62-b0_-wholesale-Affliction.html">wholesale Affliction Jeans</a>
    <a href="http://www.cmonc.com/category-85-b0_-wholesale-NBA-jersey.html">wholesale NBA jersey</a>
    <a href="http://www.netdotmall.com/category-126-b0_-wholesale-PRADA.html">wholesale PRADA Slippers</a>
    <a href="http://www.cmonc.com/category-165-b0_-wholesale-Prada-Bags.html">wholesale Prada handbags</a>
    <a href="http://www.cmonc.com/category-82-b0_-wholesale-MLB-jersey.html">wholesale MLB jersey</a>
    <a href="http://www.netdotmall.com/category-149-b0_-wholesale-VERSACE.html">wholesale VERSACE Slippers</a>
    <a href="http://www.cmonc.com/category-83-b0_-wholesale-NFL-jersey.html">wholesale NFL jersey</a>
    <a href="http://www.netdotmall.com/category-150-b0_-wholesale-Louis-Vuitton.html">wholesale Louis Vuitton Slippers</a>
    <a href="http://www.cmonc.com/category-84-b0_-wholesale-NHL-jersey.html">wholesale NHL jersey</a>
    <a href="http://www.cmonc.com/category-197-b0_-wholesale-Dooney-Bourke-Bags.html">wholesale Dooney&amp;Bourke handbags</a>
    <a href="http://www.netdotmall.com/category-148-b0_-wholesale-VERSACE.html">VERSACE Sandals</a>
    <a href="http://www.cmonc.com/category-26-b0_-wholesale-Handbags-Bags.html">wholesale Handbags &amp; Bags</a>
    <a href="http://www.netdotmall.com/category-116-b0_-wholesale-GUCCI.html">GUCCI Sandals</a>
    <a href="http://www.cmonc.com/category-434-b0_-wholesale-Headphones-Headsets.html">wholesale Bose Headphones</a>
    <a href="http://www.netdotmall.com/category-125-b0_-wholesale-BURBERRY.html">BURBERRY Sandals</a>
    <a href="http://www.cmonc.com/category-192-b0_-wholesale-Ed-hardy.html">Ed hardy Hats</a>

    wholesale Ed Hardy Bags
    March 15, 2010 at 9:45 a.m.

Post a comment