Hot Scalability Links for June 3, 2010

6/3/2010

How Big is a Yottabyte? Not so big that the NSA can't hope to store it says CrunchGear: There are a thousand gigabytes in a terabyte, a thousand terabytes in a petabyte, a thousand petabytes in an exabyte, a thousand exabytes in a zettabyte, and a thousand zettabytes in a yottabyte. In other words, a yottabyte is 1,000,000,000,000,000GB.
The CMS data aggregation system. The Large Hadron Collider project is using MongoDB as a cache. Here we discuss a new data aggregation system which consumes, indexes and delivers information from different relational and non-relational data sources to answer cross data-service queries and explore meta-data associated with petabytes of experimental data.
Google I/O 2010 Videos are up available (many of them anyway). You might be particularly interested in Google Storage for Developers, Building high-throughput data pipelines with Google App Engine, Batch data processing with App Engine, BigQuery and Prediction APIs, Measure in milliseconds redux: Meet Speed Tracer
Scale at Facebook by Director of Engineering, Aditya Agarwal. You can't scale Facebook using traditional horizontal partitioning. People make friends across many networks. Every new user can potentially access any other user. There's no way to cut the data to effectively partition the data such that access is within that particular partition.

Full story: High Scalability

Similar articles

robertpohl - Twitter Search

Hot Scalability Links for June 3, 2010 http://shar.es/mxmfb Hot Scalability Links for June 3, 2010 http://shar.es/mxmfb

High Scalability

Hot Scalability Links for June 16, 2010 You're Doing it Wrong by Poul-Henning Kamp. Don't look so guilty, he's not talking about you know what, he's talking about writing high-performance server programs: Not just wrong as in no...

High Scalability

Hot Scalability Links for June 25, 2010 Royans Tharakan is blogging like a mad man at the Velocity Conference. Read a summary of many of the presentations on his blog. Zuckerberg almost guarantees 1 billion Facebook users. And I almost&nb...

High Scalability

Hot Scalability Links for March 3, 2010 Getting Real about NoSQL and the SQL-Isn't-Scalable Lie by Dennis Forbes. Buoyed by Canada's Olympic success, Dennis is going for the gold in that least real of sports, the NoSQL vs SQL pursuit. Desi...

High Scalability

Hot Scalability Links For Sep 3, 2010 With summer almost gone, it's time to fall into some good links... Hibari - distributed, fault tolerant, highly available key-value store written in Erlang. In this video Scott Lystig Fri...

High Scalability

Hot Scalability Links for January 28 2010 Google's Research Areas of Interest: Building scalable, robust cluster applications. At Google we see distributed systems as a technology in its infancy, with huge gaps in the supporting research t...

Comments on this article

Add your comment

Report

Latest from High Scalability

High Scalability

Averages, web performance data, and how your analytics product is lying to you This guest post is written by Josh Fraser, co-founder and CEO of Torbit. Torbit creates tools for measuring, analyzing and opt...

High Scalability

Sponsored Post: Torbit, Infragistics, Velocity, Reality Check Network, Gigaspaces, AiCache, Logic Monitor, Attribution Modeling, Who's Hiring? Torbit is hiring! Care about performance? Care about making the internet faster and better? At Torbit...

High Scalability

Pinterest Architecture Update - 18 Million Visitors, 10x Growth,12 Employees, 410 TB of Data There has been an update on Pinterest: Pinterest growth driven by Amazon cloud scalability since our last post: ...

High Scalability

Stuff The Internet Says On Scalability For May 18, 2012 It's HighScalability Time: 42 Billion: Netflix API Requests/Month Quotable quotes: @commonlisp: Ideas from the...

High Scalability

Big List of 20 Common Bottlenecks In Zen And The Art Of Scaling - A Koan And Epigram Approach, Russell Sullivan offered an interesting conjecture: there are 20 c...

High Scalability

DynamoDB Talk Notes and the SSD Hot S3 Cold Pattern My impression of DynamoDB before attending a Amazon DynamoDB for Developers talk is that it’s the usual quality service p...

High Scalability

Stuff The Internet Says On Scalability For May 11, 2012 It's HighScalability Time: 2.5M : Erlang Concurrent Connections; 20 Billion : Urban Airship Push Notifications. @ag...

High Scalability

Paper: Paxos Made Moderately Complex If you are a normal human being and find the Paxos protocol confusing, then this paper, Paxos Made Moderately Complex, is ...

High Scalability

Cell Architectures A consequence of Service Oriented Architectures is the burning need to provide services at scale. The architecture that has evo...

High Scalability

Sponsored Post: Infragistics, Velocity, Reality Check Network, Gigaspaces, AiCache, ElasticHosts, Logic Monitor, Attribution Mod Who's Hiring? Are you looking for good people? Fun and Informative Events The DevOps PaaS Infusion Meetup NYC - T...

Hot Scalability Links for June 3, 2010

Similar articles

robertpohl - Twitter Search

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

Comments on this article

Latest from High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

High Scalability

Sign In