My favorites | Sign in
Project Home Downloads Wiki Issues Source
Project Information
Members
Featured
Downloads
Links

MySpace Qizmt is a mapreduce framework for executing and developing distributed computation applications on large clusters of Windows servers. The MySpace Qizmt project develops open-source software for reliable, scalable, super-easy, distributed computation software.

MySpace Qizmt core features include:

Highly Scalable Applications of MySpace Qizmt

  • Data Mining
  • Analytics
  • Bulk Media Processing
  • Content Indexing

Core MySpace Qizmt Features

  • Rapidly develop mapreducer jobs in C#.Net
  • Easy Do-It-Yourself Installer
  • Built-in IDE/Debugger
    • Automatically colors heap allocations in red
    • Autocomplete for rapid mapreducer development
    • Step through and debug mapreducer jobs directly on target cluster
  • From any machine in a cluster:
    • Edit mapreducer jobs
    • Debug mapreducer jobs
    • Execute mapreducer jobs
    • Administer mapreducer jobs
  • Delta-only exchange option for Mapreduce jobs
  • Configurable data-redundancy/machine level failover
  • Easily add machines to a cluster to increase processing power and capacity
  • CAC (Cluster Assembly Cache) for exposing .Net DLLs to mapreduce jobs
  • Three kinds of jobs
    • Mapreduce - Set-based logic on large amounts of data
    • Remote - For problems that don't fit into the mapreducer mold
    • Local - For orchestrating a pipeline of Mapreducer and Remote jobs
  • Three ways to exhange data durring mapreduce
    • Sorted - key/value pairs are evenly sorted accross the cluster
    • Grouped - like key/value pairs make their way to same reducer but not sorted
    • Hashsorted - super fast way to sort random data

MySpace Qizmt currently supports .Net 3.5 SP1 on Windows 2003 Server, Windows 2008 Server, Windows Vista and Windows 7.

MySpace Qizmt IDE/Debugger

User Documentation

MySpace Qizmt Tutorial

MySpace Qizmt Reference

MySpace Qizmt Administration

MySpace Qizmt FAQ

Qizmt SQL Documentation

MySpace Qizmt SQL Tutorial

MySpace Qizmt SQL Reference

Contributor Documentation

MySpace Qizmt Open Source Contribution

Qizmt on EC2 Documentation

Qizmt on EC2 Tutorial

Powered by Google Project Hosting