The Problem of Processing and Storage of Large Amounts of Scientific Data and Approaches to Its Solution
Isaev E.A., Kornilov V.V.
Pushchino Radio Astronomy Observatory of Astro Space Center of PN Lebedev Physics Institute, RAS
Institute of Mathematical Problems of Biology, RAS
National Research University "Higher School of Economics"
Abstract. Today we have the problem of big science data. The information collecting in science experiments, especially in bioinformatics and astrophysics grows in amazing rate. In this paper we consider special program techniques and computer technologies used for work with superlarge volumes of data. Also, we discuss the state of affairs with the big data in the Institute of Mathematical Problems of Biology RAS and in the Pushchino Radio Astronomy Observatory (Astro Space Center of Lebedev Physics Institute RAS).
Key words: big data, bioinformatics, particle physics, astrophysics, cloud computing, data center, computer systems handling big data, computer cluster, Apache Hadoop, MapReduce, NoSQL, GRID.