BigQuery

BigQuery is a RESTful web service that enables interactive analysis of massively large datasets working in conjunction with Google Storage. It is a serverless Platform as a Service (PaaS) that may be used complementarily with MapReduce.

BigQuery
Type of site
Platform as a service
Available inEnglish
OwnerGoogle
Websitecloud.google.com/products/bigquery/
RegistrationRequired
LaunchedMay 19, 2010
Current statusActive

History

After a limited testing period in 2010, BigQuery was generally available in November 2011 at the Google Atmosphere conference.[1]

In April 2016, European users of the service suffered a 12-hour outage.[2] In May 2016, support was announced for Google Sheets.[3]

Design

BigQuery provides external access to the Dremel technology,[4][5] a scalable, interactive ad hoc query system for analysis of read-only nested data. BigQuery requires all requests to be authenticated, supporting a number of Google-proprietary mechanisms as well as OAuth.

Features

  • Managing data - create and delete tables based on a JSON-encoded schema, import data encoded as CSV or JSON from Google Storage.
  • Query - the queries are expressed in a standard SQL dialect[6] and the results are returned in JSON with a maximum reply length of approximately 128 MB, or an unlimited size when large query results are enabled.[7]
  • Integration - BigQuery can be used from Google Apps Script[8] (e.g. as a bound script in Google Docs), or any language that can work with its REST API or client libraries[9].
  • Access control - is possible to share datasets with arbitrary individuals, groups, or the world.

References

  1. ^ Iain Thomson (November 14, 2011). "Google opens BigQuery for cloud analytics: Dangles free trial to lure doubters". Retrieved August 26, 2016.
  2. ^ Simon Sharwood (April 7, 2016). "Google Euro-cloud glitch". Retrieved August 26, 2016.
  3. ^ Jordan Novet (May 6, 2016). "Google BigQuery now lets you analyze data from Google Sheets". Retrieved August 26, 2016.
  4. ^ Sergey Melnik; Andrey Gubarev; Jing Jing Long; Geoffrey Romer; Shiva Shivakumar; Matt Tolton; Theo Vassilakis (2010). "Dremel: Interactive Analysis of Web-Scale Datasets". Proc. of the 36th International Conference on Very Large Data Bases (VLDB).
  5. ^ Kazunori Sato (2012). "An Inside Look at Google BigQuery" (PDF). Google. Retrieved August 26, 2016.
  6. ^ "SQL Reference". Retrieved 26 June 2017.
  7. ^ "Quota Policy". Retrieved 26 June 2017.
  8. ^ "BigQuery Service | Apps Script | Google Developers". March 15, 2018. Retrieved April 23, 2018.
  9. ^ "BigQuery Client Libraries". Retrieved 26 June 2017.

External links

AI Challenge

The AI Challenge was an international artificial intelligence programming contest started by the University of Waterloo Computer Science Club.

Initially the contest was for University of Waterloo students only. In 2010, the contest gained sponsorship from Google and allowed it to extend to international students and the general public.

Android Q

Android "Q" is the upcoming tenth major release and the 17th version of the Android mobile operating system. The first beta of Android Q was released on March 13, 2019 for all Google Pixel phones. The final release of Android Q is scheduled to be released in the third quarter of 2019.

Apache Drill

Apache Drill is an open-source software framework that supports data-intensive distributed applications for interactive analysis of large-scale datasets. Drill is the open source version of Google's Dremel system which is available as an infrastructure service called Google BigQuery. One explicitly stated design goal is that Drill is able to scale to 10,000 servers or more and to be able to process petabytes of data and trillions of records in seconds. Drill is an Apache top-level project.Drill supports a variety of NoSQL databases and file systems, including Alluxio, HBase, MongoDB, MapR-DB, HDFS, MapR-FS, Amazon S3, Azure Blob Storage, Google Cloud Storage, Swift, NAS and local files. A single query can join data from multiple datastores. For example, you can join a user profile collection in MongoDB with a directory of event logs in Hadoop.

Drill's datastore-aware optimizer automatically restructures a query plan to leverage the datastore's internal processing capabilities. In addition, Drill supports data locality, if Drill and the datastore are on the same nodes.Apache Drill 1.9 added dynamic user defined functions.

Apache Drill 1.11 added cryptographic-related functions and PCAP file format support.

Chromebit

The Chromebit is a dongle running Google's Chrome OS operating system. When placed in the HDMI port of a television or a monitor, this device turns that display into a personal computer. Chromebit allows adding a keyboard or mouse over Bluetooth or Wi-Fi. The device was announced in April 2015 and began shipping that November.

Dremel (software)

Dremel is a distributed system developed at Google for interactively querying large datasets.

Dremel is the query engine used in Google's BigQuery service.

Dremel is the inspiration for Apache Drill, Apache Impala, and Dremio, an Apache licensed platform that includes a distributed SQL execution engine.

Fluentd

Fluentd is a cross platform open-source data collection software project originally developed at Treasure Data. It is written primarily in the Ruby programming language.

G Suite Marketplace

G Suite Marketplace (formerly Google Apps Marketplace) is a product of Google Inc. It is an online store for web applications that work with Google Apps (Gmail, Google Docs, Google Sites, Google Calendar, Google Contacts, etc.) and with third party software. Some Apps are free. Apps are based on Google APIs or on Google Apps Script.

Global Database of Events, Language, and Tone

The Global Database of Events, Language, and Tone (GDELT), created by Kalev Leetaru of Yahoo! and Georgetown University, along with Philip Schrodt and others, describes itself as "an initiative to construct a catalog of human societal-scale behavior and beliefs across all countries of the world, connecting every person, organization, location, count, theme, news source, and event across the planet into a single massive network that captures what's happening around the world, what its context is and who's involved, and how the world is feeling about it, every single day." Early explorations leading up to the creation of GDELT were described by co-creator Philip Schrodt in a conference paper in January 2011. The dataset is available on Google Cloud Platform.

Google APIs

Google APIs is a set of application programming interfaces (APIs) developed by Google which allow communication with Google Services and their integration to other services. Examples of these include Search, Gmail, Translate or Google Maps. Third-party apps can use these APIs to take advantage of or extend the functionality of the existing services.

The APIs provide functionality like analytics, machine learning as a service (the Prediction API) or access to user data (when permission to read the data is given). Another important example is an embedded Google map on a website, which can be achieved using the Static maps API, Places API or Google Earth API.

Google Behind the Screen

"Google: Behind the Screen" (Dutch: "Google: achter het scherm") is a 51-minute episode of the documentary television series Backlight about Google. The episode was first broadcast on 7 May 2006 by VPRO on Nederland 3. It was directed by IJsbrand van Veelen, produced by Nicoline Tania, and edited by Doke Romeijn and Frank Wiering.

Google Cloud Platform

Google Cloud Platform (GCP), offered by Google, is a suite of cloud computing services that runs on the same infrastructure that Google uses internally for its end-user products, such as Google Search and YouTube. Alongside a set of management tools, it provides a series of modular cloud services including computing, data storage, data analytics and machine learning. Registration requires a credit card or bank account details.Google Cloud Platform provides Infrastructure as a service, Platform as a service, and Serverless computing environments.

In April 2008, Google announced App Engine, a platform for developing and hosting web applications in Google-managed data centers, which was the first cloud computing service from the company. The service became generally available in November 2011. Since the announcement of App Engine, Google added multiple cloud services to the platform.

Google Cloud Platform is a part of Google Cloud, which includes the Google Cloud Platform public cloud infrastructure, as well as G Suite, enterprise versions of Android and Chrome OS, and application programming interfaces (APIs) for machine learning and enterprise mapping services.

Google Dataset Search

Google Dataset Search is a search engine from Google that helps researchers locate online data that is freely available for use. The company launched the service on September 5, 2018, and stated that the product was targeted at scientists and data journalists.

Google Dataset Search complements Google Scholar, the company's search engine for academic studies and reports.

Google Finance

Google Finance is a website focusing on business news and financial information hosted by Google.

Google Fit

Google Fit is a health-tracking platform developed by Google for the Android operating system and Wear OS. It is a single set of APIs that blends data from multiple apps and devices. Google Fit uses sensors in a user's activity tracker or mobile device to record physical fitness activities (such as walking or cycling), which are measured against the user's fitness goals to provide a comprehensive view of their fitness.

Google Forms

Google Forms is a survey administration app that is included in the Google Drive office suite along with Google Docs, Google Sheets, and Google Slides.

Forms features all of the collaboration and sharing features found in Docs, Sheets, and Slides.

Google Guice

Google Guice (pronounced "juice") is an open-source software framework for the Java platform released by Google under the Apache License. It provides support for dependency injection using annotations to configure Java objects. Dependency injection is a design pattern whose core principle is to separate behavior from dependency resolution.

Guice allows implementation classes to be bound programmatically to an interface, then injected into constructors, methods or fields using an @Inject annotation. When more than one implementation of the same interface is needed, the user can create custom annotations that identify an implementation, then use that annotation when injecting it.

Being the first generic framework for dependency injection using Java annotations in 2008, Guice won the 18th Jolt Award for best Library, Framework, or Component.

Google Storage

Google Cloud Storage is a RESTful online file storage web service for storing and accessing data on Google Cloud Platform infrastructure. The service combines the performance and scalability of Google's cloud with advanced security and sharing capabilities. It is an Infrastructure as a Service (IaaS), comparable to Amazon S3 online storage service. Contrary to Google Drive and according to different service specifications, Google Cloud Storage appears to be more suitable for enterprises.

Google The Thinking Factory

Google: The Thinking Factory is documentary film about Google Inc. from 2008 written and directed by Gilles Cayatte.

Project Sunroof

Project Sunroof is a solar power initiative started by Google engineer Carl Elkin. The initiative's stated purpose is "mapping the planet's solar potential, one roof at a time."

As a service
Technologies
Applications
Platforms
Infrastructure
Overview
Advertising
Communication
Software
Platforms
Hardware
Development
tools
Publishing
Search
(timeline)
Events
People
Other
Related

This page is based on a Wikipedia article written by authors (here).
Text is available under the CC BY-SA 3.0 license; additional terms may apply.
Images, videos and audio are available under their respective licenses.