BigQuery
Connecting BigQuery to LightBeam
Last updated
Connecting BigQuery to LightBeam
Last updated
LightBeam Spectra users can connect various data sources to the LightBeam application and these data sources will be continuously monitored for PII, PHI data.
Examples: BigQuery, SMB, MySQL, PostgreSQL, etc.
Login to your LightBeam Instance.
Click on DATASOURCES on the Top Navigation Bar.
Click on “Add a data source”.
Search for “BigQuery”.
Fill in the details as shown below and click Next:
Instance Name: This is the unique name given to the data source.
Description: This is an optional field needed to describe the use of this data source.
Assign owner: Email address of the person responsible for this data source which will get alerts by default.
Entity Creation: LightBeam Spectra detects and associates attributes based on the context and identifies whose data it is; these are called entities. Example: Jane Doe is an entity for whom LightBeam Spectra might have detected Name and SSN in a monitored data source.
Source of Truth: LightBeam Spectra includes monitored data sources that serve as a single point of truth. These sources are utilized for looking up entities/attributes to verify the accuracy of attributes/entities discovered in other data sources. By using a Source of Truth dataset, entities are formulated based on the attributes present in the data.
Location: The location of the data source.
Purpose: The purpose of the data being collected/processed.
Stage: The stage of the data source. Example: Source, Processing, Archival, etc.
Insert the credentials as shown below:
Verify that you get the message Test Connection Success on the screen. Click on Next.
In this step, select specific project(s) that you have to scan from the drop-down list.
Now we are ready to connect to the test database and proceed.
Click on Register.
This will show you the following message:
Click on Okay.
Now you can browse the updated datasource.
Role: A role is a named set of access privileges that can be granted to users or other roles. These privileges determine what actions a user can perform and on which database objects.
In the Google Cloud console, go to IAM & Admin -> Roles
.
Click on Create Role.
Fill in the role name.
Assign the following permissions to the role:
Navigate to Service Accounts
and then click on Create Service Account.
Enter the required details, such as the name of the service account. Click Create And Continue.
Grant the role you created in the previous step to this service account and click on Continue And Save.
Once the service account has been created, select it. Navigate and click on Keys
.
Choose Create New Key.
For Key Type, choose JSON and then click Create.
10. Download the JSON file and convert it to base64 by using the following command
Now use the JSON key to connect the datasource.
LightBeam automates Privacy, Security, and AI Governance, so businesses can accelerate their growth in new markets. Leveraging generative AI, LightBeam has rapidly gained customers’ trust by pioneering a unique privacy-centric and automation-first approach to security. Unlike siloed solutions, LightBeam ties together sensitive data cataloging, control, and compliance across structured and unstructured data applications providing 360-visibility, redaction, self-service DSRs, and automated ROPA reporting ensuring ultimate protection against ransomware and accidental exposures while meeting data privacy obligations efficiently. LightBeam is on a mission to create a secure privacy-first world helping customers automate compliance against a patchwork of existing and emerging regulations.
Check the tickboxes next to the project you would like to add. To add or remove datasets within the project, you can use the '' or '' signs.
For any questions or suggestions, please get in touch with us at: .