Accelerating queries

For enhancing the query performance, a user can cache the data using Flash Stack.

For example:

A user wants to reduce the time it takes to get query results, so they cache the dataset in the lakehouse Depot using Flash Service. This ensures faster query results whenever the dataset is queried. The below manifest file defines a Service named flashtest. The Service caches a dataset named city, stored in dataos://lakehouse:retail/city, and initializes a table mycity by selecting data from retail.city.

name: flashtest
version: v1
type: service
tags:
    - service
description: Flash service
workspace: public
service:
    servicePort: 8080
    servicePorts:
    - name: backup
        servicePort: 5433  
    ingress:
    enabled: true
    stripPath: false
    path: /flash/public:flashtest
    noAuthentication: true
    replicas: 1
    logLevel: info
    compute: runnable-default
    envs:
    APP_BASE_PATH: 'dataos-basepath'
    FLASH_BASE_PATH: /flash/public:flashtest
    resources:
    requests:
        cpu: 1000m
        memory: 1024Mi
    stack: flash+python:2.0
    stackSpec:
# Datasets
    datasets:
        - name: city
        address: dataos://lakehouse:retail/city

    init:
        - create table mycity as (select * from retail.city)

    # schedule:
    #   - expression: "*/2 * * * *"
    #     sql: INSERT INTO mycustomer BY NAME (select * from customer);