hello i installed pyspark now and i have a database postgres in local in DBeaver : how can i connect to postgres from pyspark please i tried this but i have an error Answer You need to add the jars you want to use when creating the sparkSession. See this : https://spark.apache.org/docs/2.4.7/submitting-applic…
Tag: postgresql
Add on to an existing value in a field
In MySQL I would do something along the lines of I tried the following but after a bunch of searching I wasn’t able to find how to do the same in postgresql so my question is how would I go about adding a number to the previous value of a field (BIGINT) Answer You have to catch the value from
PostgreSQL generating missing records and group them with source table
I’m creating a PostgreSQL query and I’d like to have the missing records for each day filled in automatically. It occurred to me that I could generate a table that contained zero values and then join a source table to it. So I created this query, but the result still does not contain missing days,…
How to view hourly results during the time specified in Postgres
I want to create a query that returns a list of timezones as a result when the following conditions are specified. How can I get this? Answer Use generate_series to create the records from the time interval, and jsonb_build_objebt with jsonb_agg to create your json document: Demo: db<>fiddle
Date range to row in postgres
I have a table in postgres like this: id open_date close_date 5 2006-08-04 2019-12-31 There exist 4897 days between them. I need to turn the date range to date to have one record per day. For example: id open_date close_date valid_date 5 2006-08-04 2019-12-31 2006-08-04 5 2006-08-04 2019-12-31 2006-08-05 5 20…
PostgreSQL – how to have the 0 values using a WHERE?
i am currently working on PostgreSQL having 2 data tables : item and order. I want to display the number of order for each item in a period of time, but i would like to keep the name displayed if it’s 0. i’m actually doing: The problem is that my results are: And i would like to have: I have
Implement batchMerge() in JOOQ
I need to “upsert” a List of items. If an item’s id and anotherId is already existing, other values should be replaced by the new item. If it’s not, item should be inserted as new record. I came across JOOQ’s batchMerge and I thought it is similar to “upsert”. Unfortu…
Split text and digits by delimiter using regexp splitpart
From the table below I would like to split the config_json column into 2 columns as below The regex part of the code currently looks like this: However, there are some remains such as below: Thus, the formula above still needs to split by not just true,false or null, but also by digits or string. How can I fi…
Filtering null values when casting – using CASE statements
I’ve been trying to query rows with a date field up to a threshold. For reasons beyond my control, all fields are varchar. I’m trying to filter out null values which case an error when cast. My latest attempt: The above code still hits an error trying to cast “” to a date. I thought th…
Exclude from resultset based on condition
Given the following table FOO; How can I select all the records except where org = Y and status = CLOSED So the resultset looks like: Answer You can do this either of these ways: