Sample Table :
╔═══════════════╗ ║ dummy_data ║ ╠═══════════════╣ ║ XXX_1234_YYYY ║ ║ XXX_5678_YYYY ║ ║ XXX_9101_YYYY ║ ╚═══════════════╝
Desired output :
╔═══════════════╦═════════════╦═════════════╗ ║ dummy_data ║ with_prefix ║ with_suffix ║ ╠═══════════════╬═════════════╬═════════════╣ ║ XXX_1234_YYYY ║ Pre_1234 ║ 1234_Suf ║ ║ XXX_5678_YYYY ║ Pre_5678 ║ 5678_Suf ║ ║ XXX_9101_YYYY ║ Pre_9101 ║ 9101_Suf ║ ╚═══════════════╩═════════════╩═════════════╝
Currently I am trying to write a Presto Query to use on Amazon Athena,
select
dummy_data,
'Pre_' || split(dummy_data,'_')[2] as with_prefix,
split(dummy_data,'_')[2] || '_Suf' as with_suffix
from dummy_table
the above query causes split(dummy_data,'_')[2] to be computed two times. If there a way to avoid the double computation ? Also does Presto figure out that its the same computation and avoids recomputing ?
I am trying to avoid using sub-query or With clause.
Advertisement
Answer
Currently Presto does not de-decuplicate sub-expression calculations. I created feature request for this: https://github.com/prestosql/presto/issues/1070.
You can see that the expression is evaluated more than once by checking the EXPLAIN output (see the issue for example).
As you know, you can force de-duplication by using an inline view:
SELECT
dummy_data,
'Pre_' || sub_data AS with_prefix,
sub_data || '_Suf' AS with_suffix
FROM (
SELECT
dummy_data,
split(dummy_data,'_')[2] AS sub_data
FROM (VALUES 'XXX_1234_YYYY') t(dummy_data)
);