Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
Discussion Groups
Database Servers
DB2InformixIngresMS SQLOraclePervasive.SQLPostgreSQLProgressSybase
Desktop Databases
FileMakerFoxProMS AccessParadox
General
General DB TopicsDatabase Theory
Related Topics
Java Development.NET DevelopmentVB DevelopmentMore Topics ...

Database Forum / DB2 Topics / July 2006

Tip: Looking for answers? Try searching our database.

COMPRESS .. & VALUES COMPRESSION change request: RFC.

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
Konstantin Andreev - 06 Jul 2006 12:52 GMT
Well known, during "CREATE TABLE" we could optionally specify "COMPRESS SYSTEM DEFAULT" and "VALUE COMPRESSION" options. The main idea about these statements is : NOT to keep on disk the values that can be deduced from some means, isn't it ?

The small investigation ( on DB2/LINUX 8.2.3 ) shows these values are compressed:

- for numbers (integers,decimals): ZEROs and NULLs (if nullable).
- for strings (graphic) : sequences of spaces of any length (0-max) and NULLs (if nullable).

Nothing wrong with this implementation, but...  The more natural behaviour is expected, like defined in DB2 Reference manual: "... default values used for the data types ... are to be stored using minimal space".

The change desirable:  instead of skipping default value for "data type", do skip default value for COLUMN in table definition.

This change would greatly benefit applications which create huge sparse tables all filled almost single values (like JDE Peoplesoft ERP system).

Cheers,
--
Konstantin Andreev.
Serge Rielau - 06 Jul 2006 16:02 GMT
> Well known, during "CREATE TABLE" we could optionally specify "COMPRESS
> SYSTEM DEFAULT" and "VALUE COMPRESSION" options. The main idea about
[quoted text clipped - 18 lines]
> This change would greatly benefit applications which create huge sparse
> tables all filled almost single values (like JDE Peoplesoft ERP system).
DB2 9 has table compression. Customers like VISA have seen huge (like
80%) reduction in size.

Cheers
Serge
Signature

Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ondemandbusiness/conf2006/

Konstantin Andreev - 07 Jul 2006 09:15 GMT
>> The change desirable:  instead of skipping default value for "data type", do skip default value for COLUMN in table definition.
>>
>> This change would greatly benefit applications which create huge sparse tables all filled almost single values (like JDE Peoplesoft ERP system).
> DB2 9 has table compression. Customers like VISA have seen huge (like 80%) reduction in size.

Excellent ! Waiting for production release of DB2 Viper...
--
Konstantin Andreev.
Frank Swarbrick - 07 Jul 2006 18:33 GMT
Serge Rielau<srielau@ca.ibm.com> 07/06/06 9:02 AM >>>
>DB2 9 has table compression. Customers like VISA have seen huge (like
>80%) reduction in size.

You're probably not at liberty to say, but I'll ask anyway...  Assuming you
know the answer, does Visa use DB2 to store all online transactions that
pass through VisaNet?  I was under the impression they used z/TPF for their
transaction processing.  (Or is there a special version of DB2 for TPF?).

Just wondering...  we are a VisaNet processor endpoint, but we use VSAM for
all of our "card system related" files, for performance reasons.  But if
Visa uses DB2 I can't imagine any reason we shouldn't also.

Frank

---
Frank Swarbrick
Senior Developer/Analyst - Mainframe Applications
FirstBank Data Corporation - Lakewood, CO  USA
Serge Rielau - 07 Jul 2006 19:23 GMT
> Serge Rielau<srielau@ca.ibm.com> 07/06/06 9:02 AM >>>
>> DB2 9 has table compression. Customers like VISA have seen huge (like
[quoted text clipped - 8 lines]
> all of our "card system related" files, for performance reasons.  But if
> Visa uses DB2 I can't imagine any reason we shouldn't also.
The data point I gave on compression relates to a data warehouse:
http://www.ibm.com/software/data/db2/demo/?S_TACT=105AGX11&S_CMP=VIPER
I don't know what they run beyond that on DB2 for LUW and you are
correct, if I knew I probably wouldn't be at liberty to say without a
quote to point to as in above link. Now that quote does have a name and
Ellen is a friendly person.

Cheers
Serge
Signature

Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ondemandbusiness/conf2006/

Frank Swarbrick - 08 Jul 2006 01:11 GMT
Serge Rielau<srielau@ca.ibm.com> 07/07/06 12:23 PM >>>
>> Serge Rielau<srielau@ca.ibm.com> 07/06/06 9:02 AM >>>
>>> DB2 9 has table compression. Customers like VISA have seen huge (like
[quoted text clipped - 14 lines]
>quote to point to as in above link. Now that quote does have a name and
>Ellen is a friendly person.

Data warehouse makes sense.  I can only imagine (in my nightmares!) how much
data they are storing!

Thanks for the info and the link.  (Now is that a picture of you on that
page? <g>)

Frank

---
Frank Swarbrick
Senior Developer/Analyst - Mainframe Applications
FirstBank Data Corporation - Lakewood, CO  USA
Serge Rielau - 08 Jul 2006 03:31 GMT
> Data warehouse makes sense.  I can only imagine (in my nightmares!) how much
> data they are storing!
*chuckle*Now add Information Integration and Identity Analytics to the
mix and you're still playing catch up with reality.

Cheers
Serge
Signature

Serge Rielau
DB2 Solutions Development
IBM Toronto Lab

IOD Conference
http://www.ibm.com/software/data/ondemandbusiness/conf2006/

Konstantin Andreev - 07 Jul 2006 19:55 GMT
>> The change desirable:  instead of skipping default value for "data type", do skip default value for COLUMN in table definition.
>>
>> This change would greatly benefit applications which create huge sparse tables all filled almost single values (like JDE Peoplesoft ERP system).
> DB2 9 has table compression. Customers like VISA have seen huge (like 80%) reduction in size.

I've just read "Introducing DB2 9, Part 1: Data compression in DB2 9" from developerWorks. The "table compression" is rather distinct from proposed "column default" compression. How would be interesting to compare the effectiveness...
--
Konstantin Andreev.
 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2009 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.