Home | Contact Us | FAQ | Search & Site Map | Link to Us
Sign In | Join | Other 45 Sites in Network
Home
Discussion Groups
Database Servers
DB2InformixIngresMS SQLOraclePervasive.SQLPostgreSQLProgressSybase
Desktop Databases
FileMakerFoxProMS AccessParadox
General
General DB TopicsDatabase Theory
Related Topics
Java Development.NET DevelopmentVB DevelopmentMore Topics ...

Database Forum / DB2 Topics / December 2005

Tip: Looking for answers? Try searching our database.

validation testing -- use TPC-C? (or what?)

Thread view: 
Enable EMail Alerts  Start New Thread
Thread rating: 
z - 13 Dec 2005 15:30 GMT
How can validation testing on DBMSs such as DB2 and Oracle be performed?

Is there a quick commonly used publicly available DBMS test that can be
used?

Could TPC-C be used?  If so, where can TPC-C be obtained?  (Is is publicly
available?)

Thanks.
Larry Menard - 13 Dec 2005 17:05 GMT
  My TPC knowledge is a bit dated, so take it with a grain of salt.

  First of all, make sure you are looking for the right benchmark for the
type of processing you are interested in.  For example, TPC-C is a benchmark
that is indicative primarily of rapid transaction processing.  There are
other benchmarks for workloads that are more DSS-intensive (TPC-H or TPC-D)
or web-intensive (TPC-W).

  Second, I don't know of any publicly available TPC-C kits.  It is my
understanding that the source code used for TPC-C benchmark applications are
closely-guarded secrets, since the application code itself might contain
code that accounts for significant performance improvements.
Signature

--------------------
Larry Menard
"Defender of Geese and of All Things Natural"

> How can validation testing on DBMSs such as DB2 and Oracle be performed?
>
[quoted text clipped - 5 lines]
>
> Thanks.
Mark A - 13 Dec 2005 18:51 GMT
>   My TPC knowledge is a bit dated, so take it with a grain of salt.
>
[quoted text clipped - 8 lines]
> are closely-guarded secrets, since the application code itself might
> contain code that accounts for significant performance improvements.
The TPC benchmarks are published at www.tpc.org

I have reproduced the TPC-H (decision support) benchmark and the tpc.org
site provides you with everything you will need, including the test data
generator program. You may find it a bit difficult to compile the test data
generator program successfully, but I was able to get it to work after
changing a few compile parms. They also supply the schema and queries. You
will want to look at the vendor docs for each benchmark to pick up any
customization they have done to queries to allow for slight variations in
SQL syntax between the databases.

The TPC-C OLTP benchmark may be harder to reproduce as mentioned above, but
details of the benchmarks are published by each vendor on the website so you
could look there.
Serge Rielau - 13 Dec 2005 23:18 GMT
>    My TPC knowledge is a bit dated, so take it with a grain of salt.
>
[quoted text clipped - 8 lines]
> closely-guarded secrets, since the application code itself might contain
> code that accounts for significant performance improvements.
Larry,

Actually the rules demand full disclosure. And everything should be
available rom the TPC website. Starting from the algorithms to generate
the data to the exact configuration and sourcecodee for any run.
In theory a competitor can validate a TPC result inhouse
(I doubt that this has ever been done though).
Due to this rule to expose these benchmarks can be challenged.
E.g. Oracle successfully challenged the first SQL Server 2000 TPC-C
benchmark using clustering (partitioned views) because SS2000 couldn't
update the partitioning key.

Cheers
Serge
Signature

Serge Rielau
DB2 SQL Compiler Development
IBM Toronto Lab

Larry Menard - 14 Dec 2005 02:51 GMT
  I stand (or actually, sit) corrected.

Signature

--------------------
Larry Menard
"Defender of Geese and of All Things Natural"

>>    My TPC knowledge is a bit dated, so take it with a grain of salt.
>>
[quoted text clipped - 22 lines]
> Cheers
> Serge
DA Morgan - 13 Dec 2005 18:44 GMT
> How can validation testing on DBMSs such as DB2 and Oracle be performed?
>
[quoted text clipped - 5 lines]
>
> Thanks.

To validate what? why? for what purpose?

There is a huge difference between validation for security and
validation for transaction for a banking system.

You inquiry is roughly equivalent to "How an I test a vehicle with wheels?"

And my answer is roughly equivalent to "Is it a bicycle or a supersonic
jet?"
Signature

Daniel A. Morgan
http://www.psoug.org
damorgan@x.washington.edu
(replace x with u to respond)

z - 20 Dec 2005 16:03 GMT
You're right...

I went back and determined (as far as could be determined)
that the testing requirements are not high.
IOW I need a "tricycle" or "scooter"
according to your analogy.

While keeping the other options in mind,
I am now looking at the following questions:

1. Presume Oracle 9i installation has succeeded.
Oracle 9i reputedly has a "sample" database.
Where is it, how can I load it and play with it?
Are there sample queries?

2. Can one take small databases (such as
the Oracle 9i sample db) from Oracle 9i
and loade it into DB2?

Thanks...

...

> To validate what? why? for what purpose?
>
[quoted text clipped - 5 lines]
> And my answer is roughly equivalent to "Is it a bicycle or a supersonic
> jet?"
DA Morgan - 20 Dec 2005 19:07 GMT
> You're right...
>
[quoted text clipped - 30 lines]
>>And my answer is roughly equivalent to "Is it a bicycle or a supersonic
>>jet?"

Please do not top post.

You ask about the sample database in a manner that makes me think you
are coming to Oracle from some other database product and have have no
idea what the word database means in the context of Oracle.

In Oracle the word is schema. And you should find that you have numerous
sample/demo schemas installed including SCOTT, BI, PM, HR, OE, and SH.
Try this query:

SELECT username FROM dba_users;

You will get nowhere with Oracle if you treat Oracle like a Microsoft
or IBM product. Expect massive disappointment. Alternatively: Go to
http://tahiti.oracle.com and look up "DATABASE", "INSTANCE", "SCHEMA",
"USER" and get yourself a copy of every book Tom Kyte has written.
Signature

Daniel A. Morgan
http://www.psoug.org
damorgan@x.washington.edu
(replace x with u to respond)

Pierre Saint-Jacques - 20 Dec 2005 21:35 GMT
I gather you're looking to test on DB2.
After install, go to the first steps and you'll find you can create sample
databases for a simple db or for a datawarehouse.
It depends on what you install.
The sample db (called SAMPLE) can also get created from a command line by
opening a db2 command window and issuing: db2sampl  Notice no"e" at the end.

If you want more serious testing there are tools that can be downloaded (
for a fee) to help you out.
HTH,  Pierre.

Signature

Pierre Saint-Jacques
SES Consultants Inc.
514-737-4515

> You're right...
>
[quoted text clipped - 29 lines]
>> And my answer is roughly equivalent to "Is it a bicycle or a supersonic
>> jet?"
Mark Townsend - 21 Dec 2005 01:14 GMT
> 1. Presume Oracle 9i installation has succeeded.
> Oracle 9i reputedly has a "sample" database.
> Where is it, how can I load it and play with it?
> Are there sample queries?

There are a number of sample schemas provided in the default install.
Look for users HR (for a Human Resources related schema), OE (for an
order entry related schema), SH (for a sales history related schema), PM
(for a product management related schema) and IX (for an information
exchange related schema).

Each schema builds on the previous, and introduces new concepts.

For example OE adds object types
SH is a large data warehousing schema
PM has media types
IX adds queues and replicants

They are widely used in the examples in all Oracle documentation,
cirriculum and collateral - see
http://www.oracle.com/pls/db102/to_toc?pathname=server.102%2Fb14198%2Ftoc.htm
for a description

> 2. Can one take small databases (such as
> the Oracle 9i sample db) from Oracle 9i
> and loade it into DB2?

Some of the basic schemas, such as HR, should unload and load easily
into DB2. Others, as indicated, use specific Oracle features that may be
more difficult to translate into DB2
Matt Emmerton - 14 Dec 2005 04:54 GMT
> How can validation testing on DBMSs such as DB2 and Oracle be performed?
>
[quoted text clipped - 3 lines]
> Could TPC-C be used?  If so, where can TPC-C be obtained?  (Is is publicly
> available?)

If you want to validate a database for use in your business environment, the
best thing to do is build a simple prototype of your business app and test
it on the databases you're considering.  Both DB2 and Oracle come in
"express" editions, and should be full-featured enough to put a prototype
through it's paces.  This way you can play with performance scaling, various
DDL options, backup/restore and other things that you're bound to do when in
production, and really get a feel for what works best in the intended
environment.

To echo someone else's comments -- using an off-the-shelf benchmark (such as
any of the TPC benchmarks) may not be anywhere near close to what your
business needs are, and thus you'd end up with something that isn't a good
fit.  It's much like deciding to buy a sports car because it was the fastest
and flashiest, and then finding out that your wife is pregnant with triplets
and you should have bought a mini-van :)

--
Matt Emmerton
DA Morgan - 14 Dec 2005 20:52 GMT
>>How can validation testing on DBMSs such as DB2 and Oracle be performed?
>>
[quoted text clipped - 7 lines]
> best thing to do is build a simple prototype of your business app and test
> it on the databases you're considering.

Absolutely. TCP-? has absolutely nothing to do with the real world and
will provide you zero information related to your specific hardware,
your specific operating system, your specific configuration, your
specific application or anything else.
Signature

Daniel A. Morgan
http://www.psoug.org
damorgan@x.washington.edu
(replace x with u to respond)

 
Sign In
Join
My Latest Posts
My Monitored Threads
My Blog
My Photo Gallery
My Profile
My Homepage

Start New Thread
Enable EMail Alerts
Rate this Thread



©2009 Advenet LLC   Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.