Commit graph

269 commits

Author SHA1 Message Date
Kurt Jaeger
869f37c434 databases/cego: upgrade 2.45.8 -> 2.45.9
- Fix in CegoBTreeManager, the allowDuplicateNull flag was not
  treated any more. The duplicate handling has been moved from
  CegoBtreeNode to CegoBtreeManager

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-12-01 20:16:59 +00:00
Kurt Jaeger
9791df5e18 databases/cego: upgrade 2.45.6 -> 2.45.8
- Fix in CegoSelect::setVIewCond, a view condition id has to be
  calculated which is later used for getQueryId(). Otherwise, wrong
  query cache entries are used in case of views with outer conditions
- Added method CegoBTreeNode::verifyLeafFull for full btree
  verification in a sense, that each btree value is compared with the
  corresponding table data entry via datapointer reference
- Improvement in CegoAdmAction for input handling. Used the same
  methods for nextChar and friends as in CegoAction
- In CegoXMLSpace, changed access methods for mediator, primary and
  secondary in a way, that the default value ist the current hostname.
  In this case, no attribute values are set up. This reduces complexity
  and avoids to change the entries manually, if the hostname changes
  (do not edit the database xml without any deeper knowledge).

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-11-24 17:29:30 +00:00
Kurt Jaeger
3419f9eb05 devel/lfcbase: upgrade 1.14.0 -> 1.14.2
databases/cego: upgrade 2.45.5 -> 2.45.6

lfcbase:
- In configure.ac added check for darwin. This is required, since
  for File::flush implemention, darwin rather requires a fcntl call
  with option F_FULLFSYNC instead of fsync ( see OSX man page for
  fsync )

cego:
- Added command line option --fsync to enable physical disk synchronisation
  for logging and checkpointing. This options slows down database
  significantly but ensures consistent data in case of an operating
  system crash

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-08-18 17:22:44 +00:00
Kurt Jaeger
eda6267601 databases/cego: upgrade 2.45.1 -> 2.45.5
- Fix in CegoQuery::execute for INSERTBYSELECT_QUERY case.
  Since the selected tuples are clustered ( MAX_CLUSTERED_INSERT) we have
  to create a local copy for the corresponding field values.
  Otherwise, tuple information could be invalidated by relocated
  buffer pool pages
- Fix in CegoFieldValue::fastComp, the castTo method calls for t1
  and t2 have to be switched, since first ist has to be checked to
  cast to native btree datatype ( used in CegoBTreeCursor::traceLog,
  inRange and fullMatch )
  example:
  create table t1 ( a int, d datetime);
  create btree b1 on t1(b);
  select a from t1 where b = '12.07.2019'; -- should be casted
					   -- from string to datetime
- Code cleanup to avoid warnings with -Wswitch-enum
- In CegoClient, added input data check via File::hasData ( available
  with lfcbase 1.14.0 ). Now, pipe input is autodetected, so the
  command line argument "--pipe" has been removed

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-07-14 07:48:01 +00:00
Kurt Jaeger
b726fe6f4e databases/cego: upgrade 2.45.0 -> 2.45.1
- Treated alias insert queries with empty schema, e.g.
  insert into a1 values ( 1, 'XXX');
- Some patches added for alias management to allow alias defintions
  as a subset of the original table, e.g.
  create table t1 ( a int, b string(10), c string(30))
  create alias a1 on t1 ( a as ax, b as bx);
  This has required some fixes in CegoAliasObject::mapSchema and
  CegoQueryHelper::mapFLA

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-07-07 08:53:28 +00:00
Kurt Jaeger
4da64c0c27 databases/cego: upgrade 2.44.14 -> 2.45.0
- Added table alias feature to grammar definition. Table aliases
  allow alternate table name and attribute name definitions for a
  table ( create alias ... )
- Added classes CegoAliasObject and CegoAttrAlias for table alias handling
- Implemented base semantic actions for creating, listing and
  describe alias objects ( still no usage )
- In CegoDistManager::registerObjects, added registration for fkey,
  check, trigger and alias
- Added alias mapping for insert, update and delete queries (
  CegoQueryHelper::mapAliasPredicate still to implement )
- Basic alias mapping for select works, here's a sample SQL script
  drop if exists table t1;
  list alias;
  desc alias a1;
  drop if exists alias a1;
  create table t1 ( a int, b string(30));
  create alias a1 on t1 ( a as ax, b as bx );
  insert into a1 ( ax, bx ) values ( 1, 'XXX');
  insert into a1 ( ax, bx ) values ( 2, 'YYY');
  insert into a1 ( ax, bx ) values ( 3, 'ZZZ');
  select ax from a1;
- More work on table alias handling. Now works with more sophisticated
  select queries ( e.g. select ax from a1 aa where aa.ax = 1; ) For
  this, some fixes had to be done in CegoContentObject, since the the
  table alias attribute ( _tabAlias ) was not setup in constructor
  and other methods
- Added alias and trigger xml export and import feature ( trigger
  xport was still not implemented ) Fix in CegoDbThread::loadObjects
  for trigger reload, instead of triggerList.Next(), triggerList.First()
  was called, which result in an infinite loop in case of existing
  trigger objects
- Added trigger and alias object handling to CegoXPorter binary
  export and import

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-07-04 19:13:00 +00:00
Kurt Jaeger
4978cb9f3d databases/cego: upgrade 2.44.13 -> 2.44.14
- Some improved exception handling in CegoTableManager::checkIntegrity
  ( more detail information about violated object )
- Code cleanup CegoTableManager, drop/create/alter operations inside
  a transaction no more allowed

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-06-19 11:57:35 +00:00
Kurt Jaeger
c2c7c8a20d databases/cego: upgrade 2.44.12 -> 2.44.13
- Further recovery fix in CegoTableManager::insertDataTable In case
  of an insert exception ( e.g. duplicate pkey ), a checkpoint is
  forced now after deleteData to ensure file consistency
  In CegoObjectManager::insertPageData a second checkpoint is forced
  after data copy, if a previous checkpoint has occured. Otherwise
  this insert might be ignored during recovery because of lower LSN
- Fix in CegoBTreeManager::checkDuplicate, the check for uflag (
  returned CegoBTreeNode::valueExists ) to check for high value is
  not enough if, entries have been deleted from node.
  Instead, all subsequent pages have to be checked until a value higher is found
- Introduced CegoBufferPool::getCPCount() to return to current
  checkpoint count. This method is used by CegoTableManager,
  CegoObjectManager and CegoTransactionManager to decide, if a
  consitency checkpoint is required
- Version passed checkCrashRecovery with the following parameters
    NUMRUN=100
    DOTRANSACTION=-dotransaction
    ARANGE=10000
    AINTERVAL=500
    ACOUNT=30000
    PRIMARY=primary
    POOLSIZE=191
  All relevant checkpoint situations have been observed over all run

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-05-14 05:23:19 +00:00
Kurt Jaeger
90d277c9ca databases/cego: upgrade 2.44.11 -> 2.44.12
- Fix added in CegoTransactionManager::commitUpdate, btree must be
  inserted with insertBTreeWithCommit
- Fix added in CegoTransactionManager::getCrashAffectedTables,
  schema entry must be searched with Find(CegoField(Chain(),
  SYS_RB_TABLE))

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-05-11 07:44:38 +00:00
Kurt Jaeger
3da3c7a4f8 databases/cego: upgrade 2.44.10 -> 2.44.11
- Fix in CegoRecovery:::recoverCurrentTransactionLog, for LOGREC_INSERT
  and LOGREC_DELETE, the corresponding index have to be invalidated
  with CegoTableManager::invalidateIndexForTable. This logic was
  already implemented but removed in context of more sophisticated
  transaction handling ( patch 2.39.11 and around )
- Small fix in CegoObjectCursor constructor, changed _isEOC = false
  to _isEOC = ( pageId == 0 ). This causes getFirst to return false
  in case of truncated objects ( can occur for RBSEG objects )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-05-10 09:19:07 +00:00
Kurt Jaeger
5caa0e848b databases/cego: upgrade 2.44.9 -> 2.44.10
- Fix in CegoAction::readChain() to support "\r" escape character
  Fix in CegoBTreeCursor::getFirst, in case of pAttrCond = 0, getNext
  has to be called if current leaf page is empty, otherwise cursor
  trace is incomplete ( just used for CegoDistManager::verifyTable )
- Fix in CegoBTreeNode::getChildPage, parameter traceMin has been
  introduced, which is needed to trace btree with
  CegoBTreeManager::deleteBTree.
  Otherwise, it might happen that non-unique btree objects are not found

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-05-04 15:34:35 +00:00
Kurt Jaeger
f935e2c9b2 databases/cego: upgrade 2.44.8 -> 2.44.9
- Removed legacy method CegoAggregation::setInit/isInit
- Fix in CegoQueryHelper::aggregateTuple, since the field value
  reference for aggregation field value might be no more valid during
  the aggregation run, a local copy is created via
  CegoFieldValue::getLocalCopy.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-05-02 12:50:46 +00:00
Kurt Jaeger
de27c99c6f databases/cego: upgrade 2.44.7 -> 2.44.8
- Added method CegoClient::treateEscape to handle escacpe charaters
  in command strings for interactive and batch mode ( newline, carriage
  return und tab )
- Further optimization in CegoFunction::getReturnTypeLen, if the
  length argument in left, right substr function is a constant, this
  value is used for schema definition, otherwise the length of the
  source is used. Example:
    select left(a,3) from t1 => length 3 is used for schema
    select left(a,b) from t1 => definition of a is used for schema
  Further optimization done in CegoSelect and CegoAction for schema
  evaluation.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-04-28 08:35:46 +00:00
Kurt Jaeger
d8e996290e databases/cego: update 2.44.6 -> 2.44.7
- In CegoSelect::evalSelection, optimization provided in a way,
  that schema is not evaluated explizit anymore. Rather the previous
  analysed schema ( prepare method, _evalSchema ) is used. Since for
  dynamic field length, the resulting schema must be estiamated, this
  approach is ok.
- Fix added in CegoFunction::getReturnTypeLen, evalFieldValue for
  expression values could fail, since FLA ist still not set up. For
  this case, now the cont value RETVAL_LEN is returned as an estimation.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-04-26 07:35:54 +00:00
Kurt Jaeger
8bec5afaeb databases/cego: update 2.44.5 -> 2.44.6
- Added some code cleanup and additional checks ( check082 and check083 )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-04-23 11:56:46 +00:00
Kurt Jaeger
05773f4f5f databases/cego: update 2.44.4 -> 2.44.5
- Added fix in CegoAttrComp::setup, _posSetup variable was not setup
  correctly for case BTWN / VALUE2VALUE which might lead to invalid
  join array access.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-04-22 14:11:46 +00:00
Kurt Jaeger
a03d0cd817 databases/cego: update 2.44.3 -> 2.44.4
- Added fix in CegoExpr::evalField and CegoTerm::evalField to provide
  correct result type. This is required for fastserial protocol usage.
- Also added fix in CegoFieldValue::operators +-*/ to cast to the
  largest value

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-04-22 12:16:55 +00:00
Kurt Jaeger
5d36972ee2 databases/cego: update 2.44.1 -> 2.44.3
- Fix in CegoTableManager::deleteDataTable, before resolving external
  table references via evalExtTableReferences, the subquery must be
  prepared, to resolve local attributes first
- Optimization added in CegoBufferPool::bufferFix. If there is no
  available slot in the bufferpool, a checkpoint is forced for the
  corresponding tableset ( already implemented ). Now if still no
  available slot, we force checkpoint for all other online tableset
  of the database. This might be useful, if the bufferpool is heavily
  occupied by other tablesets with dirty pages.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2019-04-22 06:57:54 +00:00
Kurt Jaeger
65db7a8725 devel/lfcbase: update 1.11.9 -> 1.13.0
devel/lfcxml: update 1.2.6 -> 1.2.10
databases/cego: update 2.39.16 -> 2.44.1
databases/cegobridge: update 1.4.0 -> 1.5.0
databases/p5-DBD-cego: update 14.0 -> 1.5.0

- Warning: storage format has changed
  Export to xml format before upgrade and re-import after the upgrade
  See UPDATING
- recompile all applications linked to libcego
- Lots of changes, among them:
  o improved crash recovery
  o fixes to SQL expected behaviour
  o better CDATA handling
  o fixes primary key handling design issue
  o changes to serialisation for export/import, XML export/import is still
    possible

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
Changelog:	http://www.lemke-it.com/litexec?request=pubnews&user=&lang=en&numlog=1000
2019-04-21 13:31:25 +00:00
Sunpoet Po-Chuan Hsieh
40c9c7f7eb Update devel/readline to 8.0
- Bump PORTREVISION of dependent ports for shlib change

Changes:	https://tiswww.case.edu/php/chet/readline/CHANGES
PR:		236156
Exp-run by:	antoine
2019-04-09 14:04:49 +00:00
Kurt Jaeger
47e263b158 devel/lfcbase: update 1.11.8 -> 1.11.9
databases/cego: update 2.39.15 -> 2.39.16

lfcbase:
- Introduced new method File::flush to force synchronization of data to disk

cego:
- Fix in CegoObjectManager::insertPageData, new data entry is checked
  now for maximum available space in page. This is done if a new
  data page has to be allocated and the data entry still fits not
  into page
- Added File::flush method to CegoLogManager and CegoFileHandler
  to synchronize log data and datafile data to disk

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-04-24 05:22:57 +00:00
Kurt Jaeger
7632a3b891 databases/cego: update 2.39.14 -> 2.39.15
- Fix in dbcheck/expimpcheck, test plan was not set up correctly
  In CegoXPorter and CegoExpImpStream, row export information was
  added again to indicate overall row export for each table
- Fix added in CegoDbThread::serveRequest ( GETBLOB and GETCLOB case ) and
  CegoTableManager::getBlobData / getClobData chunkSize calculation. The
  existing calculation did not treat every boundary case.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-04-11 11:24:41 +00:00
Kurt Jaeger
a0321b3482 databases/cego: update 2.39.13 -> 2.39.14
- Fix in CegoXPorter::writeRow and CegoXPorter::readRow for binary
  export and import of tables containing lob null values. lob null
  values must be identified by colLen unsigned long long = 0 instead
  of integer = 0

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-04-09 17:56:15 +00:00
Kurt Jaeger
abd1113fb0 databases/cego: update 2.39.12 -> 2.39.13
- Introduced CegoTransactionManager::getCrashAffectedTables method.
  In case of a crash recovery, all transaction affected tables have
  to be analysed for index objects. Before finishing transactions,
  the index objects have to be invalidated ( since they might be
  corrupted ) and after completion of transactions they have to be
  recreated. This is done now in CegoTableManager::finishOpenTransaction
- Fixes in CegoLogManager, CegoRecoveryManager, CegoDistManager and
  CegoTableManager for LSN handling. Instead of saving the next LSN,
  now the current written LSN is recorded in CegoLogManager. This
  seems to be more natural, since a lot of methods set up the LSN to
  a value + 1. Also this fixes a mismatch between commited lsn and
  current lsn, which leads to a tableset recovery during startup in
  any case ( occured with version 2.39.9 )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-04-07 17:22:23 +00:00
Kurt Jaeger
5fd30ea130 databases/cego: update 2.39.11 -> 2.39.12
- Patch in CegoClient to catch format exceptions like
  "Invalid datetime string <0> for format <%d.%m.%Y %H:%M:%S>"
  This may happen, if on server side bad union selects are defined like
  create view v1 as
    select a as a, b as b from t1
    union all
    select a as a, 0 as b from t2;
  where b is a datetime data type. In this case, invalid formatted
  strings occur on the client side, which are catched now.
- Patch in CegoDatabaseManager::useObject to support lock
  delay values > 1 sec. The DBM_LOCKDELAY value in CegoDefs has now
  increased to 2500 msec. In some cases for heavy updates
  ( e.g. clob updates ) this might be useful to avoid ugly exclusive
  lock delay messages in database log file
- Fix in CegoTableManager::updateTuple. If the update fails ( this
  might happen, if another transaction actually updates the corresponding
  tuple ), any allocated lob values are freed now. Otherwise the
  data pages for the lob values were allocated with no more references.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-04-05 17:10:43 +00:00
Kurt Jaeger
73dedf9695 databases/cego: update 2.39.9 -> 2.39.11
- Improvements for log handling, the logIt method was moved from
  CegoTableManager to CegoBufferPool. This allows a more adequate
  locking of the logging actions. For this the tsLock array has been
  removed from CegoTableManager and lmLock array has been set up in
  CegoBufferPool. Since checkpoint writing occurs in CegoBufferPool
  ( which is also relevant for loging operations ), the logging method
  is now part of CegoBufferPool.
- The logAction method in CegoLogManager has also been improved in
  a way, that a log buffer is not allocated for each logging operation
  anymore. Instead, a logBuf array has been defined for all tablesets
  and the logBuf is reallocated, if the current logging record exceeds
  the log buffer.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-04-01 14:00:47 +00:00
Kurt Jaeger
b57cda5639 databases/cego: update 2.39.8 -> 2.39.9
- Added fixes for recovery procedure in CegoTableManager. Now the
  LSN is allocated at the beginning of critical operation to avoid
  double operations in case of a forced checkpoint. For this the
  CegoLogManager::nextLSN method has been introduced. Now it is no
  more ensured that the log is written with increasing LSN, so some
  logical parts of the recovery procedure in CegoRecoveryManager has
  been changed.
- In CegoBufferPool, the writeCheckPoint method still returned int
  value. This has been changed to unsigned long long

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-29 11:55:47 +00:00
Kurt Jaeger
ee269d6802 devel/lfcbase: 1.11.6 -> 1.11.7
databases/cego: 2.39.7 -> 2.39.8

lfcbase:
- Fix for memory leak in TreeT and AVLTreeT.
  The = operator implementation did not empty the tree before copy.
- Additional fix to this release : Added regfree call to Matcher
  destructor. Missing this call seems to cause a small memory leak

cego:
- Fix for memory leak in CegoPredDesc, pMatcher has not been cleaned up

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-18 10:57:01 +00:00
Kurt Jaeger
f8010281e0 databases/cego: update 2.39.5 -> 2.39.7
- Fix in CegoTableManager::deleteDataTable, pBlock has to be checked
  for null value, otherwise crash recovery might crash. ( bug came
  with 2.39.0 to check for pBlock->getTriggerValueList )
- Some clob related fixes in CegoQueryHelper::decodeNativeFVL /
  decodeFVL relevant for recovery handling
- Fix in CegoRecoveryManager::recoverCurrentTransactionLog for the
  INSERT case. For the blob/clob handling, the lobREf values have not
  been set up correctly. This might lead to problems for table recovery
  with more than one lob row ( e.g. table t1 ( a blob , b clob )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-10 11:45:01 +00:00
Kurt Jaeger
c85048adba databases/cego: update 2.39.4 -> 2.39.5
- Bug fix in CegoAction::reallocateStringBuf, in the memcpy call,
  just the previous stringBufLen has to be copied ( _stringBufLen -
  MAXSTRINGLEN ). This bug might lead to seg fault in case of large
  parser input ( e.g. clob strings )
- In CegoQuery for insert and insert-by-select case, allocated blob
  and clob data ( by CegoQueryHelper::prepareFieldValue ) is cleaned
  now if any exception occurs

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-06 18:26:49 +00:00
Kurt Jaeger
be6fb2b13f databases/cego: update 2.39.3 -> 2.39.4
- Small bug fix in CegoDistManager, which came up with version
  2.39.0. In method deleteLocalDataTable, the variable delCount was
  declared two times, which lead to a result of 0 tuples deleted in
  any case

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-05 20:34:13 +00:00
Kurt Jaeger
94ab853af5 databases/cego: update 2.39.2 -> 2.39.3
- Small improvement in CegoDbThreadPool. For a better db thread
  load value calculation, the request queue is no longer locked while
  waiting for incoming requests. Instead the QUEUEDELAY parameter has been
  increased to a default value of 200 msec to reduce db thread cpu
  load while idle. Now the db thread has a good chance to report
  idle time to the db thread pool.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-03 09:10:06 +00:00
Kurt Jaeger
a19dcac247 databases/cego: update 2.39.1 -> 2.39.2
databases/cegobridge: update 1.3.0 -> 1.4.0

cego:
- Fix in CegoTableManager::updateTuple, while setting up expression
  list, field list array must be setup BEFORE block ist set, since
  field list is needed by block setup ( in case of subqueries for
  prepare )

cegobridge:
- Adaptions for cego-2.39

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-03-01 12:29:31 +00:00
Kurt Jaeger
4ddc75fd13 databases/cego: update 2.38.20 -> 2.39.1
- Introduced table locking statements to set an explicit lock on a
  table ( e.g. for update synchronisation ). This feature replaces
  the "set update sync on/off" command
- Trigger implementation basically completed
- Fix in CegoQueryHelper::encodeFVL, for blob/clob values lists,
  the corresponding index variables ( blobidx/clobidx ) have not been
  increaed while encoding lob data. This might lead to invalid results
  and seg faults in case of multiple lobs values in one insert/update
  operation.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-02-28 18:53:10 +00:00
Kurt Jaeger
1dea0a5453 databases/cego: fix distinfo
Reported by:	pkg-fallout
2018-02-25 04:49:54 +00:00
Kurt Jaeger
44c4e1e059 databases/cego: 2.38.19 -> 2.38.20
- For heavy update operations on tables with btrees using embedding
  transactions, duplicate btree errors may occur. This is caused
  by not checking corresponding tuple states. To solve this problem,
  the following fixes have been done :
  o Fix in CegoTableManager::checkBTreeIntegrity : The tuple state for
    found entries has to be checked if state = COMMITTED
  o Fix in CegoBTreeNode:checkForAffected ( was checkForDeleted before ) :
    The tuple state has already checked for state
    INSERTED if tid != dataTid

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-02-24 19:09:17 +00:00
Kurt Jaeger
c6e8c07d58 databases/cego: update 2.38.18 -> 2.38.19
- Fix in dbcheck/check065.sql for union sql in view.There must be
  set up aliases for attributes in selection now

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-02-13 20:25:50 +00:00
Kurt Jaeger
473c9e5bfe databases/cego: update 2.38.16 -> 2.38.18
- Fix in CegoTableManager::createForeignKey, for empty tables,
  referenced attributes names have not been checked. This might lead
  to invalid key objects.
- Fix in CegoSelect::prepare, expression alias in select list are
  checked now for union selects. Alias definition in select expression
  list should be identical for all select statements in union

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2018-02-02 18:04:41 +00:00
Kurt Jaeger
4c16423c3c databases/cego: update 2.38.14 -> 2.38.16
- Increased NETMNG_QUEUE_DELAY to 1000000 ( 1 ms ) to minimize CPU load
- Introduced QUEUEDELAY ( in usec ) config parameter to adjust queue
  delay in database xml file. This allows to throttle down database
  response time for incoming connection requests and minimize CPU
  load
- Added dbcheck/check072.sql. This implements the calculation of
  fibonacci numbers using stored procedures as a demonstration for
  massive recursive procedure calls
- Optimization for procedure load in CegoFunction::evalFieldValue
  ( case USERDEFINED ), procedure is just loaded as a dedicated
  instance ( via loadProcedure method ), if pMasterBlock is set. This
  avoids ( expensive ) dedicated load, if the procedure is still not
  in use by the corresponding thread. So just for recursive procedure
  calls, the dedicated load happens.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-12-31 19:28:20 +00:00
Kurt Jaeger
c3a3c592b8 devel/lfcbase: update 1.11.4 -> 1.11.5
databases/cego: update 2.38.12 -> 2.38.14

lfcbase:
- Stability patch for strptime implementation ( MinGW only )

cego:
- Fixed memory lead in CegoDistManager destructor ( _pPA was not deleted )
- Further optimization done in CegoBTreeCursor, introduced methods
  traceLow and inRange to treat btree comparison in a more efficient way
- Fix in CegoAttrCond::getIndexCond, like and no like comparisons
  must be filtered out for new btree cursor tracing logic

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-12-20 19:59:04 +00:00
Kurt Jaeger
acad63c263 databases/cego: update 2.38.10 -> 2.38.12
- Small optimization in CegoAttrCond::checkIndex, removed primary
  flag, since this is done now by attribute ordering. This leads
  to full index trace match instead of trace with index support and
  so, additional unnecessary predicate evaluation is avoided.
- More rework for btree evaluation in CegoBTreeCursor
- Optimization in CegoBTreeCursor::getNext. Instead of calling
  getNext in a recursive way, this is now done in a iterative way.
  This might avoid heavy stacking in case of special query constraints
  ( e..g multi dimensional btrees and range conditions like a > 400
  and b betweeen 'AAA' and 'DDD' )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-12-14 16:56:12 +00:00
Kurt Jaeger
133458ad7f devel/lfcbase: update 1.11.3 -> 1.11.4
databases/cego: update 2.38.9 -> 2.38.10

lfcbase:
- Fixes in TreeT class, changed methods First, Next, isEmpty and
  compare operators to const

cego:
- Fix in CegoDistManager, we have to use a dedicated parser for
  loadView and loadProc methods. Otherwise compilation may fail in
  case of nested objects ( e.g. a view which references another view
  object)
- Fix in CegoBTreeCursor, CegoAttrCond and CegoAttrComp, for
  conflicting cursor conditions ( e.g. a = 4 and a < 1 ), the cursor
  evaluation failed, since just the primary condition was treated.
- For CegoBTreeCursor, the method fullMatch has been introduced,
  to make an final evalution in case of multi conditions.
- Also introduced: a ordering for CegoAttrComp set in
  CegoAttrCond to treat more constraint conditions at the beginning
  ( EQUAL before LESS_THAN before NOT_EQUAL and so on )
- Changed CegoAttrCond compSet from SetT to TreeT.
  This is required, since we need the ordering in the set.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-12-10 20:36:28 +00:00
Kurt Jaeger
fa8acb3c2c databases/cego: update 2.38.7 -> 2.38.9
- Introduction of new functions ascii ( get ascii character for
  numeric value ) , ldiv and lmod ( div and mod operation for long
  values )
- Modification in CegoFunction::evalFieldValue. To allow recursive
  calls of user defined functions and procedures, dedicated procedure
  instances are created for each call. This is done by parsing the
  procedure text via CegoAction

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-12-09 10:52:32 +00:00
Kurt Jaeger
d21a9cbd29 devel/lfcbase: update 1.11.2 -> 1.11.3
databases/cego: update 2.38.6 -> 2.38.7

lfcbase:
- Improvements made for dedicated strptime implementation. The
  function did not return null in case of unparsable date values.
  This code is just used for MinGW compiles since there is no
  implementation in the Standard C library available.

cego:
- Fix in CegoXPorter::readTableObject, the defintion for MAXROW BUF
  still was defined locally and rowLen was noch checked.
- Optimization in CegoFieldValue::decode, memory was allocated via
  malloc, rather _staticBuf should be used for performance reasons.
  _isLocalCopy was not set to true

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-12-02 10:43:31 +00:00
Kurt Jaeger
0400e7971d devel/lfcbase: update 1.11.1 -> 1.11.2
databases/cego: update 2.38.5 -> 2.38.6

lfcbase:
- More detailed exception messages for BigDecimal and BigInteger

cego:
- Fix in CegoFunction::getId and CegoSelect::getQueryId : with
  enabled query cache, the following select is cached
    select nextcount(mycount);
- Since nextcount is a modifying operation, this is not a good idea.
  To avoid caching, CegoFunction now throws an Exception if
  nextcount / setcount function calls are detected during getQueryId.
  For these cases, the query id ignored for caching

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-11-30 20:09:16 +00:00
Kurt Jaeger
94f035c7c0 databases/cego: update 2.38.3 -> 2.38.5
- Fix in CegoBTreeValue::valueFromSchema, introduced method
  getReservedLength to return fixed value length for type fixed and
  decimal. Since for decimal and fixed type just the dimension is
  stored in CegoField::getLength, we must define a reserved area
  for those types. This is done now with constant definition
  RESERVED_BTREE_FLOATLEN in CegoDefs.h
- Improved ordersize calculation in CegoOrderSpace:insertTuple. Now
  the following formula is used :
    int s = sizeof(fv);
    if ( fv.getLength() > STATICFIELDBUF )
      s += fv.getLength();
    orderEntryLen += s;
  The catches the base memory usage for the instance but also the
  dynamic allocated part

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-11-25 12:54:48 +00:00
Kurt Jaeger
d4cb82ae6f databases/cego: update 2.38.1 -> 2.38.3
- Fix in CegoXMLSpace::setTSSortAreaSize, changed type from int to
  unsigned long long, otherwise overflow may occur for large sort
  area size configurations
- Performance optimization done in CegoOrderSpace. Instead of storing
  the CegoField list for the result tuple in CegoOrderNode, just the
  values are stored there. The order cursor now gets the schema with
  the constructor and build the CegoField List in the getFirst /
  getNext methods. This seems a huge amount of heap space, which is
  dynamically allocated during the sorting procedure ( sortareasize
  parameter ).
  Especially for large ordering result sets this saves significantly
  memory and improves performance.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-11-22 18:46:12 +00:00
Kurt Jaeger
aac9300cfd databases/cego: update 2.38.0 -> 2.38.1
- Fix in CegoPredDesc::decode, loop variable i for IN/NOTIN case
  was not initialized
- Fix in CegoAction::execCheckCreate, check contraints are checked
  for contained subselects. subselects are ( still ) not supported
  since the CegoCheckOject::decode method can not provide a valid
  tablemanager instance ( it is called from CegoObjectManager )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-11-19 09:33:10 +00:00
Kurt Jaeger
a90cb2865a databases/cego: update 2.37.3 -> 2.38.0
databases/cegobridge: update 1.2.1 -> 1.3.0

cego:
- Fix in CegoSelect::clone, pUnionSelect was not cloned, which might
  lead to seg faults
- Introduced predicate clause for select .. in ( expr, expr, ... ),
  e.g. select * from t1 where a in ( 1, 2, 3 ); This was still not
  implemented but is part of standard SQL.

cegobridge:
- Adaptions made for modified cego-2.38.0 API with extended
  CegoDatabaseFormatter::formatPred method ( exprList was added for
  new introduced select in ( expr list ) predicate )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-11-18 08:34:07 +00:00
Kurt Jaeger
1ba43953c4 databases/cego: update 2.37.1 -> 2.37.3
- Fix in CegoClient, the new comment logic by using Tokenizer does
  not work ( '-' characters are detected as comment tokens ). Code
  replaced by using posStr chain function
- Adaption in CegoMain to also parse comment lines in a more
  sophisticated way ( same as in CegoMain ), just relevant for server
  batch mode
- Optimization in CegoDistCuror::joinSetup, the join predicate is
  now analysed in a way, that a condition list is created ( via makeCNF
  and createCondition methods in CegoQueryHelper ). The condition
  list then is analysed to achieve a better cursor condition which
  results in improved index usage

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-11-15 12:32:34 +00:00