Commit graph

202 commits

Author SHA1 Message Date
Kurt Jaeger
731c58726d databases/cego: update 2.33.19 -> 2.33.20
Fix in CegoDistCursor to support advanced left and right outer
join queries of the form

SELECT tx.a AS xa, ty.a AS ya FROM t1 tx
LEFT OUTER JOIN t2 ty ON tx.a = ty.a + 1;

For this, the evaluation of the predicate has to be done in a
different way to get complete row set

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-07-22 08:34:58 +00:00
Kurt Jaeger
2dbcf22671 databases/cego: update 2.33.18 -> 2.33.19
- Fix in CegoOrderSpace::insertTuple, for the localTuple variable,
  also a dedicated copy has to be allocated, otherwise it may happen
  that invalid tuple references ( caused be page relocation ) lead
  to invalid order results
- Added performance optimization to CegoTableManager::updateTuple.
  The already evaluated index, key and checklist are also provided
  to checkIntegrity method now ( instead of retrieving the lists again).
  The improves performance for updates with many tuples significantly

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-07-16 13:47:20 +00:00
Kurt Jaeger
2567ba54ea databases/cego: update 2.33.16 -> 2.33.18
- Method cleanup in CegoSelect.cc, also some irrelevant case is
  treated for grouping clauses in combination with distinct operator
- Added tablemanager parameter to CegoProcWhileStmt to catch query
  abort. In case of infinite while loops, this enables the db admin
  to abort procedure execution
- Optimization for CegoFunction::SETCOUNT procedure implementation
  added. Now this is an atomic operation, instead of calling
  getCounterValue.
- For this, also the CegoXMLSpace::setCounterValue method has been
  changed to return the current counter value return the current
  counter value

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-07-14 06:22:06 +00:00
Kurt Jaeger
5bf9592efc databases/cego: update 2.33.14 -> 2.33.16
- Completion for admin help backup section, some commands were still missing
  Improvements for procedure indent formatting. All sugar, nothing functional
- Fix in CegoAction::execute, missing break added after calling execListView
- Fix in CegoQueryHelper::evalPredicate. In case of subselects, the
  parent join buf also has to reset after performing the subselect,
  otherwise invalid pointer references are still active for the next
  caller
- Seg faults have been experienced for delete with double nested
  subselect conditions ( see check055 )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-06-29 05:38:13 +00:00
Sunpoet Po-Chuan Hsieh
cb037d3c98 Update devel/readline to 7.0 patch 3
- Bump PORTREVISION for shlib change

Changes:	https://cnswww.cns.cwru.edu/php/chet/readline/CHANGES
		https://lists.gnu.org/archive/html/bug-bash/2016-09/msg00107.html
		https://lists.gnu.org/archive/html/bug-readline/2017-01/msg00002.html
Differential Revision:	https://reviews.freebsd.org/D11172
PR:		219947
Exp-run by:	antoine
2017-06-27 13:46:53 +00:00
Kurt Jaeger
dc3e3a749b databases/cego: 2.33.12 -> 2.33.14
- Design modification in CegoAction for semantic action ( execXXX methods )
  An analysed statement is now just executed after complete succesful
  parsing of the given input. This avoid protocol effects for queries
  like "select * from t1;;" where the query is executed but the
  second semicolon is detected as an parse error which also is sent
  to the client.
  For this the new method CegoAction::execute has introduced which
  is ( explicitly ) called after successful CegoAction::parse
- Fix for distinct handling in CegoAggreation
  Fix for alias handling regarding view creates. Alias definitions
  are mandatory now for aggregated attribute definitions, e.g.
  create view v1 as select count(*) from t1;
  => returns now
  ERROR: Missing alias reference for view create
  and must be written as
  create view v1 as select count(*) as c from t1;

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-06-03 18:48:09 +00:00
Kurt Jaeger
73e654a6f2 databases/cego: update 2.33.11 -> 2.33.12
- Fix in CegoAttrComp::reset, case VALUE2VALUE still was not treated,
  which lead to wrong index handling for between clauses with native values

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-05-27 07:39:21 +00:00
Kurt Jaeger
679085543a databases/cego: update 2.33.9 -> 2.33.11
- Fix in CegoObjectManager::createBTreeObject to avoid some duplicate btree
  entries
- Added space character in CegoSelect::toChain after distinct keyword
  to avoid certain errors
- Fix in CegoAttrComp::operator== The values should NOT be compared,
  since they are set up by the calling CegoAttrCond::update method
  Otherwise, the error "Cannot set up diff for attribute condition"
  occurs.
  basecheck54 added to test for the this problem
- Fix in CegoQueryHelper::evalAttrCond, comparison modulation was
  missing for one case whihc leads to wrong query results for comparisons
  like 3 < a ( constant left )
- Optimization added for between clause, indexes were just used for
  constant values in between clause ( eg. a between 10 and 20 )
  This has been expanded, that also indexes are used, if attribute
  references are contained ( eg. a between t2.x and t3.y )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-05-25 20:03:54 +00:00
Kurt Jaeger
b6a95622bb databases/cego: update 2.33.8 -> 2.33.9
- in CegoTableManager::getClobData added termination character to
  ensure clob values are terminated with 0 character
- Small fixes for fixed value handling
- Small fixes for quote escape handling in cgclt batch mode
- In CegoAction::selectionList1 added alias check for non unique
  alias definitions
- Stored Procedure formatting improvements regarding indent handling

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-05-07 11:50:49 +00:00
Kurt Jaeger
9bdb0939ef databases/cego: update 2.33.6 -> 2.33.8
- Fix in CegoSelect::buildJoinConditions, the _attrPred array has
  to be set up. Otherwise it may occur, that the predicate is not
  evaluated, if it could not been evaluated by the table curser
  condition.
- Furthermore, a setup method has been introduced for CegoAttrCond
  to evalute joinBuf and parentJoinBuf ( if both references occur in
  a condition this is needed )
- Optimization in CegoCheckpoint::checkpointReached, if interval
  was reduced, we set up the new interval
- Fix in CegoTableManager::removeAllComp, first we have to remove
  from the list, the we can free the memory. On Linux system with
  g++, the previous sequence might lead to memory faults
- Fix in CegoRecoveryManager::recoverTableSet, after regDataFiles,
  als registerObjects method must be called, otherwise recovery could
  fail in case of table view recoveries
- Optimization in CegoDistManager::stopDistTableSet, the new
  introduced method CegoDatabaseManager::removeAllObjects is called,
  the ensure object cache cleaning
- Added prompt command line option to cgadm to set up specific prompt value
- Adding formating improvements to CegoAdminHandler for show logmng
  and show backupmng commands

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-04-22 15:29:38 +00:00
Martin Wilke
0a6f794f91 - Fix shebangs 2017-04-22 12:45:43 +00:00
Kurt Jaeger
866ce00bb8 devel/lfcbase: update 1.9.3 -> 1.9.6
databases/cego: update 2.33.5 -> 2.33.6

lfcbase:
- Small correction in OutStream, include required by FreeBSD
  ( for definition of WEXISTATUS )
- Added method getErrorCode to OutStream class
- Cleanup of OutStream implementation ( removed some includes,
  removed ifdef for MINGW)

cego:
- Small improvements for utility scripts cgmkdb, logManager and backupManager

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-04-14 14:30:12 +00:00
Kurt Jaeger
a41d430c77 databases/cego: update 2.33.4 -> 2.33.5
- Fix in CegoSelect and friends for query cleanup. The cleanUp
  method did not cleanup all field value references which might lead
  to invalid memory access in case of repeated view calls ( Variable
  pParentJoinBuf ).
  Corresponding cleanUp method have been introduced or CegoExpr,
  CegoTerm, CegoFactor and friends.
- Check052 has been introduced to verify the previous described behaviour

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-04-07 19:56:49 +00:00
Kurt Jaeger
f21276df5e databases/cego: update 2.33.3 -> 2.33.4
- Fix in CegoTableManager::insertDataTable, the newRBEntry method
  call for the transactions manager also must be catched by the
  exception. Otherwise, the index might be corrupted if any exception
  occur ( e.g. out of temp space )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-04-02 08:01:52 +00:00
Kurt Jaeger
57d469ac5b devel/lfcbase: update 1.9.2 -> 1.9.3
databases/cego: update 2.33.1 -> 2.33.3

lfcbase:
- Small fixes for Monitor and Pager class, adding missing ifdef for
  curses option in Pager class, replaced CGNOCURSES with LFCNOCURSES

cego:
- Fix in CegoRecoveryManager::recoverTableSet, before calling
  transactionRecovery, we have to set flag setIgnoreInvalid to true.
  During transaction recovery phase, we must ignore invalid btrees/index
  objects since these objects could be invalidated but Log data
  integrity and consistency is ensured
- Added implizit tableset btree and index correction to recovery procedure
  ( CegoRecoveryManager::recoverTableSet )
- Small syntax for cgadm from "backup TS" to "backup tableset TS"
  ( conform to other tableset commands )
- Fix in CegoTableManager::deleteDataTableEntryAtomic /
  updateDataTableSynced / beginTransaction / commitTransaction /
  rollbackTransaction to avoid log entries for forced transactions
  ( introduction of doLog flag ).
- Fix in CegoTableManager:deleteDataTable to avoid object synchronisation
  during recovery phase ( introduction of isSynced flag ), since
  during recovery phase, still no objects are registered and there is
  no need for synchronization
- Added further admin console messages for recovery procedure.
  This enables the database admin to follow the recovery procedure on
  admin console level

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-04-01 08:18:38 +00:00
Kurt Jaeger
517e5407fb databases/cego: update 2.33.0 -> 2.33.1
- Some cosmetic changes for backup manager handlng
  ( change nameing from archmng to backupmng )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-03-26 09:02:55 +00:00
Kurt Jaeger
20c659a698 devel/lfcbase: update 1.9.1 -> 1.9.2
databases/cego: update 2.32.14 -> 2.33.0

lfcbase:
- Added CommandExecuter::executeStream method to catch stdout for
  any forked process
- Added class OutStream to catch stdout from forked programs via popen

cego:
- Added database verify006 to check multidimensional btrees also in
  combination of null value handling.
- Fix in CegoObjectCursor::getNext, double method call for unlockData removed
- Small grammar correction to treat distinct flag for select-star statement
- Fix in CegoBTreeCursor::compValue, null values have not been handled
  correctly. For string values, string termination was not clean, which
  also might lead to wrong cursor results
- Introduced archive manager, which can be triggered, to perform
  an online backup. For now, online backups have to be triggered
  externally.
  The achive manager should make backup / restore handling more convenient
- Update to version 2.33.0 since the backup feature changes the product
  specification.
- Integration of newly introduced lfcbase OutStream class to catch output
  from backup manager. This allows to indicate a more detailed
  output from backup manager on the admin console.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-03-25 18:06:25 +00:00
Kurt Jaeger
9418b27bc1 devel/lfcbase: update 1.9.0 -> 1.9.1
databases/cego: update 2.32.11 -> 2.32.14

lfcbase:
- Small fix for Monitor::showFormBox, in case of menu elements,
  delete key is disabled

cego:
- Correstion for distinct clause. With the current grammar implemention,
  queries with nested selects and using the distinct operator might
  fail. Cego.def grammar and CegoAction implementation has been changed
  in way, that distinct option is just allowed at the beginning ( e.g.
  select distinct count(a) from t1 and NOT select count(distinct a) from t1 )
  This should simplify usage, since by using the distinct clause,
  distinct tuples are retrieved either for plain queries or for
  aggregation
  Confusing sample not allowed anymore : select count(distinct a),
  count(distinct b) from t1 ... now select distinct count(a), count(b)
  from t1 )
- Fix in CegoBTreeValue::valueFromSchema added.
  In case of multidimension btree objects, the insert of new values
  might fail, if string bases attributes occur at the beginning
- Fix in CegoDistManager::registerObjects, registration of btree
  objects was still missing. This might lead to wrong results for
  drop if exists btree statements
- Added check to CegoXMLSpace::addArchLog to verify, that directory
  for new archive location really exists
- Added archive log management to curses based CegoAdmMon administration
  console

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-03-11 19:33:22 +00:00
Kurt Jaeger
655eea77c3 devel/lfcbase: update 1.8.12 -> 1.9.0
databases/cego: update 2.32.8 -> 2.32.11
databases/cegobridge: update 1.1.2 -> 1.1.3, fix build with clang 4.0

devel/lfcbase:
- Added Monitor class for ncurses based GUI utility implementation.
  This class provides GUI layout and event handling to simply ncurses
  based GUI tool implementaton.
- Added class Pager for curses based pager implementation

databases/cego:
- Include stdlib.h added in CegoNet ( still missing forLinux compiles )
- Added CegoFieldValue::getDim method required for arithmetic operations
  on fixed values
- Fix in CegoTableManager::getPoolInfo, readdelay and writedelay was
  not calculated correctly
- Fix in CegoDistManager::stopDistTableSet, removing of btree objects
  from database object dictionary was still missing
- In CegoTableManager::dropTableSet now also counter objects are
  dropped ( stored in the database xml file ).
- Added some sizing optimizations for CegoAdmMon forms
- Fix in CegoRecoveryManager::recoverCurrentTransactionLog, added
  the force option to addCounter method, since counters already could
  be synched to xml ( not completely transaction save )
- Online index build up tested and verified. First tests with heavy
  insert operations ( using cgblow ) during index build went succesful.
- Improvements for CegoAdmMon role permission handling, added remove
  permission option
- Preparation of CegoObjectCursor and CegoTableManager to support
  online index rebuild with write access to the table.
  For this, concurrent insert operations have to be performed with
  append =true. The ObjectCursor locks the last page until the index
  rebuild is finished ( method setLastPageSync )
  In this way, the index can be build up in parallel, while further
  tuples could be appended to the table. ( just supported for btree
  index objects )

PR:		216621
Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
Reported by:	jbeich
2017-03-05 11:08:50 +00:00
Kurt Jaeger
cf3c00eb2e devel/lfcebase: update 1.8.11 -> 1.8.12
databases/cego: update 2.32.7 -> 2.32.8

lfcbase:
- Changed methods for class Sleeper to static. Added Sleeper class
  test to test suite
- Added include file limits.h in Chain.cc. For Linux compiles, this
  include is required ( definition of INT_MAX and INT_MIN )

cego:
- Small improvements for CegoAdmMon curses based admin console

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-01-29 09:36:36 +00:00
Kurt Jaeger
c8e1939b7a databases/cego: update 2.32.6 -> 2.32.7
- Fix in CegoFileHandler::releaseFiles.
  _tabSetId and _isReg vars have to be set to zero/false in any case.
  Otherwise, it might happen that old entries are still visible and in case
  of a tableset recreation obsolete file handle information is provided
- Method CegoTransactionManager::hasOpenTransaction added to check for open
  transaction for a spedific table. This method is called now before a table
  can be dropped to ensure there are no open transaction for this table.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-01-21 15:10:16 +00:00
Dmitry Marakasov
2da01c9df6 - Fix missed shebang
- Add dependency on bash, the port installs bash scripts
- Switch to USES=localbase
- Switch to new test framework

Approved by:	portmgr blanket
2017-01-16 12:54:58 +00:00
Kurt Jaeger
8cd9206484 databases/cego: update 2.32.5 -> 2.32.6
- Small performance improvement in CegoBufferPool::bufferFix
  Instead of copying the buffer head data to a local variable via
  memcpy, a pointer variable is used to access the data directly
  Performance improvement: just a few percent ...

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-01-04 19:37:20 +00:00
Kurt Jaeger
38ee25145f databases/cego: update 2.32.4 -> 2.32.5
- Added another performance patch to CegoBTreeCursor.
  The method compValue has been redesigned in a way, that comparison
  is prepared at cursor creation time and so could be executed in
  a optimized and faster way
  This speeds up queries with joined tables, where the joined table
  is traced many times ( e.g. select count(*) from t1, t2 where
  t1.a = t2.a )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2017-01-01 15:43:37 +00:00
Kurt Jaeger
81b217e552 databases/cego: update 2.32.3 -> 2.32.4
- Fixes and improvements for table export added
  In CegoXPorter::xmlExportable, the pOutStream pointer was deleted,
  which lead to a core dump ( pointer is already deleted by Element )
  Row counter handling and messages have been improved
- Change back to memove call in CegoBTreeNode:shiftEntries. Copying manually
  and bytewise decreased performance about two times for building
  up btree objects. This has been observed on native POSIX ( FreeBSD 11 )
  but also on MSYS64 compiles
- Improvements for CegoBTreeCursor. With the new introduced methods
  CegoBTreeNode::getMedPage and CegoBTreeNode::rightValue, the search
  for the appropriate subnode can be made with logarithmic efforts
  instead of linear search. To validate this improvement, the following
  query has been setup for a random filled table t1
  select * from t1 ta where exists ( select * from t1 tb where tb.b = ta.b );
  Execution time with the improved btree cursor was two times faster than with
  old implementation.
- More performance improvements made for btree creation
  changed linear search efforts in CegoBTreeNode::getChildPage to logarithmic
  search efforts ( introduced lb /rb variable )
- Change in CegoBTreeManager::allocPage. Since for cache based creation,
  just a pageId must be allocated, the low level method
  CegoFileHandler::allocatePage is used.This avoids an unnessary
  bufferFix call for the new page
- Introduced appendFid variable for CegoFileHandler class. In case of
  many managed datafiles, the last file with avaiable pages is used
  for the allocatePage method.
- Performance comparison to MariaDB indicates now a better scaling
  from 2 million rows and up ( by using cego btree cache )
- Improvement modifications for btree implementation increased build
  up speed for just about 3 percent. It seems, the most time is used
  by calling shiftEntries method, where memory is moved via memmove.
  I observed, that 8k page size ( instead of 16k ) brought up some
  performance improvement for btree creation of about 100% ( for
  type string(60) with random values )
- More performance improvements in CegoBTreeManager and CegoBTreeNode,
  overall impact still has to be analysed
- Fix in CegoTableManager added for alter table modify column,
  columns with existing btree or key objects can not be modified
  anymore
- Further improvement approach in CegoBTreeManager to increase btree
  creation performance. BufferPage handles have been changed from
  native variables to pointer handles. This should reduce page access
  efforts in case of enabled btree cache

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-12-31 18:14:09 +00:00
Kurt Jaeger
5877d4c4c8 databases/cego: update 2.32.2 -> 2.32.3
- Fix in CegoAction::insertStore and CegoAction::insertValueSpecStore;
  for value array inserts via network, the ack for the protocol was
  no satisfied ( e.g. insert into t1 values ( 1, 'XXX'),(2,'YYY'),...)
  which leads to a hanging database client. Since class CegoQuey
  was already prepared for bulk inserts, this was a simple fix,
  just calling execQuery via insertStore parser method just one time.
- Code cleanup in CegoBTReeManager and CegoBTreeNode, use of static
  method CegoDataPointer::getEncodingLength, (define of DPENCODINGLENGTH)
- Fix in CegoFileHandler::CleanDataFile,pageId was not calculated
  correctly ( missing offset )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-12-24 10:03:01 +00:00
Kurt Jaeger
68b530562b databases/cego: update 2.32.1 -> 2.32.2
- Fix in CegoTranactionManager, replaced LONG_TYPE with PAGEID_TYPE,
  since this is the correct type for page entries. This was detected
  on MinGW64 compiles (seg fault occured), since the type size differs
  on this platform.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-12-22 06:24:48 +00:00
Kurt Jaeger
a063e6b633 databases/cego: update 2.32.0 -> 2.32.1
- Fixes for CegoBTreeManager::deleteBTree ( changed int type to
  PageIdType for page vars )
  and CegoBTreeManager::insertBTree ( propValue was not setup correctly
  for root node propagation in some cases, which might lead to corrupt
  btree structure )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-12-18 16:57:51 +00:00
Kurt Jaeger
85c8757926 devel/lfcbase: update 1.8.10 -> 1.8.11
lfcbase:
- Added range check to Chain::toInteger method to catch overflow exception

cego:
- This version brings a complete redesign of low level page handling.
  Instead of page references identified by fileId and pageid, a
  database unique pageid is used now
  This results in a complete reimplemtation of several low level
  classes like CegoFileHandler, CegoBufferPool, Blob handling, etc.
  Since pages are references by a single ( 64 bit ) id now, I expect
  an increased performance behaviour over all database operations.
  Most code modifications are done, code complies and basic
  functionally works ( create tableset, create table, insert table )
- First performance analysis indicates a speedup of about 10% for
  btree creation, so significant speedup for full table scans.
- All base checks passed, but there is still a page allocation leak
  for table drops
- Functional tests with SysMT successful completed

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-12-16 18:24:51 +00:00
Kurt Jaeger
0c5aea664b databases/cego: update 2.31.6 -> 2.31.7
- Fix in CegoFieldValue for fixed value handling.
  In case of fixed value aggregations, the specified fixed dimension
  should be kept. This has been done be analysing the value dimension
  in the CegoFieldValue:add/sub/mu/div methods.
  In CegoQueryHelper::prepareFieldValue, fixed values are checked now
  for right dimension

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-12-04 10:54:06 +00:00
Mathieu Arnold
8b4093cba5 Do not use post-stage. Use post-install instead.
The only reason to use post-stage is because the port needs to do
"things" at a later time, like some plist manipulation.
While there, fold post-install in do-install targets when they are
defined.

PR:		214780
Submitted by:	mat
Exp-run by:	antoine
Sponsored by:	Absolight
2016-12-02 11:58:21 +00:00
Kurt Jaeger
09b9608043 databases/cego: 2.31.5 -> 2.31.6
- Fix in CegoSelect::getQueyId added, for the ordering clause asc
  and desc ordering attributes were missing. This might lead to wrong
  ordering results if query caching is used

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-11-26 10:24:06 +00:00
Kurt Jaeger
c0b1ac34df databases/cego: update 2.31.4 -> 2.31.5
- Changed CegoQueryHelper methods to static
- Fix for CegoBTreeManager and friends regarding small string values
  ( string(1) )
- Please note, that this fix invalidates btree format.
  Btrees have to be recreated after this fix, databases need to
  be exported and imported.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-11-21 06:41:32 +00:00
Kurt Jaeger
218d2ed05f databases/cego: update 2.31.3 -> 2.31.4
- Fix some leaks in CegoXPorter regarding file handles and memory
  allocation ( improved exception handling )

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-11-19 08:26:19 +00:00
Kurt Jaeger
270c3c0d4c databases/cego: update 2.31.2 -> 2.31.3
- Fixed a file handle leak for datafiles and logfiles ( CegoFileHandler,
  CegoTableManager and CegoLogManager ) After tableset creation (
  or start and stop ), file handles have not cleaned up properly.
  This lead to file remove problems in case of a tableset drop.
  This effect was detected by building and testing the MinGW64 port

Submitted by:	lemke@lemke-it.com
2016-11-16 08:44:12 +00:00
Kurt Jaeger
383879c7d3 databases/cego: update 2.31.1 -> 2.31.2
- Fix in CegoClient for escape character handling in batch mode
- Fix in CegoClient for dumpfile generation. Default values handling corrected
- Join optimizer fix in CegoSelect, CegoAttrCond and CegoBtreeCursor.
  join attributes are checked now in a more sophisticed way, which
  leads to improved execution performace for advanced joins

PR:		Bjoern Lemke <lemke@lemke-it.com>
2016-11-13 14:35:36 +00:00
Kurt Jaeger
8e291c3b65 databases/cego: update 2.31.0 -> 2.31.1
- Fix in CegoBTreeManager::insertBTree, in case of a duplicate
  exception, a bufferpool leak occured ( buffer is not unfixed ).
2016-11-10 20:19:50 +00:00
Kurt Jaeger
3ccf426272 databases/cego: 2.30.26 -> 2.31.0
- Added database flag DUPLICATENULL to allow duplicate null values
  for unique btree objects

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-09-10 12:46:48 +00:00
Kurt Jaeger
88a9fa936f databases/cego: 2.30.24 -> 2.30.26
- Fix in CegoFunction::evalFieldValue, for functions date2str,
  date2int, int2date, type casting to appropriate type has been added.
  Without the cast, the functions might return wrong results
- Adaptions for CegoBlowTab to use CegoNet API
- Completion for blob methods in CegoNet
- Improved flow control in CegoClient ( based on ncurses )
- Optimization in CegoClient, just high level CegoNet API methods
  are used now for client implementation. Missing methods have been
  added to CegoNet API

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-08-21 19:03:45 +00:00
Kurt Jaeger
bd783eb206 databases/cego: 2.30.23 -> 2.30.24
- Fix in CegoNet::connect, the global vars __dateTimeFormat,
  __currencySymbol and __decimalPoint are set up now to appropriate
  defaults

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-08-11 18:07:17 +00:00
Kurt Jaeger
96fbe512c4 devel/lfcbase: 1.8.9 -> 1.8.10
databases/cego: 2.30.21 -> 2.30.23

lfcbase:
- Improvements for BigDecimal class
  All values are normalized now and stored now with non trailing zeros

cego:
- Fixes for cast operations regarding values for type fixed
- Fix in CegoClient, global vars __currencySymbol and __decimalPoint
  still have not been set up correctly, done in the same way as for
  CegoMain on server side
- Added verify005.sql to dbcheck suite to verify cast operations

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-08-11 10:54:17 +00:00
Kurt Jaeger
8f9e0c50c8 databases/cego: 2.30.19 -> 2.30.21
- Fix in CegoProcedure::execute and CegoProcedure::getRetVal In the
  castTo method, the type dimension was still not treated. This might
  lead to wrong cast results especially for fixed values
- Fixed cgadm online help for import command, the nologging option
  was not documented
- In CegoRecoveryManager, added tableset argument line argument for
  calling the external log manager.
  This makes it more easy in the log manager code, to implement
  tableset dependent restore strategies

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-07-25 13:02:33 +00:00
Kurt Jaeger
3b231f3cb8 devel/lfcbase: 1.8.7 -> 1.8.9
databases/cego: 2.30.17 -> 2.30.19

lfcbase:
- Added File::rename method to be able to move files via file class
- Patch file File class, operator= and operator+= did not close the
  file descriptor after copying / appending. This may cause a problem
  for subsequent method calls on the instance. ( e.g. renaming or
  removing )
  This effect actually has just been observed for MinGW64 compiles

cego:
- Catched server termination in CegoTableManager::writeCheckpoint.
  If log files could not be archived, the method does not recognized
  server termination ( runstate = OFFLINE )
- Improvement added for log file shipping in CegoLogThreadPool::copyLog.
  The archive log file is first written to a temporary file and if
  finished, is moved than to its original file name. For the tape
  management, this is an indication, that the file is completely
  written and is ready for further processing
- The previous patch in lfcbase required a patch for
  CegoLogThreadPool::copyLog. Since the archfile file was not closed
  after trunc, the rename operation failed now. close method call was
  added

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-07-20 07:30:09 +00:00
Kurt Jaeger
da3fa3feeb databases/cego: 2.30.15 -> 2.30.17
- Fixed for point-in-time recovery, Date format handling was not
  done correectly
- Elimination of BUFFERPOOLHASHKEY. The bufferpool position is now
  calculated based on the page offset of the corresponding datafile
  ( this information is provided by CegoFileHandler::getRegPageOffset )
  This leads to a much better distribution and usage of the available
  buffer pool pages
- Fix in CegoTableManager::createBTree, the creation of the btree object
  must be done in a dedicated exception block, otherwise the btree
  object is dropped, if it already exists.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-07-15 17:34:38 +00:00
Kurt Jaeger
b6f628c82d devel/lfcbase: 1.8.4 -> 1.8.5
databases/cego: 2.30.14 -> 2.30.15

lfcbase:
- Added statlock mutex in ThreadLock class for protecting statistic
  counters. It seems, increment and decrement operators on atomic
  values are no more thread safe ( Once it was, but I guess this is
  a compiler issue )
  Since the lock statistics can be disabled for production mode,
  there is not performance impact caused by the additional mutex
  calls

cego:
- Made __dateFormatList in CegoMain threadsafe
  For the point-in-time recovery timestamp format, now the server
  defined format is used ( variable CGPITFORMAT is obsolete )
- Added update sync mode. With this mode, the user can decide, if
  an update or delete should be blocked until another concurrent
  transaction is finished or return immediatly without updating
  concurrent affected tuples
- Reactivation of rollback segment record locks in CegoLockHandler class.
  In CegoObjectManager::insertData, in case of rollback segements
  insert operations, the RB record lock is used instead of the
  system record lock. This might avoid some deadlock situations.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-07-10 12:39:29 +00:00
Kurt Jaeger
584e5fd0d2 databases/cego: 2.30.12 -> 2.30.14
- Added alter table modify command just for default values.
    alter table t1 modify column a default 42;
- Improvement for hash calculation in CegoBufferPool::calcSegement.
  For a better page spreading, the segment calculation was changed
  to a more linear approach
- Added more cast cases to CegoField::castTo, still not completed
- Cast handling in CegoFieldValue::castTo completed.
  This allows an any to any value casting, except lob values and
  some unsupported datetime casts ( e.g. bool to datetime really
  makes no sense )
- Fix in CegoBufferPool::poolInfo, the spread rate calculation was
  not done correctly

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-07-07 13:30:54 +00:00
Kurt Jaeger
71a9be4c7a databases/cego: 2.30.11 -> 2.30.12
- Added cast improvements to CegoFieldValue::castTo method, which are
  also checked now with check050
- Evaluation of locale to find out decimal point character. E.g.
  for english locales this is ., for german this is ,. The character
  is used for float value handling in CegoFieldValue methods.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-06-27 05:36:44 +00:00
Kurt Jaeger
cd5464b270 databases/cego: 2.30.7 -> 2.30.11
- Fix in CegoRecoveryManager::recoverTableSet, the lsn was incremented
  which lead to leaks in the transaction log. This could result in
  an incomplete recovery procedure
- Improvements for tableset recovery, external log manage field is
  checked in CegoAdminThread::medRecover before restore procedure is
  started.
- Fix in CegoLogManager::logAction, if online redo log is full, the
  current log entry has to be written anyway, otherwise a checkpoint
  is written and subsequent logAction call in CegoTableManager::logIt
  might lead to duplicate entries in case of a crash recovery
- Fixes for query and table cache added (addEntry method was still not clean)
- Added tableset runstate CHECKPOINT to be set during a tableset
  checkpoint is performed.
  Since this is a critical section in terms of data consistency,
  no system crash should occur while writing a checkpoint.
  If so, the tableset now is marked with status CHECKPOINT and cannot be
  used anymore ( tableset recovery from backup required )
- Patch in CegoDistManager::startTableSet, before starting redo log
  file recovery, the tableset state has to be set to RECOVERY
  Otherwise, occupied redo logs are not archived by the log manager.
  This problem might occur in case of a crash recovery with archive
  mode set to ON
- Patch in CegoQueryCache and CegoTableCache ( for each method addEntry )
  The usedSize calculation was not done correctly for replaces entries
- Added table and cache used size information to show tableset admin command
  This indicates the amount of memory, which is already allocated
  for cached data
- Added synrchonization for query and table cache handling.
  The lack of synchronization might lead to core dumps, if a cache
  entry is freed but also be used by a query
  So before cache cleanup, it has to be checked,
  if the corresponding cache entry is still in use
  If so, it has to be wait, until the cache is clean. For both
  caches ( query and table), the similar logic is used
- Added improvement for query cache handling
  If a stored function, which are used in the cached query, was
  modified, the cache entry will be invalidated
  For this, the CegoSelect::getTableList method was changed to
  CegoSelect::getObjectList and also the used functions are evaluated
  and added to this list.
- Adapted sysmtexp and sysmtimp X-port utilities for current schema definition
- Cache cleanup in CegoQuery class is performed now AFTER the
  modifying action.Otherwise, it may appear, that a cache entry is
  made after cache cleanup but also before the modifying action.
  This may lead to wrong results retrieved from obsolete query cache

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-06-23 05:20:40 +00:00
Kurt Jaeger
07525303ba databases/cego: 2.30.6 -> 2.30.7
- Fixed memory leak in CegoSelect::nextTuple.
  Since the querycache is allocated by the CegoQueryCache instance, the
  pCacheList variable has to be freed after calling the addEntry method.
  Actually, the logic is not very smart, since the cache element is build up
  two times...

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-06-11 06:35:16 +00:00
Kurt Jaeger
e8c46b5ea6 databases/cego: 2.30.5 -> 2.30.6
The following query can cause a core dump
  create table t1(a string(100));
  insert into t1 values ( 'Hugo Habicht');
  insert into t1 values ( 'Kim Kaiser');
  select substr(a, 1, getpos(a, ' ')) from t1;

For return value length evaluation, the method CegoFieldValue::asInteger
is called on a null value which causes the dump. A fix has been
added, so the method returns a value of 0 in case of null values.

Submitted by:	Bjoern Lemke <lemke@lemke-it.com>
2016-06-04 06:31:16 +00:00