I'm running heterogenous replication between Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit and SQL Server 2008 R2 10.50.2500.0 SP1 Enterprise Edition (64-bit). I have found a situation where the Log Reader Agent appears to stall. If I stop the log reader agent and restart it all of a sudden appears to complete all task and log all the activity it has performed. I have full logging on the log reader agent to file and a capture of the agent window after restarting. I've attached 2 diagrams of the monitor; one before restarting the log reader agent and one after restarting. I've also embedded the log file after the images and the point in the log file markedWAS HUNG HERE is where I restarted the log reader agent. This is a pretty serious issue that I need resolved as soon as possible, thanks.
publisher publisher_db
entry_time tran_count cmd_count cmd_2_tran_ratio
------------------------------ ------------------------------ ----------------------- ----------- ----------- ---------------- CRM
distribution 2013-01-11 00:32:00.000 1 131526
131526.50
CRM distribution
2013-01-11 05:39:00.000 2 11395 5698.00
CRM distribution
2013-01-11 05:40:00.000 12 2437 203.58
CRM distribution
2013-01-11 05:51:00.000 1 1 1.50
publisher_db article
entry_time cmd_count
------------------------------ ------------------------------ ----------------------- -----------
distribution PROV_TPL_CURRENT 2013-01-11 00:00:00.000
1
distribution PROV_TPL_CURRENT 2013-01-11 00:30:00.000
1
distribution PROV_TPL_CURRENT 2013-01-11 05:39:00.000
11395
distribution PROV_TPL_CURRENT 2013-01-11 05:40:00.000
10
distribution PROV_TPL_CURRENT 2013-01-11 05:51:00.000
1
distribution PROV_TVL_CURRENT 2013-01-11 00:32:00.000
131526
distribution PROV_TVL_CURRENT 2013-01-11 05:40:00.000
2427
David Ryan
Before Restarting Agent
After Restarting Agent ( roughly 5 hours later)
******************** STATISTICS SINCE AGENT STARTED ***************************
01-11-2013 00:29:23
Execution time (ms): 42808624
Work time (ms): 417538
Distribute Repl Cmds Time(ms): 144087
Fetch time(ms): 4294965940
Repldone time (ms): 138248
Write time (ms): 2838
Num Trans: 46 Num Trans/Sec: 0.110170
Num Cmds: 50197 Num Cmds/Sec: 120.221393
LoadReplCmds time(ms): 277883
Publisher status requests (ms): 43973
GetPublisherStatus (ms): 15
GetChangeStatus (ms): 43958
Publisher synchronization requests (ms): 230307
PollBegin (ms): 149972
PollSync (ms): 0
PollEnd (ms): 80335
Publisher data queries (ms): 717
SyncInit (ms): 0
SyncDone (ms): 0
InReconciliation (ms): 0
Change (ms): 501
RowCount (ms): 0
TracerToken (ms): 216
Distribution thread requests (ms): 1590
SyncInit (ms): 0
SyncDone (ms): 0
RowCount (ms): 0
TracerToken (ms): 0
Change (ms): 1590
Commit (ms): 0
Distributor queries (ms): 15
SetSubStateActive (ms): 0
SetSubStateInitiated (ms): 0
GetDistributorFlushTime (ms): 15
Log Reader processing (ms): 1266
SyncInit (ms): 0
SyncDone (ms): 0
InReconciliation (ms): 0
RowCount (ms): 0
TracerToken (ms): 32
Change processing (ms): 1093
SetupCache (ms): 141
SyncInit Total (ms): 0
SyncInit request to publisher (ms): 0
SetSubStateInitiated query (ms): 0
SyncInit distribution thread (ms): 0
SyncInit log reader processing (ms): 0
SyncDone Total (ms): 0
SyncDone request to publisher (ms): 0
SetSubStateActive query (ms): 0
SyncDone distribution thread (ms): 0
SyncDone log reader processing (ms): 0
InReconciliation Total (ms): 0
SyncDone request to publisher (ms): 0
InRecon log reader processing (ms): 0
RowCount Total (ms): 0
RowCount request to publisher (ms): 0
RowCount distribution thread (ms): 0
RowCount log reader processing (ms): 0
TracerToken Total (ms): 248
Tracer request to publisher (ms): 216
Tracer distribution thread (ms): 0
Tracer log reader processing (ms): 32
Change Total (ms): 3184
Change request to publisher (ms): 501
Change distribution thread (ms): 1590
Gather change data (ms): 796
Format change commands (ms): 297
SetupCache (ms): 141
Repldone time (ms): 138248
Publisher synchronization requests (ms): 138248
PollSync (ms): 0
PollEnd (ms): 138248
SyncDone Total (ms): 0
SyncDone request to publisher (ms): 0
SetSubStateActive (ms): 0
SyncDone distribution thread (ms): 0
SyncDone log reader processing (ms): 0
*******************************************************************************
2013-01-11 06:30:00.582 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 06:30:00.751 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000035, '0x00000000000000000035'.'.
2013-01-11 06:31:03.484 Status: 16384, code: 20007, text: 'No replicated transactions are available.'.
2013-01-11 06:32:07.518 Status: 16384, code: 20007, text: 'No replicated transactions are available.'.
2013-01-11 06:32:34.373 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
WAS HUNG HERE
2013-01-11 11:39:05.134 Microsoft SQL Server Log Reader Agent 10.50.2500.0
2013-01-11 11:39:05.148 Copyright (c) 2008 Microsoft Corporation
2013-01-11 11:39:05.149 Microsoft SQL Server Replication Agent: logread
2013-01-11 11:39:05.150
2013-01-11 11:39:05.150 The timestamps prepended to the output lines are expressed in terms of UTC time.
2013-01-11 11:39:05.151 User-specified agent parameter values:
-Publisher CRM
-Distributor RTN1
-DistributorSecurityMode 1
-Continuous
-output d:\repllog\crm_logreader.txt
-outputverboselevel 3
-XJOBID 0xF165ADD24A0ECE49B45BCFBE12CAA01A
-XJOBNAME CRM-CRM-1
-XSTEPID 2
-XSUBSYSTEM LogReader
-XSERVER CRM
-XCMDLINE 0
-XCancelEventHandle 0000000000000774
-XParentProcessHandle 00000000000006E8
2013-01-11 11:39:05.209 Parameter values obtained from agent profile:
-pollinginterval 2000
-historyverboselevel 2
-logintimeout 15
-querytimeout 1800
-readbatchsize 500
-readbatchsize 500000
2013-01-11 11:39:05.211 Connecting to OLE DB Publisher at datasource: 'RTN1', location: '', catalog: 'distribution', providerstring: '' using provider 'SQLNCLI10'
2013-01-11 11:39:05.214 OLE DB Publisher: RTN1
DBMS: Microsoft SQL Server
Version: 10.50.2500
catalog name: distribution
user name: HTMS\logagent
API conformance: 0
SQL conformance: 0
transaction capable: 1
read only: F
identifier quote char: "
non_nullable_columns: 0
owner usage: 15
max table name len: 128
max column name len: 128
need long data len:
max columns in table: 1000
max columns in index: 16
max char literal len: 131072
max statement len: 131072
max row size: 131072
2013-01-11 11:39:06.394 OLE DB Publisher: RTN1
DBMS: Microsoft SQL Server
Version: 10.50.2500
catalog name: distribution
user name: HTMS\logagent
API conformance: 0
SQL conformance: 0
transaction capable: 1
read only: F
identifier quote char: "
non_nullable_columns: 0
owner usage: 15
max table name len: 128
max column name len: 128
need long data len:
max columns in table: 1000
max columns in index: 16
max char literal len: 131072
max statement len: 131072
max row size: 131072
2013-01-11 11:39:06.395 OLE DB Publisher 'RTN1': select @@SERVERNAME
2013-01-11 11:39:06.397 Connecting to OLE DB DISTOLE at datasource: 'RTN1', location: '', catalog: 'distribution', providerstring: '' using provider 'SQLNCLI10'
2013-01-11 11:39:06.402 OLE DB DISTOLE: RTN1
DBMS: Microsoft SQL Server
Version: 10.50.2500
catalog name: distribution
user name: HTMS\logagent
API conformance: 0
SQL conformance: 0
transaction capable: 1
read only: F
identifier quote char: "
non_nullable_columns: 0
owner usage: 15
max table name len: 128
max column name len: 128
need long data len:
max columns in table: 1000
max columns in index: 16
max char literal len: 131072
max statement len: 131072
max row size: 131072
2013-01-11 11:39:06.403 OLE DB DISTOLE: RTN1
DBMS: Microsoft SQL Server
Version: 10.50.2500
catalog name: distribution
user name: HTMS\logagent
API conformance: 0
SQL conformance: 0
transaction capable: 1
read only: F
identifier quote char: "
non_nullable_columns: 0
owner usage: 15
max table name len: 128
max column name len: 128
need long data len:
max columns in table: 1000
max columns in index: 16
max char literal len: 131072
max statement len: 131072
max row size: 131072
2013-01-11 11:39:06.403 OLE DB DISTOLE 'RTN1': select datasource, srvid from master..sysservers where upper(srvname) = upper(N'CRM')
2013-01-11 11:39:06.406 OLE DB Publisher 'RTN1': sp_MSgetversion
2013-01-11 11:39:06.408 Status: 4096, code: 20024, text: 'Initializing'.
2013-01-11 11:39:06.409 The agent is running. Use Replication Monitor to view the details of this agent session.
2013-01-11 11:39:06.410 OLE DB DISTOLE 'RTN1': sp_MSget_last_transaction @publisher_id = 2, @publisher_db = N'distribution', @for_truncate = 0x0
2013-01-11 11:39:06.411 OLE DB DISTOLE 'RTN1': sp_MSquery_syncstates 2, N'distribution'
2013-01-11 11:39:07.585 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:39:07.677 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000037, '0x00000000000000000037'.'.
2013-01-11 11:39:08.721 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:16.254 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 11394 commands, 1 xacts. Last xact: 0x00000000000000000038, '0x00000000000000000038'.'.
2013-01-11 11:40:16.569 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:18.548 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1427 commands, 1 xacts. Last xact: 0x00000000000000000039, '0x00000000000000000039'.'.
2013-01-11 11:40:18.569 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:18.589 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x0000000000000000003a, '0x0000000000000000003a'.'.
2013-01-11 11:40:18.610 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:18.629 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x0000000000000000003b, '0x0000000000000000003b'.'.
2013-01-11 11:40:20.432 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:20.887 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1000 commands, 1 xacts. Last xact: 0x0000000000000000003c, '0x0000000000000000003c'.'.
2013-01-11 11:40:20.912 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:20.932 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x0000000000000000003d, '0x0000000000000000003d'.'.
2013-01-11 11:40:20.952 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:20.975 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x0000000000000000003e, '0x0000000000000000003e'.'.
2013-01-11 11:40:20.996 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:21.013 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x0000000000000000003f, '0x0000000000000000003f'.'.
2013-01-11 11:40:21.040 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:21.059 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000040, '0x00000000000000000040'.'.
2013-01-11 11:40:21.081 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:21.098 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000041, '0x00000000000000000041'.'.
2013-01-11 11:40:21.119 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:21.137 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000042, '0x00000000000000000042'.'.
2013-01-11 11:40:21.158 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:21.182 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000043, '0x00000000000000000043'.'.
2013-01-11 11:40:21.206 Status: 4, code: 6002, text: 'Committed batch to distribution database.'.
2013-01-11 11:40:21.223 Status: 4, code: 22021, text: 'Batch committed. Batch consisted of 1 commands, 1 xacts. Last xact: 0x00000000000000000044, '0x00000000000000000044'.'.
2013-01-11 11:41:22.901 Status: 16384, code: 20007, text: 'No replicated transactions are available.'.