Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error on Snapshot 'Apply All': Could not find a part of the path '\App_Data\temp\usync\snapshots\Views' #214

Open
lcichanowicz opened this issue May 1, 2019 · 22 comments

Comments

@lcichanowicz
Copy link
Contributor

lcichanowicz commented May 1, 2019

I have a clean install of Umbraco 7.10.4, to match the one I'm trying to sync from. I installed uSync via the Backoffice. I synced a snapshot into the file system with Beyond Compare ([site root]\uSync\Snapshots). I clicked 'Apply All' on the destination site, after a 'Refresh' click. It churned briefly, then threw the error.

Error: An error has occurred. - Could not find a part of the path '[site root]\App_Data\temp\usync\snapshots\Views'.

I can see that there are now a bunch of folders in the parent folder, but no Views folder as the error state.

image

Ah, my confusion. That image above is the not the temp folder. Here it is:
image

So, it seems there was a failure to include the Views folder on the source site, when the snapshot was created.

@lcichanowicz
Copy link
Contributor Author

lcichanowicz commented May 1, 2019

Ugh.

  1. I tried deleting the snapshot on the source site. It left empty folders behind, which caused the snapshot to show in the 'Current Snapshots' list with zero items. (I deleted the folders and refreshed.)
  2. I tried creating a new snapshot. I get: "Error: undefined - undefined" in the Backoffice UI.

I checked the log.

 2019-05-01 14:05:41,522 [P5864/D3/T17] INFO  Jumoo.uSync.Snapshots.SnapshotServiceController - Createsnap shot: 2019-05-01
 2019-05-01 14:06:23,124 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Running full Umbraco Export
 2019-05-01 14:06:23,139 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.DataTypeHandler - Exporting all DataTypes.
 2019-05-01 14:06:52,341 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.TemplateHandler - Exporting all Templates
 2019-05-01 14:06:59,618 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.ContentTypeHandler - Exporting all ContentTypes (DocTypes)
 2019-05-01 14:07:17,416 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.MediaTypeHandler - Exporting all MediaTypes
 2019-05-01 14:07:19,101 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.LanguageHandler - Exporting all Languages
 2019-05-01 14:07:19,304 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.DictionaryHandler - Exporting all Dictionary Items
 2019-05-01 14:07:19,742 [P5864/D3/T17] INFO  Jumoo.uSync.BackOffice.Handlers.MacroHandler - Exporting all Macros
 2019-05-01 14:07:20,426 [P5864/D3/T17] INFO  Jumoo.uSync.Content.MediaHandler - Exporting Media
 2019-05-01 14:09:02,574 [P5864/D3/T17] INFO  Jumoo.uSync.Content.ContentHandler - Exporting Content
 2019-05-01 14:09:33,110 [P5864/D3/T17] INFO  Jumoo.uSync.Content.DomainHandler - Exporting Domain Settings

I have not altered the 'Culture and Hostnames'. Why does it appear to be choking on that export?
image

@lcichanowicz
Copy link
Contributor Author

lcichanowicz commented May 1, 2019

I think I have figured out the issue, thanks to trying to make, and delete, a couple more snapshots and getting more log info.

2019-05-01 15:00:38,843 [P5864/D12/T26] INFO  Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Initializing uSync 73
 2019-05-01 15:00:38,890 [P5864/D12/T26] INFO  Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Firing up uSync
 2019-05-01 15:00:39,218 [P5864/D12/T26] INFO  Jumoo.uSync.Core.uSyncCoreContext - Loading Context (239ms)
 2019-05-01 15:00:39,328 [P5864/D12/T26] INFO  Jumoo.uSync.BackOffice.uSyncBackOfficeContext - Loading up Sync Handlers : 20
 2019-05-01 15:00:39,375 [P5864/D12/T26] INFO  Jumoo.uSync.Content.ContentTemplateHandler - Content Handler Enabled = True
 2019-05-01 15:00:39,406 [P5864/D12/T26] INFO  Jumoo.uSync.BackOffice.uSyncAction - ### uSync.BackOffice Processed 0 items with 0 changes ###
 2019-05-01 15:00:39,468 [P5864/D12/T26] INFO  Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - uSync Complete (583ms)
 2019-05-01 15:00:39,611 [P5864/D12/T26] INFO  Umbraco.Web.Search.ExamineEvents - Initializing Examine and binding to business logic events
 2019-05-01 15:00:39,781 [P5864/D12/T26] INFO  Umbraco.Web.Search.ExamineEvents - Adding examine event handlers for index providers: 3
 2019-05-01 15:00:39,812 [P5864/D12/T26] INFO  Umbraco.Core.PluginManager - Resolving umbraco.interfaces.IDiscoverable
 2019-05-01 15:00:39,812 [P5864/D12/T26] INFO  Umbraco.Core.PluginManager - Resolved umbraco.interfaces.IDiscoverable (took 0ms)
 2019-05-01 15:00:39,812 [P5864/D12/T26] INFO  Umbraco.Core.PluginManager - Resolving [Umbraco.Core.Persistence.Mappers.MapperForAttribute]Umbraco.Core.Persistence.Mappers.BaseMapper
 2019-05-01 15:00:39,812 [P5864/D12/T26] INFO  Umbraco.Core.PluginManager - Resolved [Umbraco.Core.Persistence.Mappers.MapperForAttribute]Umbraco.Core.Persistence.Mappers.BaseMapper (took 5ms)
 2019-05-01 15:00:40,406 [P5864/D12/T26] INFO  Umbraco.Core.CoreBootManager - Umbraco application startup complete (took 8052ms)
 2019-05-01 15:00:44,516 [P5864/D12/T42] INFO  Umbraco.Core.Sync.ApplicationUrlHelper - New ApplicationUrl detected: http://herrs-stage.azurewebsites.net:80/umbraco
 2019-05-01 15:00:44,531 [P5864/D12/T42] INFO  Umbraco.Core.Sync.ApplicationUrlHelper - ApplicationUrl: http://herrs-stage.azurewebsites.net:80/umbraco (UmbracoModule request)
 2019-05-01 15:00:51,792 [P5864/D11/T41] INFO  Umbraco.Core.UmbracoApplicationBase - Application shutdown. Details: HostingEnvironment

_shutDownMessage=Directory rename change notification for 'D:\home\site\wwwroot'.
Overwhelming Change Notification in wwwroot
HostingEnvironment initiated shutdown
Directory rename change notification for 'D:\home\site\wwwroot'.
Overwhelming Change Notification in wwwroot
Directory rename change notification for 'D:\home\site\wwwroot'.
Overwhelming Change Notification in wwwroot
Directory rename change notification for 'D:\home\site\wwwroot'.
Overwhelming Change Notification in wwwroot
HostingEnvironment caused shutdown

_shutDownStack=   at System.Environment.GetStackTrace(Exception e, Boolean needFileInfo)
   at System.Environment.get_StackTrace()
   at System.Web.Hosting.HostingEnvironment.InitiateShutdownInternal()
   at System.Web.Hosting.HostingEnvironment.InitiateShutdownWithoutDemand()
   at System.Web.HttpRuntime.ShutdownAppDomain(String stackTrace)
   at System.Web.HttpRuntime.OnCriticalDirectoryChange(Object sender, FileChangeEvent e)
   at System.Web.FileChangesMonitor.OnSubdirChange(Object sender, FileChangeEvent e)
   at System.Web.DirectoryMonitor.FireNotifications()
   at System.Web.Util.WorkItem.CallCallbackWithAssert(WorkItemCallback callback)
   at System.Web.Util.WorkItem.OnQueueUserWorkItemCompletion(Object state)
   at System.Threading.QueueUserWorkItemCallback.WaitCallback_Context(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.QueueUserWorkItemCallback.System.Threading.IThreadPoolWorkItem.ExecuteWorkItem()
   at System.Threading.ThreadPoolWorkQueue.Dispatch()
   at System.Threading._ThreadPoolWaitCallback.PerformWaitCallback()

...Led me here:
https://www.rahulpnath.com/blog/azure-web-restarting-automatically-due-to-overwhelming-change-notification/

My source site is hosted on Azure.

@lcichanowicz
Copy link
Contributor Author

The fcnMode issue was breaking full deletion of a SnapShot. However, even with fcnMode disabled, creating a snapshot still fails at the same place each time, per the log.

uSync Backoffice GUI error:
Error: undefined - undefined

Log:

 2019-05-01 15:47:05,067 [P5864/D16/T52] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:07,352 [P5864/D16/T24] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:08,438 [P5864/D16/T54] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:19,847 [P5864/D16/T25] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:21,242 [P5864/D16/T54] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:22,069 [P5864/D16/T39] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:22,354 [P5864/D16/T54] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:22,588 [P5864/D16/T18] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:22,840 [P5864/D16/T24] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:23,123 [P5864/D16/T39] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:47:25,372 [P5864/D16/T24] INFO  Jumoo.uSync.Snapshots.SnapshotManager - Get Snapshots
 2019-05-01 15:48:13,477 [P5864/D16/T25] INFO  Jumoo.uSync.Snapshots.SnapshotServiceController - Createsnap shot: 2019-05-01_1148
 2019-05-01 15:48:13,508 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Running full Umbraco Export
 2019-05-01 15:48:13,508 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.DataTypeHandler - Exporting all DataTypes.
 2019-05-01 15:48:38,024 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.TemplateHandler - Exporting all Templates
 2019-05-01 15:48:45,178 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.ContentTypeHandler - Exporting all ContentTypes (DocTypes)
 2019-05-01 15:49:03,260 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.MediaTypeHandler - Exporting all MediaTypes
 2019-05-01 15:49:04,347 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.LanguageHandler - Exporting all Languages
 2019-05-01 15:49:04,407 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.DictionaryHandler - Exporting all Dictionary Items
 2019-05-01 15:49:04,890 [P5864/D16/T25] INFO  Jumoo.uSync.BackOffice.Handlers.MacroHandler - Exporting all Macros
 2019-05-01 15:49:05,468 [P5864/D16/T25] INFO  Jumoo.uSync.Content.MediaHandler - Exporting Media
 2019-05-01 15:50:49,570 [P5864/D16/T25] INFO  Jumoo.uSync.Content.ContentHandler - Exporting Content
 2019-05-01 15:51:20,788 [P5864/D16/T25] INFO  Jumoo.uSync.Content.DomainHandler - Exporting Domain Settings

That is the end of the log (again).

@KevinJump
Copy link
Owner

Hi,

turning logging levels up to debug might give a little more info, but there is obviously something going wrong 😞

try adding to log4net.config :

  <logger name="Jumoo.uSync">
    <level value="Debug" />
  </logger>

@lcichanowicz
Copy link
Contributor Author

Thanks, @KevinJump. Will do, but I have a snapshot running at the moment. I added a domain to the site, in the Backoffice, thinking that may help.

@lcichanowicz
Copy link
Contributor Author

My idea did not work.

Here is the log tail from yet another attempted snapshot creation, with more logging.

 2019-05-01 16:19:42,151 [P5864/D18/T6] DEBUG Jumoo.uSync.BackOffice.Helpers.uSyncIOHelper - Saving XML to Disk: D:\home\site\wwwroot\uSync\Snapshots\20190501_161606_2019-05-01-1216\Content\settings\global-meta-data\content.config
 2019-05-01 16:19:42,186 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Serializers.ContentSerializer - Serialize Core: Global Site Navigation
 2019-05-01 16:19:42,217 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.NestedContent in loaded mappers
 2019-05-01 16:19:42,233 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,233 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Returning Mapper (dynamic): umbraco.nestedcontent
 2019-05-01 16:19:42,280 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,280 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,280 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.MediaPicker2 in loaded mappers
 2019-05-01 16:19:42,280 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,280 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,280 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,295 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,295 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,295 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.MediaPicker2 in loaded mappers
 2019-05-01 16:19:42,295 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.MediaPicker2 in loaded mappers
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,311 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.MediaPicker2 in loaded mappers
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,326 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,373 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.NestedContent in loaded mappers
 2019-05-01 16:19:42,373 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,373 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Returning Mapper (dynamic): umbraco.nestedcontent
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,391 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,405 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,405 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,405 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,405 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.Textbox in loaded mappers
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for Umbraco.RelatedLinks2 in loaded mappers
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Mappers.ContentMapperFactory - Looking for a dynamic mapper
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Serializers.ContentSerializer - Is Blueprint?
 2019-05-01 16:19:42,420 [P5864/D18/T6] DEBUG Jumoo.uSync.Core.Serializers.ContentSerializer - Returning Node
 2019-05-01 16:19:42,514 [P5864/D18/T6] DEBUG Jumoo.uSync.BackOffice.Helpers.uSyncIOHelper - Saving XML to Disk: D:\home\site\wwwroot\uSync\Snapshots\20190501_161606_2019-05-01-1216\Content\settings\global-site-navigation\content.config
 2019-05-01 16:19:42,721 [P5864/D18/T6] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler: uSync: ContentTemplateHandler is disabled by config
 2019-05-01 16:19:42,721 [P5864/D18/T6] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler uSync: DomainHandler is missing in group "default" Enabled = True
 2019-05-01 16:19:42,721 [P5864/D18/T6] INFO  Jumoo.uSync.Content.DomainHandler - Exporting Domain Settings
 2019-05-01 16:19:43,065 [P5864/D18/T6] DEBUG Jumoo.uSync.BackOffice.Helpers.uSyncIOHelper - Saving XML to Disk: D:\home\site\wwwroot\uSync\Snapshots\20190501_161606_2019-05-01-1216\Domains\herrsStageazurewebsitesnet.config
 2019-05-01 16:19:43,080 [P5864/D18/T6] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Full Export - checking folders
 2019-05-01 16:20:06,231 [P5864/D18/T6] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Processing and Actions (deletes/renames)
 2019-05-01 16:20:06,262 [P5864/D18/T6] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:20:16,029 [P5864/D18/T6] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:20:16,029 [P5864/D18/T6] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Removing Duplicate files from snapshot

@lcichanowicz
Copy link
Contributor Author

@KevinJump, this seems to be the telltale line:

2019-05-01 16:19:42,721 [P5864/D18/T6] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler uSync: DomainHandler is missing in group "default" Enabled = True

I do not know what it is telling, though.

@lcichanowicz
Copy link
Contributor Author

<?xml version="1.0" encoding="utf-8" ?> 
<uSyncBackOfficeSettings xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
  
  <!-- uSync 3.0. Settings file, -->
  
  <!-- uSync folder -->
  <Folder>~/uSync/data/</Folder>

  <!-- run import at startup -->
  <Import>true</Import> 
  
  <!-- export everything to disk at startup -->  
  <ExportAtStartup>false</ExportAtStartup>
    
  <!-- when a user saves something, write it to disk -->  
  <ExportOnSave>true</ExportOnSave> 

  <!-- watch the usync folder, and if something changes, import it-->  
  <WatchForFileChanges>false</WatchForFileChanges> 
  
  <!-- create an archive, when an item is a save, 
      if you're using source control, you probibly don't want this -->
  <ArchiveVersions>false</ArchiveVersions>
  <ArchiveFolder>~/uSync/Archive/</ArchiveFolder>
  <MaxArchiveVersionCount>0</MaxArchiveVersionCount>

  <!-- Backups, create backups before doing the import, this will
        help, when rollback is implimented -->
  <BackupFolder>~/uSync/Backup/</BackupFolder>
  
  <!-- for a live site - you want don't throw errors = true, then the site won't be affected should usync do something bad -->
  <DontThrowErrors>true</DontThrowErrors>
  
  <!-- set to true, and folders and file names will use the ID (not the name or alias) good if you are hitting path length issues -->
  <UseShortIdNames>false</UseShortIdNames>
    
  <!-- 
    under normal operation usync will delete files, when you delete or rename something,
    for some deployment senarios this can be a pain, because you can't always clean your
    folder before deployment - with Preserve set to true, usync will just leave a marker
    file in the place of anything that gets renamed - so you can do additive only deployments
  -->
  <PreserveAllFiles>false</PreserveAllFiles>


  <!-- name of the handler group to use in standard back office operations -->
  <!-- 
      if you want to have diffrent groups on different instances, create new 
      handler groups, and transform this value between your deployments. 
      
      you can also set this in the app settings in web.config, 
      
        <add key="uSync.HandlerGroup" value="default" />
          
      but you need to remove the value in this file if you do that.            
  -->
  <HandlerGroup>default</HandlerGroup>

  <!-- turn individual elements on or off 
    if a handler is registerd but not listed then it is by 
    default on - you have to add it to the list, to turn it off.
  -->
  <Handlers Group="default" EnableMissing="true">
    <HandlerConfig Name="uSync: DataTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: TemplateHandler" Enabled="true" />

    <HandlerConfig Name="uSync: ContentTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MediaTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: LanguageHandler" Enabled="true" />
    <HandlerConfig Name="uSync: DictionaryHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MacroHandler" Enabled="true" />
    <HandlerConfig Name="uSync: DataTypeMappingHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MemberTypeHandler" Enabled="false" />
    
    <!-- content edition - if installed -->
    <HandlerConfig Name="uSync: ContentHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MediaHandler" Enabled="true" />
    
    <!-- Umbraco 7.7 - Content Templates (Blueprints) --> 
    <HandlerConfig Name="uSync: ContentTemplateHandler" Enabled="false" />
  </Handlers>
  
  <!-- deployment handlers 
          - the files are flat, and things never get deleted from disk -->
  <Handlers Group="Deploy" EnableMissing="false">
    <HandlerConfig Name="Deploy:DataTypeHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:TemplateHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:ContentTypeHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:MediaTypeHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:LanguageHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:DictionaryHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:MacroHandler" Enabled="true"/>
    <HandlerConfig Name="Deploy:MemberTypeHandler" Enabled="true"/>
  </Handlers>

  <!-- 
    Handler groups: allow you to specify groups you want to import / export 
    
    Good if you have multiple targets, and you don't want to do everything 
    all the time. 
  -->
  <!-- 
  <Handlers Group="snapshot" EnableMissing="false"> 
    <HandlerConfig Name="uSync: DataTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: TemplateHandler" Enabled="true" />
    <HandlerConfig Name="uSync: ContentTypeHandler" Enabled="true" />
  </Handlers>
  -->
</uSyncBackOfficeSettings>

@lcichanowicz
Copy link
Contributor Author

Getting warmer...

  <Handlers Group="default" EnableMissing="true">
    <HandlerConfig Name="uSync: DataTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: TemplateHandler" Enabled="true" />

    <HandlerConfig Name="uSync: ContentTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MediaTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: LanguageHandler" Enabled="true" />
    <HandlerConfig Name="uSync: DictionaryHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MacroHandler" Enabled="true" />
    <HandlerConfig Name="uSync: DataTypeMappingHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MemberTypeHandler" Enabled="false" />
    
    <!-- content edition - if installed -->
    <HandlerConfig Name="uSync: ContentHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MediaHandler" Enabled="true" />
    
    <!-- Umbraco 7.7 - Content Templates (Blueprints) --> 
    <HandlerConfig Name="uSync: ContentTemplateHandler" Enabled="false" />
  </Handlers>

@KevinJump
Copy link
Owner

Hi,

the logging seems to indicate it is getting past the domain handler,

the domain handler is included because of the EnableMissing="true" line (which is the default)

basically this says if a usync handler is installed but not in the config treat it as if it's enabled.

you can disable it by either .

  1. setting EnableMissing = "false"
    or
  2. explicity adding a disabled line
    <HandlerConfig Name="uSync: DomainHandler" Enabled="false" />

@KevinJump
Copy link
Owner

but at the moment that's not the issue, because you are getting to the bit where snapshots cleans up its folders (so removes and duplicates, etc) - i suspect this is the code that is probibly going wrong.

@lcichanowicz
Copy link
Contributor Author

Thanks. I already took a stab and added this line:

<HandlerConfig Name="uSync: DomainHandler" Enabled="false" />

By copying the last line of that section and changing the name. I'm waiting on the delete to finish, to run it again.

@lcichanowicz
Copy link
Contributor Author

lcichanowicz commented May 1, 2019

It bombed at the same place, as you predicted.

 2019-05-01 16:37:17,874 [P5864/D18/T39] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Full Export - checking folders
 2019-05-01 16:37:27,577 [P5864/D18/T39] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Processing and Actions (deletes/renames)
 2019-05-01 16:37:27,577 [P5864/D18/T39] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:37:37,524 [P5864/D18/T39] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:37:37,524 [P5864/D18/T39] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Removing Duplicate files from snapshot

I set the root log4net priority to debug, and I am trying again.

  <root>
    <priority value="Debug"/>
    <appender-ref ref="AsynchronousLog4NetAppender" />
  </root>

@lcichanowicz
Copy link
Contributor Author

Hmm, the tail of the log looks the same:

 2019-05-01 16:45:07,759 [P5864/D18/T42] DEBUG Jumoo.uSync.BackOffice.Helpers.uSyncIOHelper - Saving XML to Disk: D:\home\site\wwwroot\uSync\Snapshots\20190501_164141_2019-05-01-1241\Content\settings\global-site-navigation\content.config
 2019-05-01 16:45:07,775 [P5864/D18/T42] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler: uSync: ContentTemplateHandler is disabled by config
 2019-05-01 16:45:07,775 [P5864/D18/T42] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler uSync: DomainHandler is missing in group "default" Enabled = True
 2019-05-01 16:45:07,823 [P5864/D18/T42] INFO  Jumoo.uSync.Content.DomainHandler - Exporting Domain Settings
 2019-05-01 16:45:07,853 [P5864/D18/T42] DEBUG Jumoo.uSync.BackOffice.Helpers.uSyncIOHelper - Saving XML to Disk: D:\home\site\wwwroot\uSync\Snapshots\20190501_164141_2019-05-01-1241\Domains\herrsStageazurewebsitesnet.config
 2019-05-01 16:45:07,868 [P5864/D18/T42] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Full Export - checking folders
 2019-05-01 16:45:17,524 [P5864/D18/T42] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Processing and Actions (deletes/renames)
 2019-05-01 16:45:17,524 [P5864/D18/T42] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:45:27,541 [P5864/D18/T42] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:45:27,541 [P5864/D18/T42] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Removing Duplicate files from snapshot

Oddly, it still shows:

2019-05-01 16:45:07,775 [P5864/D18/T42] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler uSync: DomainHandler is missing in group "default" Enabled = True

Here is my saved config:

  <Handlers Group="default" EnableMissing="true">
    <HandlerConfig Name="uSync: DataTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: TemplateHandler" Enabled="true" />

    <HandlerConfig Name="uSync: ContentTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MediaTypeHandler" Enabled="true" />
    <HandlerConfig Name="uSync: LanguageHandler" Enabled="true" />
    <HandlerConfig Name="uSync: DictionaryHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MacroHandler" Enabled="true" />
    <HandlerConfig Name="uSync: DataTypeMappingHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MemberTypeHandler" Enabled="false" />
    <HandlerConfig Name="uSync: DomainHandler" Enabled="false" />

    
    <!-- content edition - if installed -->
    <HandlerConfig Name="uSync: ContentHandler" Enabled="true" />
    <HandlerConfig Name="uSync: MediaHandler" Enabled="true" />
    
    <!-- Umbraco 7.7 - Content Templates (Blueprints) --> 
    <HandlerConfig Name="uSync: ContentTemplateHandler" Enabled="false" />
  </Handlers>

@KevinJump
Copy link
Owner

you have to restart the site after changing that file (it doesn't trigger a restart like a web.config)

@lcichanowicz
Copy link
Contributor Author

Bah! I've done so many, and forgot to. Thanks.

@KevinJump
Copy link
Owner

In all likelyhood its failing here

https://github.com/KevinJump/uSync/blob/82c1c35037b2bac998e06d23cc1e0d19b1c25a20/Jumoo.uSync.Snapshots/Helpers/SnapshotIO.cs#L59

or here

https://github.com/KevinJump/uSync/blob/82c1c35037b2bac998e06d23cc1e0d19b1c25a20/Jumoo.uSync.Snapshots/Helpers/SnapshotIO.cs#L93

this is at the end of the process when it's created a snapshot, it removes anything that was in the last combined snapshot (so things that haven't changed) - this the RemovedDuplicats function

and then it does a clean directories, where it removes any folders that are empty.

looking at the code for both they sort of assume that the folders they ask for at the beginning of the process are still there by the end, but there are probably a few possibilities for them not being.

threading, if the snapshot is running twice it could be deleting files as it goes,
azure disk speed, its possible a file isn't there when azure said it was , as the azure site is effectively running from a network share, it might be something to do with this.

solutions (i will look into) - probably involve using local temp (like examine does on azure) storage to build the temp snapshots and more checks, within those functions, just because a DirectoryInfo says a folder or file is there doesn't mean it will still be later when you delete it. ???

@lcichanowicz
Copy link
Contributor Author

Uhm, I think it just ran successfully. ?!

@lcichanowicz
Copy link
Contributor Author

 2019-05-01 16:57:43,819 [P5864/D19/T53] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:57:43,834 [P5864/D19/T53] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 19ms)
 2019-05-01 16:57:43,834 [P5864/D19/T53] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:57:43,912 [P5864/D19/T52] DEBUG Jumoo.uSync.BackOffice.Helpers.uSyncIOHelper - Saving XML to Disk: D:\home\site\wwwroot\uSync\Snapshots\20190501_165557_2019-05-01-1255\Content\settings\global-site-navigation\content.config
 2019-05-01 16:57:43,945 [P5864/D19/T52] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler: uSync: ContentTemplateHandler is disabled by config
 2019-05-01 16:57:43,945 [P5864/D19/T52] DEBUG Jumoo.uSync.BackOffice.uSyncApplicationEventHandler - Handler: uSync: DomainHandler is disabled by config
 2019-05-01 16:57:43,945 [P5864/D19/T52] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Full Export - checking folders
 2019-05-01 16:57:48,475 [P5864/D19/T52] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Processing and Actions (deletes/renames)
 2019-05-01 16:57:48,475 [P5864/D19/T52] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:57:48,838 [P5864/D19/T24] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:57:48,850 [P5864/D19/T24] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 12ms)
 2019-05-01 16:57:48,946 [P5864/D19/T24] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:57:53,978 [P5864/D19/T22] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:57:54,006 [P5864/D19/T22] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 32ms)
 2019-05-01 16:57:54,006 [P5864/D19/T22] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:57:58,897 [P5864/D19/T52] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - ---------------------------------------
 2019-05-01 16:57:58,897 [P5864/D19/T52] DEBUG Jumoo.uSync.Snapshots.SnapshotManager - Removing Duplicate files from snapshot
 2019-05-01 16:57:59,007 [P5864/D19/T53] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:57:59,055 [P5864/D19/T53] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 49ms)
 2019-05-01 16:57:59,069 [P5864/D19/T53] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:02,135 [P5864/D19/T53] DEBUG Umbraco.Web.UmbracoModule - Begin request: http://herrs-stage.azurewebsites.net/umbraco/backoffice/UmbracoApi/Authentication/GetRemainingTimeoutSeconds.
 2019-05-01 16:58:02,463 [P5864/D19/T28] DEBUG Umbraco.Web.Scheduling.ScheduledTasks - Scheduled tasks executing
 2019-05-01 16:58:02,463 [P5864/D19/T28] DEBUG Umbraco.Web.Scheduling.ScheduledTasks - Scheduled tasks complete (took 5ms)
 2019-05-01 16:58:02,476 [P5864/D19/T28] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledTasks] Task added Umbraco.Web.Scheduling.ScheduledTasks
 2019-05-01 16:58:02,663 [P5864/D19/T39] DEBUG Umbraco.Web.Scheduling.ScheduledPublishing - Processed 0 items
 2019-05-01 16:58:02,663 [P5864/D19/T39] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledPublishing] Task added Umbraco.Web.Scheduling.ScheduledPublishing
 2019-05-01 16:58:04,085 [P5864/D19/T17] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:04,116 [P5864/D19/T17] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 35ms)
 2019-05-01 16:58:04,134 [P5864/D19/T17] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:09,151 [P5864/D19/T39] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:09,151 [P5864/D19/T39] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 11ms)
 2019-05-01 16:58:09,151 [P5864/D19/T39] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:14,191 [P5864/D19/T22] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:14,207 [P5864/D19/T22] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 20ms)
 2019-05-01 16:58:14,223 [P5864/D19/T22] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:17,754 [P5864/D19/T24] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [Umbraco.Web.Scheduling.IBackgroundTask] Task added Umbraco.Web.Strategies.ServerRegistrationEventHandler+TouchServerTask
 2019-05-01 16:58:19,239 [P5864/D19/T40] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:19,285 [P5864/D19/T40] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 49ms)
 2019-05-01 16:58:19,285 [P5864/D19/T40] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:24,301 [P5864/D19/T17] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:24,317 [P5864/D19/T17] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 20ms)
 2019-05-01 16:58:24,333 [P5864/D19/T17] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:29,380 [P5864/D19/T28] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:29,411 [P5864/D19/T28] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 30ms)
 2019-05-01 16:58:29,411 [P5864/D19/T28] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:34,439 [P5864/D19/T6] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:34,439 [P5864/D19/T6] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:58:34,439 [P5864/D19/T6] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:39,440 [P5864/D19/T52] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:39,440 [P5864/D19/T52] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:58:39,440 [P5864/D19/T52] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:44,443 [P5864/D19/T40] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:44,443 [P5864/D19/T40] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:58:44,443 [P5864/D19/T40] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:49,445 [P5864/D19/T54] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:49,450 [P5864/D19/T54] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:58:49,450 [P5864/D19/T54] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:54,462 [P5864/D19/T54] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:54,462 [P5864/D19/T54] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:58:54,462 [P5864/D19/T54] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:58:59,475 [P5864/D19/T6] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:58:59,475 [P5864/D19/T6] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 9ms)
 2019-05-01 16:58:59,475 [P5864/D19/T6] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:59:02,107 [P5864/D19/T18] DEBUG Umbraco.Web.UmbracoModule - Begin request: http://herrs-stage.azurewebsites.net/umbraco/backoffice/UmbracoApi/Authentication/GetRemainingTimeoutSeconds.
 2019-05-01 16:59:02,485 [P5864/D19/T40] DEBUG Umbraco.Web.Scheduling.ScheduledTasks - Scheduled tasks executing
 2019-05-01 16:59:02,485 [P5864/D19/T40] DEBUG Umbraco.Web.Scheduling.ScheduledTasks - Scheduled tasks complete (took 1ms)
 2019-05-01 16:59:02,485 [P5864/D19/T40] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledTasks] Task added Umbraco.Web.Scheduling.ScheduledTasks
 2019-05-01 16:59:02,710 [P5864/D19/T22] DEBUG Umbraco.Web.Scheduling.ScheduledPublishing - Processed 0 items
 2019-05-01 16:59:02,710 [P5864/D19/T22] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [ScheduledPublishing] Task added Umbraco.Web.Scheduling.ScheduledPublishing
 2019-05-01 16:59:04,478 [P5864/D19/T17] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:59:04,478 [P5864/D19/T17] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 10ms)
 2019-05-01 16:59:04,478 [P5864/D19/T17] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:59:09,500 [P5864/D19/T54] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:59:09,504 [P5864/D19/T54] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:59:09,504 [P5864/D19/T54] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing
 2019-05-01 16:59:14,518 [P5864/D19/T6] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Syncing from database...
 2019-05-01 16:59:14,518 [P5864/D19/T6] DEBUG Umbraco.Core.Sync.DatabaseServerMessenger - Complete (took 7ms)
 2019-05-01 16:59:14,518 [P5864/D19/T6] DEBUG Umbraco.Web.Scheduling.BackgroundTaskRunner - [InstructionProcessing] Task added Umbraco.Web.BatchedDatabaseServerMessenger+InstructionProcessing

@KevinJump
Copy link
Owner

yeah my suspicions are with azure disk access - i think if we are rapdily reading/writing things, we can't be 100% sure things are happing in the order we expect.

@lcichanowicz
Copy link
Contributor Author

Thanks for the prompt attention and the help, @KevinJump. Both are much appreciated.

@lcichanowicz
Copy link
Contributor Author

FYI, @KevinJump, I ended up copying the site from Azure, to my local PC, using Beyond Compare, and the full export worked fine, on the exact site on my PC. I expect that you'd expect that. :]

marcemarc pushed a commit to marcemarc/uSync-Legacy that referenced this issue Aug 4, 2023
* Per Handler importing (so breaking up the big requests).

* Add starting / end message to js.

* make performAction a proper-promise.

* update change message.

* streamline handler calls (and use the caches again!)

* Container lookup optimisation (perf)

* Don't show addons with _ in addon string (hide history)

Co-authored-by: Kevin Jump <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants