{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":27392543,"defaultBranch":"master","name":"gobblin","ownerLogin":"apache","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2014-12-01T18:10:50.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/47359?v=4","public":true,"private":false,"isOrgOwned":true},"refInfo":{"name":"","listCacheKey":"v0:1693453714.0","currentOid":""},"activityList":{"items":[{"before":"f6ba4731f6e47a5b0701341e5f6d7e9925946119","after":"2695699363acbf8a07df61d6118f560f3839cb81","ref":"refs/heads/master","pushedAt":"2024-08-29T22:33:58.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2143] handle concurrent ReevaluateDagProc for cancelled dag nodes correctly (#4038)\n\n* avoid adding dag node where update only is required\r\n* address review comments","shortMessageHtmlLink":"[GOBBLIN-2143] handle concurrent ReevaluateDagProc for cancelled dag …"}},{"before":"444f2664be7fb3a44342cc481aaefb46542e8ede","after":"f6ba4731f6e47a5b0701341e5f6d7e9925946119","ref":"refs/heads/master","pushedAt":"2024-08-29T04:00:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2145] fix bug in getting flow status (#4040)\n\n* fix bug in getting flow status","shortMessageHtmlLink":"[GOBBLIN-2145] fix bug in getting flow status (#4040)"}},{"before":"b28b468091e26eb632292ee46fd8aa1e97bbb15e","after":"444f2664be7fb3a44342cc481aaefb46542e8ede","ref":"refs/heads/master","pushedAt":"2024-08-27T22:04:32.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2144] Prevent `GenerateWorkUnitsImpl` from inadvertently cleaning up temp/staging dirs (#4039)","shortMessageHtmlLink":"[GOBBLIN-2144] Prevent GenerateWorkUnitsImpl
from inadvertently cle…"}},{"before":"7c8127c7aa336f25ea2292346cede3756e3098f6","after":"b28b468091e26eb632292ee46fd8aa1e97bbb15e","ref":"refs/heads/master","pushedAt":"2024-08-26T21:43:59.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2142] fix bug in determining if a dag is finished or not (#4037)\n\n* fix bug in determining if a dag is finished or not\r\n* address review comments","shortMessageHtmlLink":"[GOBBLIN-2142] fix bug in determining if a dag is finished or not (#4037"}},{"before":"d58bbc0a12689e83696360f86235925743d1be3a","after":"7c8127c7aa336f25ea2292346cede3756e3098f6","ref":"refs/heads/master","pushedAt":"2024-08-23T18:09:08.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2141] Simulate directly on trash class (#4036)\n\n* Support Trash simulate mode without using MockTrash\r\n\r\n* Use Trashfactory initialization on simulated trash classes","shortMessageHtmlLink":"[GOBBLIN-2141] Simulate directly on trash class (#4036)"}},{"before":"a21428251cdbe265cfe2b5c6398c1cae23a69b7f","after":"d58bbc0a12689e83696360f86235925743d1be3a","ref":"refs/heads/master","pushedAt":"2024-08-22T22:50:16.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"use a newer api in guava (#4034)","shortMessageHtmlLink":"use a newer api in guava (#4034)"}},{"before":"e857c002c6191a5ed94aa9efad09d4006d9d4db0","after":"a21428251cdbe265cfe2b5c6398c1cae23a69b7f","ref":"refs/heads/master","pushedAt":"2024-08-21T21:02:11.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2131] process all dag actions during startup parallely (#4024)\n\n* process all dag actions during startup parallely\r\n* addressed PR comments","shortMessageHtmlLink":"[GOBBLIN-2131] process all dag actions during startup parallely (#4024)"}},{"before":"ac5d6eee1a71bb51fef2f27607a8492abc12cc61","after":"e857c002c6191a5ed94aa9efad09d4006d9d4db0","ref":"refs/heads/master","pushedAt":"2024-08-15T22:42:01.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2133] provide job future before calling SpecProducer::cancelJob (#4027)\n\n* correct order in killing\r\n* add more unit tests","shortMessageHtmlLink":"[GOBBLIN-2133] provide job future before calling SpecProducer::cancel…"}},{"before":"054279466b2f89e97d65c04599af749440b19c84","after":"ac5d6eee1a71bb51fef2f27607a8492abc12cc61","ref":"refs/heads/master","pushedAt":"2024-08-15T15:23:13.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2132] set flow event field in dag and also emit GTE when flow is submitted (#4026)\n\n* set and emit flow status events\r\n* add logs\r\n* address review comments","shortMessageHtmlLink":"[GOBBLIN-2132] set flow event field in dag and also emit GTE when flo…"}},{"before":"bdbf43a37b170d9cbfbad955d8c0b4b085b094ec","after":"054279466b2f89e97d65c04599af749440b19c84","ref":"refs/heads/master","pushedAt":"2024-08-12T19:24:46.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2129] avoid throwing unnessary exception that is polluting logs (#4023)","shortMessageHtmlLink":"[GOBBLIN-2129] avoid throwing unnessary exception that is polluting l…"}},{"before":"eaed5825a3e7a5d94361fa56d0fcf9c69c85d911","after":"bdbf43a37b170d9cbfbad955d8c0b4b085b094ec","ref":"refs/heads/master","pushedAt":"2024-08-11T19:10:17.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2130] avoid race condition b/w add dag node and delete dag (#4021)","shortMessageHtmlLink":"[GOBBLIN-2130] avoid race condition b/w add dag node and delete dag (#…"}},{"before":"ca7ad90e98872a085bb4bdf2c19122215234c130","after":"eaed5825a3e7a5d94361fa56d0fcf9c69c85d911","ref":"refs/heads/master","pushedAt":"2024-08-11T19:06:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2128] Fix bugs in setpermission step where it does not properly add records… (#4020)\n\n* Fix bugs in setpermission step where it does not properly add records with equal file depths","shortMessageHtmlLink":"[GOBBLIN-2128] Fix bugs in setpermission step where it does not prope…"}},{"before":"977928ed3ecee82bd44132906312c088f1d5ca28","after":"ca7ad90e98872a085bb4bdf2c19122215234c130","ref":"refs/heads/master","pushedAt":"2024-08-08T03:01:50.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"reevaluate dag proc should accept pending_retry status if it is a retry (#4019)","shortMessageHtmlLink":"reevaluate dag proc should accept pending_retry status if it is a ret…"}},{"before":"4543e02b8d8a28cbf0c289f303b0be55b0a647ad","after":"977928ed3ecee82bd44132906312c088f1d5ca28","ref":"refs/heads/master","pushedAt":"2024-08-07T22:18:27.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2127] do not emit GaaSObservabilityEvent for a failed job that is going to be retried (#4018)\n\n* modify job status to pending_retry in the right order","shortMessageHtmlLink":"[GOBBLIN-2127] do not emit GaaSObservabilityEvent for a failed job th…"}},{"before":"e501b62ffe646885d8b33198737bc16d38c04ba3","after":"4543e02b8d8a28cbf0c289f303b0be55b0a647ad","ref":"refs/heads/master","pushedAt":"2024-08-06T23:49:18.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"Remove setpermission step for pre-existing folders (#4017)\n\n* Remove setpermission step for pre-existing folders","shortMessageHtmlLink":"Remove setpermission step for pre-existing folders (#4017)"}},{"before":"a55c89c5e22d7af77bae9cc361865e83494248bb","after":"e501b62ffe646885d8b33198737bc16d38c04ba3","ref":"refs/heads/master","pushedAt":"2024-08-06T19:20:31.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"ZihanLi58","name":"Zihan Li","path":"/ZihanLi58","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/48699939?s=80&v=4"},"commit":{"message":"[GOBBLIN-2118]Reduce no of network calls while fetching kafka offsets during startup (#4009)\n\n* Reduce no of network calls to kafka\r\n\r\n* Add UT\r\n\r\n* Added UTs\r\n\r\n* Refactoring code\r\n\r\n* Removing whitespaces\r\n\r\n* Removing whitespaces\r\n\r\n* Removing whitespaces\r\n\r\n* Addressed review comments\r\n\r\n* Changing contains to add for the failedOffsetsGetList\r\n\r\n* Added null check\r\n\r\n---------\r\n\r\nCo-authored-by: Arpit Varshney ","shortMessageHtmlLink":"[GOBBLIN-2118]Reduce no of network calls while fetching kafka offsets…"}},{"before":"805ab6429bf4be2f5e7c0223b96bbe5f299c0f9b","after":"a55c89c5e22d7af77bae9cc361865e83494248bb","ref":"refs/heads/master","pushedAt":"2024-08-06T00:34:51.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2124] only retry transient exceptions (#4016)\n\n* only retry non-transient exceptions\r\n* address review comment","shortMessageHtmlLink":"[GOBBLIN-2124] only retry transient exceptions (#4016)"}},{"before":"a46d74e2cd4e79063345a16288df3375d9516b1f","after":"805ab6429bf4be2f5e7c0223b96bbe5f299c0f9b","ref":"refs/heads/master","pushedAt":"2024-08-05T22:53:53.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2121] redirect kill requests to dag proc engine (#4015)\n\n* redirect kill requests to dag proc engine\r\n* address review comment","shortMessageHtmlLink":"[GOBBLIN-2121] redirect kill requests to dag proc engine (#4015)"}},{"before":"442b5b24cc91ee16b1f03a6056f8fa7d6c3b923d","after":"a46d74e2cd4e79063345a16288df3375d9516b1f","ref":"refs/heads/master","pushedAt":"2024-08-03T05:01:22.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2123] create reevaluate dag action for jobs in state PENDING_RETRY (#4013)\n\n* add pending_Retry to finished statuses list so that a reevaluate dag proc is created for such GTEs","shortMessageHtmlLink":"[GOBBLIN-2123] create reevaluate dag action for jobs in state PENDING…"}},{"before":"78c889140266d27bf5826e5c5b78b045b0bcb1f1","after":"442b5b24cc91ee16b1f03a6056f8fa7d6c3b923d","ref":"refs/heads/master","pushedAt":"2024-08-02T23:33:48.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"serialize/deserialize curretnAttemps and currentGeneration in dag node (#4014)","shortMessageHtmlLink":"serialize/deserialize curretnAttemps and currentGeneration in dag node ("}},{"before":"981ec4f31027e69962984f1f63fb41a04f08dab8","after":"78c889140266d27bf5826e5c5b78b045b0bcb1f1","ref":"refs/heads/master","pushedAt":"2024-07-30T17:16:47.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2087] Enhance DatasetHiveSchemaContainsNonOptionalUnion to suport Optional database name (#3972)\n\n* GOBBLIN-2087 Enhance DatasetHiveSchemaContainsNonOptionalUnion to support Optional database name\r\n\r\n---------\r\n\r\nCo-authored-by: preddy_LinkedIn ","shortMessageHtmlLink":"[GOBBLIN-2087] Enhance DatasetHiveSchemaContainsNonOptionalUnion to s…"}},{"before":"bdea71eb9945abdb1a300ba2daf32841ea6c7414","after":"981ec4f31027e69962984f1f63fb41a04f08dab8","ref":"refs/heads/master","pushedAt":"2024-07-30T00:28:33.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2079] Separate GaaSJobObservabilityEvents to both flow and job level events (#3962)\n\n* Adding flow level events to GaaSObservability to better differentiate vs job level events","shortMessageHtmlLink":"[GOBBLIN-2079] Separate GaaSJobObservabilityEvents to both flow and j…"}},{"before":"dd34ba9cd7820c5ea40a62898963534e1485c4ec","after":"bdea71eb9945abdb1a300ba2daf32841ea6c7414","ref":"refs/heads/master","pushedAt":"2024-07-29T23:31:33.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"update job_name column size (#4011)","shortMessageHtmlLink":"update job_name column size (#4011)"}},{"before":"2ea96226cedbc8286952029101d8acb82cecadc7","after":"dd34ba9cd7820c5ea40a62898963534e1485c4ec","ref":"refs/heads/master","pushedAt":"2024-07-24T17:23:08.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"Mark dagActionsConclude correctly (#4010)\n\nCo-authored-by: Urmi Mustafi ","shortMessageHtmlLink":"Mark dagActionsConclude correctly (#4010)"}},{"before":"e68b62e739976a3d370d0501fdf27c67fd784846","after":"2ea96226cedbc8286952029101d8acb82cecadc7","ref":"refs/heads/master","pushedAt":"2024-07-23T20:42:39.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2119] ignore adding deadline dag actions if they are already present (#4008)\n\n* ignore adding deadline dag actions if they are already present\r\n* fix bug","shortMessageHtmlLink":"[GOBBLIN-2119] ignore adding deadline dag actions if they are already…"}},{"before":"50fdda93978d8dbc09485e5d5706f7d725bde6ef","after":"e68b62e739976a3d370d0501fdf27c67fd784846","ref":"refs/heads/master","pushedAt":"2024-07-22T20:32:29.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2117] Initialize metrics map for DagProcEngineMetrics (#4007)\n\n* Initialize metrics map for DagProcEngineMetrics","shortMessageHtmlLink":"[GOBBLIN-2117] Initialize metrics map for DagProcEngineMetrics (#4007)"}},{"before":"5e8371f5ad7482ce34bec9eb62fb60ea87c4bddb","after":"50fdda93978d8dbc09485e5d5706f7d725bde6ef","ref":"refs/heads/master","pushedAt":"2024-07-19T19:49:33.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"Implement dagProcessingEngine metrics (#3983)\n\nImplement dagProcessingEngine metrics","shortMessageHtmlLink":"Implement dagProcessingEngine metrics (#3983)"}},{"before":"6aa65309c7a93353719bc50f79a4d3d489134bf0","after":"5e8371f5ad7482ce34bec9eb62fb60ea87c4bddb","ref":"refs/heads/master","pushedAt":"2024-07-19T01:03:12.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"arjun4084346","name":"Arjun Singh Bora","path":"/arjun4084346","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/14981564?s=80&v=4"},"commit":{"message":"[GOBBLIN-2111] Delete adhoc flowSpecs in DagProcEngine (#4002)\n\n* Delete adhoc flowSpec after LaunchDagTask.conclude to only delete after finishing the DagProc","shortMessageHtmlLink":"[GOBBLIN-2111] Delete adhoc flowSpecs in DagProcEngine (#4002)"}},{"before":"077a10ac4182ad64865eb4985df15ee08de9a971","after":"6aa65309c7a93353719bc50f79a4d3d489134bf0","ref":"refs/heads/master","pushedAt":"2024-07-18T22:19:17.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"Update Hive retention to add table location to retention dataset root property (#4006)","shortMessageHtmlLink":"Update Hive retention to add table location to retention dataset root…"}},{"before":"2f0e53792fde7f852a808f73f9fc32a627fd2b71","after":"077a10ac4182ad64865eb4985df15ee08de9a971","ref":"refs/heads/master","pushedAt":"2024-07-18T21:53:15.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"Will-Lo","name":"William Lo","path":"/Will-Lo","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/6377154?s=80&v=4"},"commit":{"message":"[GOBBLIN-2114] Add fields to show computed delta between consume and … (#4005)\n\n* [GOBBLIN-2114] Add fields to show computed delta between consume and producer/append time respectively","shortMessageHtmlLink":"[GOBBLIN-2114] Add fields to show computed delta between consume and … ("}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAAEqBtwvQA","startCursor":null,"endCursor":null}},"title":"Activity · apache/gobblin"}