{"id":296,"date":"2018-09-11T17:06:40","date_gmt":"2018-09-11T16:06:40","guid":{"rendered":"https:\/\/blogs.ncl.ac.uk\/integration\/?p=296"},"modified":"2018-09-12T08:17:53","modified_gmt":"2018-09-12T07:17:53","slug":"dream-of-grouper","status":"publish","type":"post","link":"https:\/\/blogs.ncl.ac.uk\/integration\/2018\/09\/11\/dream-of-grouper\/","title":{"rendered":"I don&#8217;t dream of Grouper, but if I did &#8230;"},"content":{"rendered":"<p>A couple of weeks ago I said we had <a href=\"https:\/\/blogs.ncl.ac.uk\/integration\/2018\/08\/23\/nothing-to-lose\/\">nothing to lose<\/a>\u00a0by trying out a new Grouper to Active Directory group membership provisioning mechanism. Well, it turns out we actually had a lot to gain. The new solution has worked better than I could&#8217;ve dreamt. (For the record, I don&#8217;t dream of Grouper; I have been asked!)<\/p>\n<p>Despite another huge number of corporate data changes at the start of September, we have not had any membership changes waiting more than a day to be provisioned and now, on day 11, we actually have no backlog at all so PSP is back to &#8220;real time&#8221; provisioning.<\/p>\n<div id=\"attachment_295\" style=\"width: 594px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-295\" class=\"wp-image-295 size-large\" src=\"https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018-1024x537.png\" alt=\"Chart showing monthly updates to Grouper groups, by stem, from March 2016 to September 2018\" width=\"584\" height=\"306\" srcset=\"https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018-1024x537.png 1024w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018-300x157.png 300w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018-768x403.png 768w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018-500x262.png 500w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/2018.png 1536w\" sizes=\"auto, (max-width: 584px) 100vw, 584px\" \/><\/a><p id=\"caption-attachment-295\" class=\"wp-caption-text\">Chart showing monthly updates to Grouper groups, by stem, from March 2016 to September 2018<\/p><\/div>\n<p>The fact that we have got through the entire backlog at least a week sooner than last year has surprised me, but I have a theory as to why this might be.<\/p>\n<p>The obvious conclusion, which you could jump to by looking at the chart, is simply that there have not been as many changes for PSP to process this year.<\/p>\n<p>There might be something in that but I also think the monthly view could be slightly misleading. When broken down by week, you can see that last year&#8217;s peak is not that much taller than this year&#8217;s &#8211; it&#8217;s just that we&#8217;re only part way through September at the moment.<\/p>\n<div id=\"attachment_300\" style=\"width: 594px\" class=\"wp-caption alignnone\"><a href=\"https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly.png\"><img loading=\"lazy\" decoding=\"async\" aria-describedby=\"caption-attachment-300\" class=\"size-large wp-image-300\" src=\"https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly-1024x557.png\" alt=\"Chart showing weekly updates to Grouper groups, by stem, from September 2017 to September 2018\" width=\"584\" height=\"318\" srcset=\"https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly-1024x557.png 1024w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly-300x163.png 300w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly-768x418.png 768w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly-500x272.png 500w, https:\/\/blogs.ncl.ac.uk\/integration\/files\/2018\/09\/201718weekly.png 1477w\" sizes=\"auto, (max-width: 584px) 100vw, 584px\" \/><\/a><p id=\"caption-attachment-300\" class=\"wp-caption-text\">Chart showing weekly updates to Grouper groups, by stem, from September 2017 to September 2018<\/p><\/div>\n<p>My theory is that the highly effective new method of updating AD group memberships with changes in Grouper, that we&#8217;ve been using since the end of August, has allowed PSP to run through its backlog far quicker, as it&#8217;s actually had less work to do.<\/p>\n<p>The PSP provisioning technology works in a three step process: &#8216;calc&#8217;, &#8216;diff&#8217;, &#8216;sync&#8217;.<\/p>\n<ol>\n<li>&#8216;Calc&#8217;: It firstly, calculates how the AD group should look, after the change from the change log has been applied.<\/li>\n<li>&#8216;Diff&#8217;: It then works out the difference between how the AD group should look and how it does look, and what needs to be done so that there is no difference.<\/li>\n<li>&#8216;Sync&#8217;. Finally, it synchronises the groups by applying the output from the the &#8216;diff&#8217; step.<\/li>\n<\/ol>\n<p>This is all relatively time-consuming. By using <a href=\"https:\/\/blogs.ncl.ac.uk\/integration\/2018\/08\/02\/a-new-hope\/\">the new solution to synchronise group memberships before PSP gets around to trying<\/a>, PSP has less to do as it only has to complete the &#8216;calc&#8217; and &#8216;diff&#8217; steps for each change and can therefore race through the change log at a much faster pace.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A couple of weeks ago I said we had nothing to lose\u00a0by trying out a new Grouper to Active Directory group membership provisioning mechanism. Well, it turns out we actually had a lot to gain. The new solution has worked &hellip; <a href=\"https:\/\/blogs.ncl.ac.uk\/integration\/2018\/09\/11\/dream-of-grouper\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1062,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[2],"tags":[16],"class_list":["post-296","post","type-post","status-publish","format-standard","hentry","category-group-management","tag-workaround"],"_links":{"self":[{"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/posts\/296","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/users\/1062"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/comments?post=296"}],"version-history":[{"count":8,"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/posts\/296\/revisions"}],"predecessor-version":[{"id":306,"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/posts\/296\/revisions\/306"}],"wp:attachment":[{"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/media?parent=296"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/categories?post=296"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.ncl.ac.uk\/integration\/wp-json\/wp\/v2\/tags?post=296"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}