entityMap|0|type|LINK|mutability|MUTABLE|data|url|https://stackoverflow.com/q/419019/181965|1|IMAGE|IMMUTABLE|imageUrl|https://ask.qcloudimg.com/http-save/yehe-900000/756f44520776e05d2e9e4031b0497713.png|imageAlt|blocks|key|eamcp|text|这个答案将利用Biml的一些高级概念。第一个是分层，因此我们将在第1层中生成150个包。然后在第2层(或任何大于前一层的数字)中，我们将能够将第0层中的劳动成果引用到(tier+max+-1)。|unstyled|depth|inlineStyleRanges|entityRanges|d6r4c|第0层是静态/平面Biml+(在本例中我们没有任何Biml)。由于我们将循环生成子程序包，因此它将自动位于第一层，但我选择在此明确说明，以防您有前身但又是动态的任务要解决|bqkmh|<#*+....+#>是一个被Biml编译器忽略的超级强大的注释结构|offset|length|style|CODE|fvnkt|<#%2B+....+#>是为将显式方法和类添加到Biml中而构建|d4gm5|我们还将使用Extension+method将我们的包大致拆分成组，然后填充到序列容器中。|d2ipn|第1层|6rjuu|这段代码生成名称从so_54773502_000到so_54773502_149的空白SSIS包(总共150个)|19bc7|<#@+template+tier="1"+#>
<Biml+xmlns="http://schemas.varigence.com/biml.xsd">
++++<Packages>
<#foreach+(int+index+in+Enumerable.Range(0,+150)){#>
++++<Package+Name="so_54773502_<#=+string.Format("{0:000}",+index)+#>"+/>
<#}#>
++++</Packages>
</Biml>|code-block|syntax|javascript|68mi6|第2层|1ih90|在这里，我们指定需要多少个并行容器。Split方法的结果是一个列表列表。对于外部容器列表中的每个元素，我们需要添加一个序列容器。对于弹出的列表中的每个元素，我们需要枚举它并执行一个包任务。|32geu|<#@+template+tier="2"+#>
<#
int+taskCountPerContainer+=+10;
int+currentContainerNumber+=+0;
#>
<Biml+xmlns="http://schemas.varigence.com/biml.xsd">
++++<Packages>
++++++++<Package+Name="master">
++++++++++++<Tasks>
<#*+
++++This+is+such+a+fun+bit+of+LINQ.+I+used+the+Split+extension+so+handily+defined+on+the+linked+question
++++I+pass+in+a+List+of+package+names+and+how+many+buckets+I+want+and+it+returns+a+list+of+lists

++++From+there,+we+enumerate+through+the+list+bucket+and+for+each+element+we+find,+we+create+a+sequence
++++container.+Then,+for+each+element+in+the+bucket,+we+add+an+Execute+Package+Task.

++++I+was+unable+to+Split+an+instance+of+AstPackageNodes+as+it+resulted+in+the+error+below+but+the+only+reason
++++your+sample+needed+the+full+object+was+to+provide+both+Name+and+PackageFileName+properties.+We+can+derive
++++the+second+given+the+first

//+foreach(var+outerlist+in+Split(this.RootNode.Packages.ToList<AstPackageNode>(),taskCountPerContainer)){++++
//+results+in+this+error.+
//+Destination+array+was+not+long+enough.+Check+destIndex+and+length,+and+the+array's+lower+bounds.++++
//+TODO:+Check+with+Varigence+or+run+in+C#+project

*#>
++++++++++++++++<#foreach(var+listOfPackages+in+Split(this.RootNode.Packages.Select(x+=>+x.Name).ToList<string>(),+taskCountPerContainer)){#>
++++++++++++++++<Container+Name="SEQC_<#=currentContainerNumber%2B%2B#>"+ConstraintMode="Linear">
++++++++++++++++++++<Tasks>
++++++++++++++++++++<#foreach(var+packageName+in+listOfPackages){#>
++++++++++++++++++++++++<ExecutePackage+Name="EPT+<#=packageName#>"><ExternalProjectPackage+Package="<#=packageName#>.dtsx"/></ExecutePackage>
++++++++++++++++++++<#}#>
++++++++++++++++++++</Tasks>
++++++++++++++++</Container>
++++++++++++++++<#}#>
++++++++++++</Tasks>
++++++++</Package>
++++</Packages>
</Biml>

<#%2B
//+https://stackoverflow.com/questions/419019/split-list-into-sublists-with-linq
public+static+IList<List<T>>+Split<T>(IList<T>+source,+int+buckets)
{
++++return++source
++++++++.Select((x,+i)+=>+new+{+Index+=+i,+Value+=+x+})
++++++++.GroupBy(x+=>+x.Index+/+buckets)
++++++++.Select(x+=>+x.Select(v+=>+v.Value).ToList())
++++++++.ToList();
}

#>|cqc4v|最终结果|dfbas|看，妈，很多包都被执行了！|4gp8l|​|ait35|?|atomic|8calk|d9pj3^0|0|0|0|B|0|0|B|0|6|G|0|0|0|0|0|0|I|5|0|0|0|0|0|0|1|1|0|0^^$0|$1|$2|3|4|5|6|$7|8]]|9|$2|A|4|B|6|$C|D|E|-4]]]|F|@$G|H|I|J|2|K|L|1Q|M|@]|N|@]|6|$]]|$G|O|I|P|2|K|L|1R|M|@]|N|@]|6|$]]|$G|Q|I|R|2|K|L|1S|M|@$S|1T|T|1U|U|V]]|N|@]|6|$]]|$G|W|I|X|2|K|L|1V|M|@$S|1W|T|1X|U|V]]|N|@]|6|$]]|$G|Y|I|Z|2|K|L|1Y|M|@]|N|@$S|1Z|T|20|G|21]]|6|$]]|$G|10|I|11|2|K|L|22|M|@]|N|@]|6|$]]|$G|12|I|13|2|K|L|23|M|@]|N|@]|6|$]]|$G|14|I|15|2|16|L|24|M|@]|N|@]|6|$17|18]]|$G|19|I|1A|2|K|L|25|M|@]|N|@]|6|$]]|$G|1B|I|1C|2|K|L|26|M|@$S|27|T|28|U|V]]|N|@]|6|$]]|$G|1D|I|1E|2|16|L|29|M|@]|N|@]|6|$17|18]]|$G|1F|I|1G|2|K|L|2A|M|@]|N|@]|6|$]]|$G|1H|I|1I|2|K|L|2B|M|@]|N|@]|6|$]]|$G|1J|I|1K|2|K|L|2C|M|@]|N|@]|6|$]]|$G|1L|I|1M|2|1N|L|2D|M|@]|N|@$S|2E|T|2F|G|2G]]|6|$]]|$G|1O|I|1K|2|K|L|2H|M|@]|N|@]|6|$]]|$G|1P|I|-4|2|K|L|2I|M|@]|N|@]|6|$]]]]

<p>This answer is going to take advantage of a few advanced concepts with Biml. The first will be tiering so we will generate our 150 packages in tier 1. Then in tier 2 (or any number greater than the previous tier), we will be able to reference the fruits of our labor in tier 0 to (tier max -1).</p>

<p>Tier 0 is static/flat Biml (which we don't have any in this example). Since we'll be looping to generate the child packages, it will automatically be in tier 1 but I chose to be explicit here in case you have precursor, yet dynamic, tasks to solve</p>

<p><code>&lt;#* .... #&gt;</code> is a super powerful comment construct that is ignored by the Biml compiler</p>

<p><code>&lt;#+ .... #&gt;</code> is construct for adding explicit methods and classes into your Biml</p>

<p>We will also use an <a href="https://stackoverflow.com/q/419019/181965">Extension method</a> to approximately split our packages into groups to then stuff into Sequence Containers.</p>

<h2>Tier 1</h2>

<p>This code generates blank SSIS packages with names ranging from so_54773502_000 to so_54773502_149 (150 in total)</p>

<pre><code>&lt;#@ template tier="1" #&gt;
&lt;Biml xmlns="http://schemas.varigence.com/biml.xsd"&gt;
    &lt;Packages&gt;
&lt;#foreach (int index in Enumerable.Range(0, 150)){#&gt;
    &lt;Package Name="so_54773502_&lt;#= string.Format("{0:000}", index) #&gt;" /&gt;
&lt;#}#&gt;
    &lt;/Packages&gt;
&lt;/Biml&gt;
</code></pre>

<h2>Tier 2</h2>

<p>In here we specify how many parallel containers we want. The results of the <code>Split</code> method is a list of lists. For each element in the outer container list, we need to add a Sequence Container. For each element within that popped list, we need to enumerate through it and execute a package task.</p>

<pre><code>&lt;#@ template tier="2" #&gt;
&lt;#
int taskCountPerContainer = 10;
int currentContainerNumber = 0;
#&gt;
&lt;Biml xmlns="http://schemas.varigence.com/biml.xsd"&gt;
    &lt;Packages&gt;
        &lt;Package Name="master"&gt;
            &lt;Tasks&gt;
&lt;#* 
    This is such a fun bit of LINQ. I used the Split extension so handily defined on the linked question
    I pass in a List of package names and how many buckets I want and it returns a list of lists

    From there, we enumerate through the list bucket and for each element we find, we create a sequence
    container. Then, for each element in the bucket, we add an Execute Package Task.

    I was unable to Split an instance of AstPackageNodes as it resulted in the error below but the only reason
    your sample needed the full object was to provide both Name and PackageFileName properties. We can derive
    the second given the first

// foreach(var outerlist in Split(this.RootNode.Packages.ToList&lt;AstPackageNode&gt;(),taskCountPerContainer)){    
// results in this error. 
// Destination array was not long enough. Check destIndex and length, and the array's lower bounds.    
// TODO: Check with Varigence or run in C# project

*#&gt;
                &lt;#foreach(var listOfPackages in Split(this.RootNode.Packages.Select(x =&gt; x.Name).ToList&lt;string&gt;(), taskCountPerContainer)){#&gt;
                &lt;Container Name="SEQC_&lt;#=currentContainerNumber++#&gt;" ConstraintMode="Linear"&gt;
                    &lt;Tasks&gt;
                    &lt;#foreach(var packageName in listOfPackages){#&gt;
                        &lt;ExecutePackage Name="EPT &lt;#=packageName#&gt;"&gt;&lt;ExternalProjectPackage Package="&lt;#=packageName#&gt;.dtsx"/&gt;&lt;/ExecutePackage&gt;
                    &lt;#}#&gt;
                    &lt;/Tasks&gt;
                &lt;/Container&gt;
                &lt;#}#&gt;
            &lt;/Tasks&gt;
        &lt;/Package&gt;
    &lt;/Packages&gt;
&lt;/Biml&gt;

&lt;#+
// https://stackoverflow.com/questions/419019/split-list-into-sublists-with-linq
public static IList&lt;List&lt;T&gt;&gt; Split&lt;T&gt;(IList&lt;T&gt; source, int buckets)
{
    return  source
        .Select((x, i) =&gt; new { Index = i, Value = x })
        .GroupBy(x =&gt; x.Index / buckets)
        .Select(x =&gt; x.Select(v =&gt; v.Value).ToList())
        .ToList();
}

#&gt;
</code></pre>

<h2>End result</h2>

<p>Look ma, lots of packages getting executed!</p>

<p><a href="https://i.stack.imgur.com/plj6L.png" rel="noreferrer"><img src="https://i.stack.imgur.com/plj6L.png" alt="enter image description here"></a></p>


<p>I have a situation where my master biml generates 150 Execute package task.I need to generate sequence containers so that each of them holds (150/10)15  Execute package task per sequence container in the master package.</p>

<p>Could you please help me to find an appropriate solution any ideas/Working exmaples/code base are welcome!!</p>

<pre><code>&lt;Tasks&gt; 
    &lt;# foreach (var package in RootNode.Packages) { #&gt; 
         &lt;ExecutePackage Name="Execute &lt;#=package.Name#&gt;" &gt; 
              &lt;ExternalProjectPackage Package="&lt;#=package.PackageFileName#&gt;" /&gt; 
         &lt;/ExecutePackage&gt;
    &lt;# } #&gt;
&lt;/Tasks&gt; 
</code></pre>


Unable to generate BIML script for Tiering in SSIS

编译器

容器

 我有一个情况，我的主biml生成150个执行包任务。我需要生成序列容器，以便它们中的每个容器在主包中每个序列容器都包含(150/10)15个执行包任务。 你能帮我找到一个合适的解决方案吗?欢迎任何想法/工作示例/代码库！！ <Tasks>     <# foreach (var package in RootNode...

问无法为SSIS中的分层生成BIML脚本
EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问无法为SSIS中的分层生成BIML脚本EN

社区

活动

资源

关于

腾讯云开发者

热门产品

热门推荐

更多推荐

问无法为SSIS中的分层生成BIML脚本
EN