Re: [Kdn-users] Fw:Re: asking for Dataset

Dear José,        I am so appreciated that you can offer me so much guidance. During these days, I gradually understand the structure of dataset_v1, i.e. nsfnetbw.tar.gz.         First, I imported the .ned file into omnet++ and got the topology as shown in the figure below.      Second, I checked the link connection between a pair of output ports of its corrsponding switches as shown in the figure below.      Third, I decoded the meaning of element in Routing.txt. Actually, it can be seen as a collection of routing tables  of all the switches. For instance, line 0 represents the routing table of switch 0. For each row, 14 columns represent 14 destinations respectively from switch 0. And the element in the position (row i, column j) means, in switch i’s routing table, which output port of switch i should be chosen in order to forward a packet to arrive at destination j. For example in the file results_nsfnetbw_8-10_Routing-SP-k-0_0_124/Routing.txt, the element (1,2) = 1 means, in order to forward a packet to switch 2, switch 1 should forward the packet through its output port 1.        These three steps above seem to be with no doubt till now. However, I don’t understand the data structure yet. In the Readme file of GitHub (https://github.com/knowledgedefinednetworking/NetworkModelingDatasets/tree/…). It says there are 125 lines in each simulationResults.txt, representing 125 different levels of traffic intensity in 125 simulations.         And there are 11 key performance indices listed below. For example, bandwidth [src_node][dst_node] seems to be a 2-layer for-loop, the outer layer is the index of src_node from 0-13 meanwhile the inner layer is the index of dst_node from 0-13. So there should be 14*14 = 196 elements. But what does the highlight expression mean in the figure snapshot?       I thought the value should be sampled from the simulation environment rather than calculated. For instance, the  bandwidth between src_node = switch 1 and dst_node = switch 4 should be recorded in the position bandwidth[1][4], but what does bandwidth[1][4] = (1*14 + 4) *3 = 54 mean?         Another question is about the naming manner of each file as shown below. I know 8-10 and 14-16 represent the <lower bound , upper bound> of traffic intensity. However, what dose SP-k-x_0 and W-1-k-x_0 mean? Does it mean shortest path first and widest path first routing scheme. But how can 0 path exist?        Could you please give me a bit hint to these two questions? Thanks a lot! Best Regards, Zeyu tjuzeyuluan tjuzeyuluan(a)163.com <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=tjuzeyuluan&uid=tjuzeyuluan%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22tjuzeyuluan%40163.com%22%5D> 签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail81> 定制 --------- Forwarded Message --------- From： José Suárez-Varela &lt;jsuarezv(a)ac.upc.edu&gt; <mailto:jsuarezv@ac.upc.edu> Date： 02/17/2020 20:39 To： tjuzeyuluan &lt;tjuzeyuluan(a)163.com&gt; <mailto:tjuzeyuluan@163.com> Cc： kdn-users(a)knowledgedefinednetworking.org &lt;kdn-users(a)knowledgedefinednetworking.org&gt; <mailto:kdn-users@knowledgedefinednetworking.org> Subject： Re: [Kdn-users] asking for Dataset Dear Zeyu, Thank you for your interest in this work. Unfortunately, the datasets are quite large and cannot be shared via e-mail. Note that files under the "nsfnetbw/tfrecords/train/" directory include 889M of data. The main difference between both datasets you mention (v0 and v1) is in the topologies they include (see README files with the descriptions). Also, 'datasets_v0' include 500 iterations for each combination of routing+traffic intensity. Note that each iteration uses a different input traffic matrix (TM) of a given traffic intensity (TI). The method to generate these traffic matrices is described in Section 4.1 of [1].  In the case of 'datasets_v1', each file includes 125 iterations. In this case, a file includes a collection of traffic matrices with a range of traffic intensities (<lower lambda max>-<upper lambda max>). Also, these latter datasets include the following information: "5.- Average per-packet neperian logarithm of the delay over the packets transmitted in each source-destination pair". Which can be useful to make probabilistic modeling. For instance, to parameterize a Gamma distribution that models the delay distribution on each source-destination pair. Overall, if you want to reproduce the experiments of a paper I recommend you use the datasets used in the paper. Otherwise, you will need to modify the code to read datasets with a different format. For instance: "Challenging the generalization capabilities of Graph Neural Networks for network modeling" -> datasets_v0 (https://github.com/knowledgedefinednetworking/NetworkModelingDatasets/tree/…) Also, for the paper "Unveiling the potential of Graph Neural Networks for network modeling and optimization in SDN" you should use the datasets at the following link: https://github.com/knowledgedefinednetworking/Unveiling-the-potential-of-GN… This paper presents the first version of RouteNet (https://github.com/knowledgedefinednetworking/net2vec/tree/RouteNet-SOSR/ro…), which did not have support for variable link capacity. For this reason, in these latter datasets all the links in the different topologies have the same capacity. You can check the link capacities used in the "*.ned" files that describe each topology. [1] Krzysztof Rusek, José Suárez-Varela, Albert Mestres, Pere Barlet-Ros, Albert Cabellos-Aparicio; "Unveiling the potential of Graph Neural Networks for network modeling and optimization in SDN," in and in ACM Symposium on SDN Research (SOSR) , pp. 140-151, 209. Link: https://github.com/knowledgedefinednetworking/Unveiling-the-potential-of-GN… Regards, José On 14/02/20 08:00, tjuzeyuluan wrote: > > Dear Professor, >     I’m Zeyu, a PhD student from UC Berkeley. I am really interested > in your work related in Graph Neural Networks -based routing > optimization. I am trying to repeat your experiment. However, the > download speed from the URL(path > ='/home/datasets/SIGCOMM/nsfnetbw/tfrecords/train/') is so slow. > Could you please transfer the zip package via the e-mail? Thank you > very much! >     Another question is that what’s the difference between dataset v0 > and dataset v1. I am a little confused. Could you please explain > further? Thanks a lot! > > tjuzeyuluan > tjuzeyuluan(a)163.com > > <https://maas.mail.163.com/dashi-web-extend/html/proSignature.html?ftlId=1&name=tjuzeyuluan&uid=tjuzeyuluan%40163.com&iconUrl=https%3A%2F%2Fmail-online.nosdn.127.net%2Fqiyelogo%2FdefaultAvatar.png&items=%5B%22tjuzeyuluan%40163.com%22%5D> > > 签名由 网易邮箱大师 <https://mail.163.com/dashi/dlpro.html?from=mail81> > 定制 > > > _______________________________________________ > Kdn-users mailing list > Kdn-users(a)knowledgedefinednetworking.org > https://mail.n3cat.upc.edu/cgi-bin/mailman/listinfo/kdn-users