Fixes for the common vm utils and scripts to install bookinfo #872

costinm · 2017-09-19T23:35:56Z

Scripts cleaned up and migrated from proxy.

Location and name of release files may still change (and only one file made it to current release candidate).

Added example scripts for installing bookinfo components on a cluster extension (VM)

ldemailly · 2017-09-19T23:47:22Z

install/tools/istio_vm_common.sh

 function istioCopyBuildFiles() {
  local ISTIO_IO=${ISTIO_BASE:-${GOPATH:-$HOME/go}}/src/istio.io
-  local ISTIO_FILES=${ISTIO_FILES:-.}
+  local ISTIO_FILES=${ISTIO_FILES:-$ISTIO_IO/istio/bazel-bin/vm}


didn't you rename this already ? ISTIO_STAGING_DIR

ldemailly · 2017-09-19T23:50:03Z

samples/apps/bookinfo/cluster_extension.sh

+
+  cat <<EOF | mysql -u root -ppassword
+  USE test;
+  update ratings set rating=$RATING where reviewid=1;


cute.
though you can put test as mysql arg and avoid the use test and you can also put the update as a -e all in 1 line:

mysql -u root -ppassword test -e "update ratings set rating=$RATING where reviewid=1;

(and having the user and password hardcoded is a bit scary)

I know you can pass a single command - but I think the other style is more readable and can be used for more generic setups.

Nothing I can do at this point about the hardcoded password. I believe mongodb sample is also wide open and relies only on firewall. If auth is enabled - mTLS will take care of it.

ldemailly · 2017-09-19T23:52:42Z

where is the istioctl register part btw ?

ldemailly

putting it in your queue. small change and istioctl register question and good to go

costinm · 2017-09-20T19:26:58Z

istioctl is not part of the script - there is no point to wrap it with a function that takes the same parameters.

The previous kubectl method to add the service was in the script because it requires few commands and a more complex syntax.

ZackButcher

Fine by me to go in.

ZackButcher · 2017-09-20T22:26:49Z

Shriram should still give it a thumbs up first though.

rshriram

Where are the callers for these scripts? I am also unclear about the objective here, to run details and yet be installing MySQL.

There is a wildcard chmod that needs to be cleaned up. And better to move the cluster ext scripts to a scripts folder.

rshriram · 2017-09-20T22:53:18Z

install/tools/istio_vm_common.sh

@@ -189,18 +189,19 @@ function istioBootstrapVM() {

  istio_provision_certs $SA

-  local ISTIO_FILES=${ISTIO_FILES:-.}
+  local ISTIO_IO=${ISTIO_BASE:-${GOPATH:-$HOME/go}}/src/istio.io
+  local ISTIO_STAGING=${ISTIO_STAGING:-$ISTIO_IO/istio/bazel-bin/vm}


Are we allowe to create our own directories under bazel folders ?

This directory (and all of the other bazel-* dirs) is actually a symlink to $HOME/.cache/bazel/... - we should be able to create directories there, but they're ephemeral.

my understanding is the script will be packaged in our istio release binary, correct? If so, is bazel stuff mandatory? I'd hope not, if so, i would prefer a default dir not mention bazel to avoid confusion.

AFAIK we can create files and dirs - this can go away once we have all .deb files available
for download.

Resolved - will just use the structure that downloadIstio creates ( and updated the script to get the files we need ).

Long term the deb files will be in an apt repo, and we can include the helpers for VM in the debian ( a bit too late for Monday, will try to have a PR ready just in case )

rshriram · 2017-09-20T22:54:20Z

install/tools/istio_vm_common.sh

+  mkdir -p $ISTIO_STAGING
+  pushd $ISTIO_STAGING
+
+  curl ${CURL_OPTIONS:-} https://storage.googleapis.com/istio-release/releases/$ISTIO_VERSION/deb/istio-auth-node-agent-release.deb > istio-auth-node-agent.deb


Can you name the files with the versions ? Makes it easier to revert

Will complicate the script that runs on the machine ( would need to take istio version ).
Reverting is 'apt-get remove istio-auth' ( i.e. the name of the package, without version).

This is all temporary - we will need to setup the apt-get and signing, but I don't see it
happening in 0.2.

i meant istio-auth-agent-${ISTIO_VERSION}.deb .

Following the release names - will be istio-ISTIO_VERSION/... ( we can change in the next release )

Well - in the next release I hope we'll not download .deb by hand...

rshriram · 2017-09-20T22:55:01Z

install/tools/istio_vm_common.sh

+  curl ${CURL_OPTIONS:-} https://storage.googleapis.com/istio-release/releases/$ISTIO_VERSION/deb/istio-auth-node-agent-release.deb > istio-auth-node-agent.deb
+  curl ${CURL_OPTIONS:-} https://storage.googleapis.com/istio-release/releases/$ISTIO_VERSION/deb/istio-proxy-envoy-release.deb > istio-proxy-envoy.deb
+  curl ${CURL_OPTIONS:-} https://storage.googleapis.com/istio-release/releases/$ISTIO_VERSION/deb/istio-agent-release.deb > istio-agent.deb
+  chmod +w *.deb


Also bad idea. Esp wildcard like these. Maybe istio-*.deb

Will update it - probably not needed, not sure what the default perm will be on the curl.

The problem with r/o .deb is that "scp ..." fails the second time. May not be an issue for
regular users who just try this once (and long term will go away when we have proper
apt repos)

rshriram · 2017-09-20T22:56:11Z

samples/apps/bookinfo/cluster_extension.sh

+#
+################################################################################
+
+# Script to run on a VM with VPC connectivity to the cluster, to prepare the DB and details app.


Why details app? I thought we were just running MySQL here. Besides ratings is the one that accesses db. Not details

VPC connectivity is confusing as it is not required. can we reword it to network connectivity?

Yes, I think ratings should run on k8s, to show it can access a DB over TCP. That's
the main use case.

Details is to show http works - and can run either on the VM or on k8s. Why - simply easiest to install (just ruby dep). I tried the others - any can be run, and we can even have a demo with all components on VMs, but this seems the lighter.

On wording - 'network connectivity' is also pretty confusing.

rshriram · 2017-09-20T23:00:49Z

samples/apps/bookinfo/cluster_extension.sh

@@ -0,0 +1,73 @@
+#!/bin/bash
+#


Not really liking the concept of polluting bookinfo root. If possible move to dedicated folder. Also, call it demo_cluster_ext.sh

Or just _bookinfo_vm_svc.sh

Sure - how about cluster_ext folder ? We need some way to help automate running
bookinfo on a VM.

cluster_ext or scripts.. your call.

Used clusterex for now ( since it's not clear if 'ext' or 'exp' will be used :-)

rshriram · 2017-09-20T23:09:30Z

samples/apps/bookinfo/cluster_extension.sh

+  fi
+  ruby details/details.rb 9080  > details.log 2>&1 &
+  echo $! > $app.pid
+}


Now this I am really confused. I thought your initial PRs were just testing. It kind of distorts the story if we say we are running in a kube pod, but let's take same app and run in a vm. The story is much more powerful, streamlined and memorable if we just say, assume you now have to talk to legacy db vm or a legacy service that you have not seen yet so far in the example flow.

Sorry for the confusion - this is not for testing, but to allow people to see that some services can run on the VM, and you can have a 'mesh' of services that may include components running on-prem.

I don't mind removing (or not showing) the details on the VM, AFAIK it was part of the demo use case - but I agree the DB is more compelling.

Note that 'rating' won't work on the VM, since we don't yet support labels (like version)

Its still not too late. We can whip up a simple Go/python based price service that talks http to bookinfo, and its a very small change in the UI to show price (fits nicely with book "info"). This service can talk to the DB, and let it run in the VM itself

rshriram · 2017-09-20T23:10:48Z

samples/apps/bookinfo/install_cluster_extension.sh

@@ -0,0 +1,111 @@
+#!/bin/bash
+#


Okay, we definitely need a folder here. Too many scripts in the root. I asked Greg to move consul stuff to separate folder.

Maybe be good to move both consul and 'simple' VMs to same folder ?

no. rule formats are different. see bookinfo consul folder

Removed this completely - the setup extension instructions will take care of all that is needed, we only need the script
to setup mysql and whatever app we want to show.

For now I'm keeping details - but I agree a go app will be better ( for 0.3)

rshriram · 2017-09-20T23:11:27Z

samples/apps/bookinfo/cluster_extension.sh

+if [[ ${1:-} == "install" ]] ; then
+  istioInstallBookinfo
+fi
+


Who is calling the updateRatings function?

User or whoever is showing a demo ( to show that the DB is used, and you can still connect to it from the VM)

rshriram · 2017-09-20T23:13:15Z

samples/apps/bookinfo/install_cluster_extension.sh

+
+}
+
+# Helper to create the raw VM. You can also use an existing VM, or create using the UI.


Remove Raw.

rshriram · 2017-09-20T23:14:03Z

samples/apps/bookinfo/install_cluster_extension.sh

+# Helper to create the raw VM. You can also use an existing VM, or create using the UI.
+# Currently uses gcloud - can be extended with other environments.
+function istioVMInit() {
+  # TODO: check if it exists and do "reset", to speed up the script.


Rename to createGCloudVM

How about remove this completely - and add a comment that user should create the VM using the UI or CLI ? It may be convenient as a function - but it's pretty slow.
The only reason I kept it is to make sure firewall on 22 is set, and a deb/ubuntu image is used.

Yep. remove and we explain steps in doc.

linsun

Could we also give generate usage guideline of these scripts? It is not super clear how they are used in which sequence, and the requirements before using it.

linsun · 2017-09-21T01:25:04Z

install/tools/istio_vm_common.sh

@@ -189,18 +189,19 @@ function istioBootstrapVM() {

  istio_provision_certs $SA

-  local ISTIO_FILES=${ISTIO_FILES:-.}
+  local ISTIO_IO=${ISTIO_BASE:-${GOPATH:-$HOME/go}}/src/istio.io
+  local ISTIO_STAGING=${ISTIO_STAGING:-$ISTIO_IO/istio/bazel-bin/vm}


my understanding is the script will be packaged in our istio release binary, correct? If so, is bazel stuff mandatory? I'd hope not, if so, i would prefer a default dir not mention bazel to avoid confusion.

linsun · 2017-09-21T01:33:46Z

install/tools/istio_vm_common.sh


+  mkdir -p $ISTIO_STAGING


is source required? The comment isn't clear and the code seems to indicate yes.

Yes, this builds the .deb files from source. Will go away once we test the download of
release .deb.

Removed this part, download from release artifacts.

linsun · 2017-09-21T01:34:08Z

install/tools/istio_vm_common.sh

+function istioDownloadVMFiles() {
+  local ISTIO_IO=${ISTIO_BASE:-${GOPATH:-$HOME/go}}/src/istio.io
+  local ISTIO_STAGING=${ISTIO_STAGING:-$ISTIO_IO/istio/bazel-bin/vm}
+  local ISTIO_VERSION=${ISTIO_VERSION:-0.2.3}


can we not hard code version here?

I like to have defaults - but I could source istio.version file ( since this will be part of the samples ).

downloadIstio.sh (https://git.io/getIstio) also hardcodes the version, there is a TODO to update it automatically
one each release - when this is done we'll update here as well.

( in any case - removed this code, it is now part of downloadIstio )

linsun · 2017-09-21T01:36:09Z

samples/apps/bookinfo/cluster_extension.sh

+#
+################################################################################
+
+# Script to run on a VM with VPC connectivity to the cluster, to prepare the DB and details app.


VPC connectivity is confusing as it is not required. can we reword it to network connectivity?

…ookinfo

costinm

PTAL.

ldemailly · 2017-09-22T23:51:05Z

downloadIstio.sh

 echo "Downloading $NAME from $URL ..."
 curl -L "$URL" | tar xz
+
+# Current URL for the debian files artifacts. Will be replaced by a proper apt repo.
+DEBURL=http://gcsweb.istio.io/gcs/istio-release/releases/${ISTIO_VERSION}/deb


let's please not touch this file

rshriram · 2017-09-22T23:54:24Z

downloadIstio.sh

+curl -L ${DEBURL}/istio-agent-release.deb > istio-${ISTIO_VERSION}/istio-agent-release.deb
+curl -L ${DEBURL}/istio-auth-node-agent-release.deb > istio-${ISTIO_VERSION}/istio-auth-node-agent-release.deb
+curl -L ${DEBURL}/istio-proxy-release.deb > istio-${ISTIO_VERSION}/istio-proxy-release.deb
+


Sorry, I totally missed this.. downloadIstio is linked to our vanity URL. If anything, can you add a comment to this file to not modify anything except the version ?

that too modify by hand.. Say its linked to getIstio.sh

rshriram

Almost done. You have some stray YAML files. Also rename run_extensions.sh to setupApps.sh and undo mods to downloadIstio.sh

rshriram · 2017-09-23T00:00:49Z

samples/bookinfo/bookinfo-injected.yaml

+# Copyright 2017 Istio Authors
+#
+#   Licensed under the Apache License, Version 2.0 (the "License");
+#   you may not use this file except in compliance with the License.


whats this file for? And it has personal images as well.

rshriram · 2017-09-23T00:01:44Z

samples/bookinfo/clusterex/run_extensions.sh

@@ -0,0 +1,75 @@
+#!/bin/bash
+#


setup_app.sh

rshriram · 2017-09-23T00:02:21Z

samples/bookinfo/route-rule-ratings-v1.yaml

@@ -0,0 +1,17 @@
+type: route-rule
+name: ratings-test-v2


Why this file? We have a copy in bookinfo/kube/...

rshriram · 2017-09-23T00:18:23Z

/lgtm

istio-merge-robot · 2017-09-23T00:24:44Z

/lgtm cancel //PR changed after LGTM, removing LGTM. @costinm @rshriram

ldemailly · 2017-09-23T00:26:54Z

install/tools/setupIstioVM.sh

@@ -57,6 +57,14 @@ function istioInstall() {
  chown -R istio-proxy /etc/certs
  chown -R istio-proxy /var/lib/istio/envoy

+  ISTIO_VERSION=${ISTIO_VERSION:-0.2.4}


source istio.VERSION instead ?

From where ? This will be curl ... |sh

…l instead of functions

andraxylia · 2017-09-25T18:08:09Z

/lgtm

istio-merge-robot · 2017-09-25T18:08:37Z

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: andraxylia, rshriram

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these OWNERS Files:

~~OWNERS~~ [andraxylia,rshriram]

You can indicate your approval by writing /approve in a comment
You can cancel your approval by writing /approve cancel in a comment

istio-merge-robot · 2017-09-25T18:28:57Z

/test all [submit-queue is verifying that this PR is safe to merge]

istio-merge-robot · 2017-09-25T18:54:42Z

Automatic merge from submit-queue

Former-commit-id: 468f2e1ed80dd9df026c2aac56253cdfe8391f3d

Automatic merge from submit-queue Fixes for the common vm utils and scripts to install bookinfo Scripts cleaned up and migrated from proxy. Location and name of release files may still change (and only one file made it to current release candidate). ```release-note Added example scripts for installing bookinfo components on a cluster extension (VM) ``` Former-commit-id: 1ec4132

Former-commit-id: 67c41b8de5fee747d9d6b1b5497b5c414ad8bb2f

) Automatic merge from submit-queue Fixes for the common vm utils and scripts to install bookinfo Scripts cleaned up and migrated from proxy. Location and name of release files may still change (and only one file made it to current release candidate). ```release-note Added example scripts for installing bookinfo components on a cluster extension (VM) ``` Former-commit-id: 1ec4132

* ingress separation * remove stale istioct stuff * code shuffle * finish separation * typo * address comments * exclude ingress from race test

Automatic merge from submit-queue Fixes for the common vm utils and scripts to install bookinfo Scripts cleaned up and migrated from proxy. Location and name of release files may still change (and only one file made it to current release candidate). ```release-note Added example scripts for installing bookinfo components on a cluster extension (VM) ``` Former-commit-id: 1ec4132

* Doc fixes. * Add high-level overview and diagrams for MCP (istio#805) * document MCP * add additional note on NACK behavior * add a note about ignoring stale nonces * Add envoy metrics service configuration to ProxyConfig (istio#803) * Add envoy metrics service configuration to ProxyConfig Similar to the statsd sink config, this change is in preparation for adding support for the envoy metrics service API. * Update proto.lock * Reorder metrics_service_address just after statsd_udp_address * Update comment in the authN API to match with 1.1 behavior (istio#808) * Rename metrics_service_address to clarify that it is for Envoy's API (istio#809) Since "metrics service" is so ambiguous, this change specifically denotes that the config is for Envoy's metrics service API. The comments also now link to detailed info about the metrics service API. * Generate separate HTML page per proto under networking (istio#811) * Generate separate pages for each networking proto Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * update Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * tweaks Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * Fix interdoc references * separate doc and go gen * change dash to underscore * fix * more fixes * makefile fix Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * remove bad target * Revert "change dash to underscore" This reverts commit 7fbced66f620fb60b0d5e18af916567e313a0109. * final update Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * Revert "Generate separate HTML page per proto under networking (istio#811)" This reverts commit 5f14eadd since it breaks the ability to generate reference docs in istio.io * Update to latest tools. * Revert "Update to latest tools." This reverts commit 231fadc5 which I accidentally pushed to the wrong place. * fix mcp update error diagram (istio#810) * update istio/tools (istio#815) * Revert "Revert "Generate separate HTML page per proto under networking (istio#811)"" (istio#818) * Minor updates for building docker images. (istio#817) * Add spell checking for docs. (istio#819) * Add a bunch of words to the custom dictionary. * Document exportTo restrictions (istio#820) * Doc fixes. (istio#821) * Proxy config: Add tls_certs_to_watch field (istio#824) * Proxy config: Add tls_certs_to_watch field * Address PR comment * Revert "Proxy config: Add tls_certs_to_watch field (istio#824)" (istio#825) This reverts commit e613e358ae8d4f331dd48904b0a2b176e11bf7f5. * Update gateway and sidecar hosts doc (istio#826) * Update gateway and sidecar hosts doc * regen * review comments * Update API docs (service entry, gateway, sidecar) (istio#831) * Update sidecar and gateway docs Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * gen docs Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * update service entry Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * updates Signed-off-by: Shriram Rajagopalan <shriramr@vmware.com> * add configurable dns refresh rate to mesh for strict dns cluster, (istio#832) * add configurable dns refresh rate to mesh for strict dns cluster, issue istio#12181 * add lock file * Hosts are not ignored in ServiceEntry for HTTPs (istio#833) * Hosts are not ignored in ServiceEntry for HTTPs * Clarify * Reword * Generate protos * Address code review comments * Fix typo * generate * make mixer config marshal deterministic (istio#846) Signed-off-by: Kuat Yessenov <kuat@google.com> * Fix some doc errors. (istio#854) This started out to just fix a bad link to unblock work on istio.io, but I ended up fixing a bunch of typos/incorrect format throughout. * Fix two more broken links. (istio#856) * Fix CRD examples for release-1.1 (istio#859) * fix MeshNetworks demo (istio#841) * fix MeshNetworks demo * generate * update * last minute doc fixes (istio#865) Signed-off-by: Shriram Rajagopalan <rshriram@gmail.com> * Clarify comment for server_name field in Mixer oop auth config (istio#800) * add mixerclient config to istio.io reference docs (istio#827) * Envoyfilter docs fix (istio#867) * Tweaks to get the mixer client config docs to be published. (istio#868) * Change where the Mixer client docs are published.

Fixes for the common vm utils and scripts to install bookinfo

3eeaf34

googlebot added the cla: yes label Sep 19, 2017

costinm requested review from ldemailly and rshriram September 19, 2017 23:36

istio-merge-robot added the release-note label Sep 19, 2017

ldemailly reviewed Sep 19, 2017

View reviewed changes

Small fixes

c5b352c

ldemailly suggested changes Sep 20, 2017

View reviewed changes

ldemailly approved these changes Sep 20, 2017

View reviewed changes

Update the variable name, few more docs

ead159b

costinm requested a review from ZackButcher September 20, 2017 21:40

ZackButcher approved these changes Sep 20, 2017

View reviewed changes

rshriram suggested changes Sep 20, 2017

View reviewed changes

linsun requested changes Sep 21, 2017

View reviewed changes

costinm added 7 commits September 22, 2017 11:25

More info about generated files

53a50a5

Updates

2bbfcd9

Use downloaded files

058eedd

Merge branch 'master' of github.com:istio/istio into costin-cluster

561218d

Merge branch 'master' of github.com:istio/istio into costin-bookinfo

473e358

Merge branch 'costin-cluster' of github.com:istio/istio into costin-b…

b6f92ed

…ookinfo

More fixes/updates

f1a2db2

costinm commented Sep 22, 2017

View reviewed changes

Missed conflicts

f45e645

ldemailly suggested changes Sep 22, 2017

View reviewed changes

rshriram reviewed Sep 22, 2017

View reviewed changes

rshriram suggested changes Sep 23, 2017

View reviewed changes

Revert downloadIstio, renames

0ce494d

Another stray

9bcdb5e

rshriram approved these changes Sep 23, 2017

View reviewed changes

istio-testing assigned rshriram Sep 23, 2017

istio-testing added the lgtm label Sep 23, 2017

istio-merge-robot added the approved label Sep 23, 2017

Renames

08e3a7f

istio-merge-robot removed the lgtm label Sep 23, 2017

ldemailly reviewed Sep 23, 2017

View reviewed changes

Add help and command parameters, since it's now used as a normal shel…

1820386

…l instead of functions

rshriram approved these changes Sep 23, 2017

View reviewed changes

linsun approved these changes Sep 25, 2017

View reviewed changes

Merge branch 'master' into costin-bookinfo

c36d1e1

istio-testing assigned andraxylia Sep 25, 2017

istio-testing added the lgtm label Sep 25, 2017

istio-merge-robot merged commit 1ec4132 into master Sep 25, 2017

ldemailly deleted the costin-bookinfo branch October 3, 2017 22:07

mandarjog pushed a commit to mandarjog/istio that referenced this pull request Oct 30, 2017

Fix the cfg.pb.go (istio#872)

1848fcd

Former-commit-id: 468f2e1ed80dd9df026c2aac56253cdfe8391f3d

mandarjog pushed a commit that referenced this pull request Oct 31, 2017

Fix the cfg.pb.go (#872)

a328a7e

Former-commit-id: 67c41b8de5fee747d9d6b1b5497b5c414ad8bb2f

mandarjog pushed a commit that referenced this pull request Oct 31, 2017

Complete ingress controller separation (#872)

f5ae770

* ingress separation * remove stale istioct stuff * code shuffle * finish separation * typo * address comments * exclude ingress from race test


		}

		# Helper to create the raw VM. You can also use an existing VM, or create using the UI.

Fixes for the common vm utils and scripts to install bookinfo #872

Fixes for the common vm utils and scripts to install bookinfo #872

Uh oh!

Conversation

costinm commented Sep 19, 2017

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ldemailly commented Sep 19, 2017 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ldemailly left a comment

Choose a reason for hiding this comment

Uh oh!

costinm commented Sep 20, 2017

Uh oh!

ZackButcher left a comment

Choose a reason for hiding this comment

Uh oh!

ZackButcher commented Sep 20, 2017

Uh oh!

rshriram left a comment

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

ldemailly commented Sep 19, 2017 •

edited

Loading