Skip to content

Commit

Permalink
Test scripts etc.
Browse files Browse the repository at this point in the history
  • Loading branch information
@vishal-biyani
vishal-biyani committed Oct 27, 2020
1 parent 3359663 commit 2b4e753
Show file tree
Hide file tree
Showing 24 changed files with 411 additions and 79 deletions.
63 changes: 63 additions & 0 deletions samples/long-running-compute/jmeter.log
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
2020-10-16 21:40:47,200 INFO o.a.j.u.JMeterUtils: Setting Locale to en_EN
2020-10-16 21:40:47,247 INFO o.a.j.JMeter: Loading user properties from: /usr/local/Cellar/jmeter/5.3/libexec/bin/user.properties
2020-10-16 21:40:47,248 INFO o.a.j.JMeter: Loading system properties from: /usr/local/Cellar/jmeter/5.3/libexec/bin/system.properties
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: Copyright (c) 1998-2020 The Apache Software Foundation
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: Version 5.3
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: java.version=11.0.8
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: java.vm.name=OpenJDK 64-Bit Server VM
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: os.name=Mac OS X
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: os.arch=x86_64
2020-10-16 21:40:47,249 INFO o.a.j.JMeter: os.version=10.15.3
2020-10-16 21:40:47,250 INFO o.a.j.JMeter: file.encoding=UTF-8
2020-10-16 21:40:47,250 INFO o.a.j.JMeter: java.awt.headless=null
2020-10-16 21:40:47,250 INFO o.a.j.JMeter: Max memory =1073741824
2020-10-16 21:40:47,250 INFO o.a.j.JMeter: Available Processors =8
2020-10-16 21:40:47,262 INFO o.a.j.JMeter: Default Locale=English (EN)
2020-10-16 21:40:47,262 INFO o.a.j.JMeter: JMeter Locale=English (EN)
2020-10-16 21:40:47,262 INFO o.a.j.JMeter: JMeterHome=/usr/local/Cellar/jmeter/5.3/libexec
2020-10-16 21:40:47,262 INFO o.a.j.JMeter: user.dir =/Users/vishalb/code/fission_codebase/examples/samples/long-running-compute
2020-10-16 21:40:47,263 INFO o.a.j.JMeter: PWD =/Users/vishalb/code/fission_codebase/examples/samples/long-running-compute
2020-10-16 21:40:47,267 INFO o.a.j.JMeter: IP: 127.0.0.1 Name: Vishals-MacBook-Pro.local FullName: localhost
2020-10-16 21:40:47,982 INFO o.a.j.JMeter: Setting LAF to: com.github.weisj.darklaf.DarkLaf:com.github.weisj.darklaf.theme.DarculaTheme
2020-10-16 21:40:50,151 INFO o.a.j.JMeter: Loaded icon properties from org/apache/jmeter/images/icon.properties
2020-10-16 21:40:51,393 INFO o.j.r.JARSourceHTTP: Requesting https://jmeter-plugins.org/repo/?installID=mac_os_x-1007122775c217cc51aec5a93e7c81ca-gui
2020-10-16 21:40:54,058 INFO o.j.r.PluginManager: Plugins Status: [jpgc-plugins-manager=1.3, jmeter-core=5.3, jmeter-ftp=5.3, jmeter-http=5.3, jmeter-jdbc=5.3, jmeter-jms=5.3, jmeter-junit=5.3, jmeter-java=5.3, jmeter-ldap=5.3, jmeter-mail=5.3, jmeter-mongodb=5.3, jmeter-native=5.3, jmeter-tcp=5.3, jmeter-components=5.3]
2020-10-16 21:40:54,059 INFO o.j.r.PluginManagerMenuItem: Plugins Manager has upgrades: [jpgc-plugins-manager]
2020-10-16 21:41:08,331 INFO o.a.j.s.FileServer: Default base='/Users/vishalb/code/fission_codebase/examples/samples/long-running-compute'
2020-10-16 21:41:08,334 INFO o.a.j.g.a.Load: Loading file: /Users/vishalb/Downloads/Fission.jmx
2020-10-16 21:41:08,335 INFO o.a.j.s.FileServer: Set new base='/Users/vishalb/Downloads'
2020-10-16 21:41:08,488 INFO o.a.j.s.SaveService: Testplan (JMX) version: 2.2. Testlog (JTL) version: 2.2
2020-10-16 21:41:08,499 INFO o.a.j.s.SaveService: Using SaveService properties version 5.0
2020-10-16 21:41:08,501 INFO o.a.j.s.SaveService: Using SaveService properties file encoding UTF-8
2020-10-16 21:41:08,502 INFO o.a.j.s.SaveService: Loading file: /Users/vishalb/Downloads/Fission.jmx
2020-10-16 21:41:08,905 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/html is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2020-10-16 21:41:08,906 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for application/xhtml+xml is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2020-10-16 21:41:08,906 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for application/xml is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2020-10-16 21:41:08,906 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/xml is org.apache.jmeter.protocol.http.parser.LagartoBasedHtmlParser
2020-10-16 21:41:08,906 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/vnd.wap.wml is org.apache.jmeter.protocol.http.parser.RegexpHTMLParser
2020-10-16 21:41:08,906 INFO o.a.j.p.h.s.HTTPSamplerBase: Parser for text/css is org.apache.jmeter.protocol.http.parser.CssParser
2020-10-16 21:41:09,065 INFO o.a.j.s.SampleResult: Note: Sample TimeStamps are START times
2020-10-16 21:41:09,066 INFO o.a.j.s.SampleResult: sampleresult.default.encoding is set to ISO-8859-1
2020-10-16 21:41:09,066 INFO o.a.j.s.SampleResult: sampleresult.useNanoTime=true
2020-10-16 21:41:09,066 INFO o.a.j.s.SampleResult: sampleresult.nanoThreadSleep=5000
2020-10-16 21:41:09,224 INFO o.a.j.v.ViewResultsFullVisualizer: Add JavaFX to your Java installation if you want to use renderer: org.apache.jmeter.visualizers.RenderInBrowser
2020-10-16 21:41:09,295 INFO o.a.j.s.FileServer: Set new base='/Users/vishalb/Downloads'
2020-10-16 21:42:01,551 INFO o.a.j.e.StandardJMeterEngine: Running the test!
2020-10-16 21:42:01,552 INFO o.a.j.s.SampleEvent: List of sample_variables: []
2020-10-16 21:42:01,552 INFO o.a.j.s.SampleEvent: List of sample_variables: []
2020-10-16 21:42:01,557 INFO o.a.j.e.u.CompoundVariable: Note: Function class names must contain the string: '.functions.'
2020-10-16 21:42:01,557 INFO o.a.j.e.u.CompoundVariable: Note: Function class names must not contain the string: '.gui.'
2020-10-16 21:42:01,861 INFO o.a.j.g.u.JMeterMenuBar: setRunning(true, *local*)
2020-10-16 21:42:01,914 INFO o.a.j.e.StandardJMeterEngine: Starting ThreadGroup: 1 : Function#1
2020-10-16 21:42:01,914 INFO o.a.j.e.StandardJMeterEngine: Starting 1 threads for group Function#1.
2020-10-16 21:42:01,914 INFO o.a.j.e.StandardJMeterEngine: Thread will continue on error
2020-10-16 21:42:01,915 INFO o.a.j.t.ThreadGroup: Starting thread group... number=1 threads=1 ramp-up=1 delayedStart=false
2020-10-16 21:42:01,919 INFO o.a.j.t.ThreadGroup: Started thread group number 1
2020-10-16 21:42:01,919 INFO o.a.j.e.StandardJMeterEngine: All thread groups have been started
2020-10-16 21:42:01,920 INFO o.a.j.t.JMeterThread: Thread started: Function#1 1-1
2020-10-16 21:42:01,931 INFO o.a.j.p.h.s.HTTPHCAbstractImpl: Local host = Vishals-MacBook-Pro.local
2020-10-16 21:42:01,938 INFO o.a.j.p.h.s.HTTPHC4Impl: HTTP request retry count = 0
2020-10-16 21:42:18,357 INFO o.a.j.t.JMeterThread: Thread is done: Function#1 1-1
2020-10-16 21:42:18,357 INFO o.a.j.t.JMeterThread: Thread finished: Function#1 1-1
2020-10-16 21:42:18,358 INFO o.a.j.e.StandardJMeterEngine: Notifying test listeners of end of test
2020-10-16 21:42:18,359 INFO o.a.j.g.u.JMeterMenuBar: setRunning(false, *local*)
4 changes: 2 additions & 2 deletions samples/long-running-compute/specs/env-python-1.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ spec:
builder: {}
imagepullsecret: ""
keeparchive: false
poolsize: 250
poolsize: 25
resources:
limits:
cpu: 75m
Expand All @@ -17,6 +17,6 @@ spec:
cpu: 50m
memory: 64Mi
runtime:
image: fission/python-env
image: fission/python-env:1.11.0
terminationGracePeriod: 1
version: 3
4 changes: 2 additions & 2 deletions samples/long-running-compute/specs/env-python-2.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ spec:
builder: {}
imagepullsecret: ""
keeparchive: false
poolsize: 150
poolsize: 15
resources:
limits:
cpu: 100m
Expand All @@ -17,6 +17,6 @@ spec:
cpu: 75m
memory: 96Mi
runtime:
image: fission/python-env
image: fission/python-env:1.11.0
terminationGracePeriod: 1
version: 3
4 changes: 2 additions & 2 deletions samples/long-running-compute/specs/env-python-3.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ spec:
builder: {}
imagepullsecret: ""
keeparchive: false
poolsize: 150
poolsize: 15
resources:
limits:
cpu: 75m
Expand All @@ -17,6 +17,6 @@ spec:
cpu: 50m
memory: 64Mi
runtime:
image: fission/python-env
image: fission/python-env:1.11.0
terminationGracePeriod: 1
version: 3
4 changes: 2 additions & 2 deletions samples/long-running-compute/specs/env-python-4.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ spec:
builder: {}
imagepullsecret: ""
keeparchive: false
poolsize: 100
poolsize: 10
resources:
limits:
cpu: 75m
Expand All @@ -17,6 +17,6 @@ spec:
cpu: 50m
memory: 64Mi
runtime:
image: fission/python-env
image: fission/python-env:1.11.0
terminationGracePeriod: 1
version: 3
4 changes: 2 additions & 2 deletions samples/long-running-compute/specs/env-python-5.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@ spec:
builder: {}
imagepullsecret: ""
keeparchive: false
poolsize: 100
poolsize: 10
resources:
limits:
cpu: 75m
Expand All @@ -17,6 +17,6 @@ spec:
cpu: 50m
memory: 64Mi
runtime:
image: fission/python-env
image: fission/python-env:1.11.0
terminationGracePeriod: 1
version: 3
2 changes: 1 addition & 1 deletion samples/long-running-compute/specs/function-hello-1-15.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ spec:
SpecializationTimeout: 3600
TargetCPUPercent: 0
StrategyType: execution
concurrency: 2000
concurrency: 200
configmaps: null
environment:
name: python-1
Expand Down
2 changes: 1 addition & 1 deletion samples/long-running-compute/specs/function-hello-2-45.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ spec:
SpecializationTimeout: 3600
TargetCPUPercent: 0
StrategyType: execution
concurrency: 1200
concurrency: 120
configmaps: null
environment:
name: python-2
Expand Down
2 changes: 1 addition & 1 deletion samples/long-running-compute/specs/function-hello-3-75.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ spec:
SpecializationTimeout: 3600
TargetCPUPercent: 0
StrategyType: execution
concurrency: 1200
concurrency: 120
configmaps: null
environment:
name: python-3
Expand Down
2 changes: 1 addition & 1 deletion samples/long-running-compute/specs/function-hello-4-90.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ spec:
SpecializationTimeout: 3600
TargetCPUPercent: 0
StrategyType: execution
concurrency: 800
concurrency: 80
configmaps: null
environment:
name: python-4
Expand Down
2 changes: 1 addition & 1 deletion samples/long-running-compute/specs/function-hello-5-120.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -40,7 +40,7 @@ spec:
SpecializationTimeout: 3600
TargetCPUPercent: 0
StrategyType: execution
concurrency: 800
concurrency: 80
configmaps: null
environment:
name: python-5
Expand Down
62 changes: 5 additions & 57 deletions scripts/cluster-setup/README.md
View file
Original file line number Diff line number Diff line change
@@ -1,61 +1,9 @@
echo "GET http://a72c0989896a24498b58842b22da42a6-2126244409.ap-south-1.elb.amazonaws.com/fission-function/hello-1-15" | vegeta attack -duration=300s -timeout=3600s -rate=2500/m -max-workers=2000> hello-1-15.txt &
echo "GET http://LB_ADDRESS/fission-function/hello-1-15" | vegeta attack -duration=300s -timeout=3600s -rate=2500/1m -max-workers=13000> hello-1-15.txt &

echo "GET http://a72c0989896a24498b58842b22da42a6-2126244409.ap-south-1.elb.amazonaws.com/fission-function/hello-2-45" | vegeta attack -duration=300s -timeout=3600s -rate=1500/m -max-workers=2000> hello-2-45.txt &
echo "GET http://LB_ADDRESS/fission-function/hello-2-45" | vegeta attack -duration=300s -timeout=3600s -rate=1500/1m -max-workers=8000> hello-2-45.txt &

echo "GET http://a72c0989896a24498b58842b22da42a6-2126244409.ap-south-1.elb.amazonaws.com/fission-function/hello-3-75" | vegeta attack -duration=300s -timeout=3600s -rate=1500/m -max-workers=2000> hello-3-75.txt &
echo "GET http://LB_ADDRESS/fission-function/hello-3-75" | vegeta attack -duration=300s -timeout=3600s -rate=1500/1m -max-workers=8000> hello-3-75.txt &

echo "GET http://a72c0989896a24498b58842b22da42a6-2126244409.ap-south-1.elb.amazonaws.com/fission-function/hello-4-90" | vegeta attack -duration=300s -timeout=4800s -rate=1000/m -max-workers=2000> hello-4-90.txt &
echo "GET http://LB_ADDRESS/fission-function/hello-4-90" | vegeta attack -duration=300s -timeout=4800s -rate=1000/1m -max-workers=6000> hello-4-90.txt &

echo "GET http://a72c0989896a24498b58842b22da42a6-2126244409.ap-south-1.elb.amazonaws.com/fission-function/hello-5-120" | vegeta attack -duration=300s -timeout=4800s -rate=1000/m -max-workers=2000> hello-5-120.txt &

root@test-temp:~# vegeta report hello-5-120.txt
Requests [total, rate, throughput] 2001, 2.03, 0.59
Duration [total, attack, wait] 49m42s, 16m27s, 33m15s
Latencies [min, mean, 50, 90, 95, 99, max] 16m26s, 36m24s, 38m58s, 45m26s, 46m29s, 47m3s, 47m9s
Bytes In [total, mean] 20325, 10.16
Bytes Out [total, mean] 0, 0.00
Success [ratio] 87.86%
Status Codes [code:count] 200:1758 502:243
Error Set:
502 Bad Gateway

root@test-temp:~# vegeta report hello-4-90.txt
Requests [total, rate, throughput] 2001, 2.11, 0.65
Duration [total, attack, wait] 49m15s, 15m49s, 33m26s
Latencies [min, mean, 50, 90, 95, 99, max] 15m47s, 35m16s, 37m54s, 45m12s, 45m53s, 46m27s, 46m35s
Bytes In [total, mean] 15827, 7.91
Bytes Out [total, mean] 0, 0.00
Success [ratio] 96.50%
Status Codes [code:count] 200:1931 502:70
Error Set:
502 Bad Gateway

root@test-temp:~# vegeta report hello-3-75.txt
Requests [total, rate, throughput] 2001, 2.38, 0.68
Duration [total, attack, wait] 49m2s, 13m59s, 35m3s
Latencies [min, mean, 50, 90, 95, 99, max] 13m59s, 29m45s, 31m12s, 40m9s, 41m7s, 41m52s, 41m58s
Bytes In [total, mean] 14007, 7.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:2001
Error Set:

root@test-temp:~# vegeta report hello-2-45.txt
Requests [total, rate, throughput] 2001, 2.47, 0.69
Duration [total, attack, wait] 48m34s, 13m29s, 35m5s
Latencies [min, mean, 50, 90, 95, 99, max] 13m29s, 28m13s, 29m51s, 38m44s, 39m53s, 40m55s, 41m30s
Bytes In [total, mean] 14007, 7.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:2001
Error Set:

root@test-temp:~# vegeta report hello-1-15.txt
Requests [total, rate, throughput] 2001, 2.68, 0.68
Duration [total, attack, wait] 48m59s, 12m26s, 36m34s
Latencies [min, mean, 50, 90, 95, 99, max] 12m26s, 21m12s, 20m50s, 28m59s, 29m58s, 39m4s, 48m16s
Bytes In [total, mean] 14007, 7.00
Bytes Out [total, mean] 0, 0.00
Success [ratio] 100.00%
Status Codes [code:count] 200:2001
Error Set:
echo "GET http://LB_ADDRESS/fission-function/hello-5-120" | vegeta attack -duration=300s -timeout=4800s -rate=1000/1m -max-workers=6000> hello-5-120.txt &
2 changes: 1 addition & 1 deletion scripts/cluster-setup/cluster-as.yaml
View file
Original file line number Diff line number Diff line change
Expand Up @@ -155,7 +155,7 @@ spec:
- --cloud-provider=aws
- --skip-nodes-with-local-storage=false
- --expander=least-waste
- --node-group-auto-discovery=asg:tag=k8s.io/cluster-autoscaler/enabled,k8s.io/cluster-autoscaler/scale-test
- --node-group-auto-discovery=asg:tag=k8s.io/cluster-autoscaler/enabled,k8s.io/cluster-autoscaler/fission-scale
- --balance-similar-node-groups
- --skip-nodes-with-system-pods=false
volumeMounts:
Expand Down
8 changes: 5 additions & 3 deletions scripts/cluster-setup/setupcluster.sh
View file
Original file line number Diff line number Diff line change
Expand Up @@ -4,7 +4,7 @@ set -euo pipefail

echo "Starting Eksctl cluster setup"
# eksctl create cluster -f cluster.yaml # Till --asg-access is supported in YAML file, we need to use CLI
eksctl create cluster --name scale-test --version 1.17 --managed --asg-access --region ap-south-1 --node-type=c4.4xlarge --nodes-min 3 --nodes-max 20 --ssh-access
eksctl create cluster --name fission-scale --version 1.17 --managed --asg-access --region ap-south-1 --node-type=c4.4xlarge --nodes-min 1 --nodes-max 20 --ssh-access

echo "Getting nodes"
kubectl get nodes
Expand All @@ -20,7 +20,9 @@ helm install fission-metrics --namespace monitoring prometheus-community/kube-pr
--set prometheus.prometheusSpec.podMonitorSelectorNilUsesHelmValues=false \
--set prometheus.prometheusSpec.ruleSelectorNilUsesHelmValues=false

# helm install --namespace fission --name-template fission --set prometheus.enabled=false https://github.com/fission/fission/releases/download/1.10.0/fission-all-1.10.0.tgz
# kubectl annotate svc/router -nfission service.beta.kubernetes.io/aws-load-balancer-connection-idle-timeout: "3600"
helm install --namespace fission --name-template fission --set prometheus.enabled=false,nats.enabled=false,executor.podReadyTimeout=3600s,router.unTapServiceTimeout=4800s https://github.com/fission/fission/releases/download/1.11.2/fission-all-1.11.2.tgz

# kubectl annotate svc/router -nfission service.beta.kubernetes.io/aws-load-balancer-connection-idle-timeout: "4800"

# kubectl apply -f servicemonitors.yaml --namespace fission
# kubectl --namespace monitoring port-forward svc/fission-metrics-grafana 3000:80
3 changes: 0 additions & 3 deletions scripts/cluster-setup/setuptestcluster.sh
View file

This file was deleted.

63 changes: 63 additions & 0 deletions scripts/cluster-setup/sys_changes_ds.yaml
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,63 @@
apiVersion: apps/v1
kind: DaemonSet
metadata:
labels:
name: syschanges
name: system-changes-sysds-node-exporter
spec:
selector:
matchLabels:
component: "node-exporter"
app: sysds
updateStrategy:
type: RollingUpdate
template:
metadata:
labels:
component: "node-exporter"
app: sysds
heritage: Helm
spec:
containers:
- name: busybox
image: "busybox"
command:
- /bin/sh
- -c
- |
sysctl -w net.ipv4.tcp_max_tw_buckets=65535
#sysctl -w net.ipv4.tcp_tw_recycle=1
sysctl -w net.ipv4.tcp_tw_reuse=0
sysctl -w net.ipv4.tcp_max_syn_backlog=131072
sysctl -w net.ipv4.tcp_syn_retries=3
sysctl -w net.ipv4.tcp_synack_retries=3
sysctl -w net.ipv4.tcp_retries1=3
sysctl -w net.ipv4.tcp_retries2=8
sysctl -w net.ipv4.tcp_rmem="16384 174760 349520"
sysctl -w net.ipv4.tcp_wmem="16384 131072 262144"
sysctl -w net.ipv4.tcp_mem="262144 524288 1048576"
sysctl -w net.ipv4.tcp_max_orphans=65536
sysctl -w net.ipv4.tcp_fin_timeout=10
sysctl -w net.ipv4.tcp_low_latency=1
sysctl -w net.ipv4.tcp_syncookies=0
imagePullPolicy: "IfNotPresent"
securityContext:
privileged: true
resources:
{}
volumeMounts:
- name: proc
mountPath: /host/proc
readOnly: true
- name: sys
mountPath: /host/sys
readOnly: true
hostNetwork: true
hostPID: true
volumes:
- name: proc
hostPath:
path: /proc
- name: sys
hostPath:
path: /sys
Loading

0 comments on commit 2b4e753

Please sign in to comment.