From a007f4bad9acc49f154cd47033a3aad815aa71bb Mon Sep 17 00:00:00 2001 From: "Documenter.jl" Date: Wed, 15 Jan 2025 21:59:13 +0000 Subject: [PATCH] build based on 82ffe77 --- previews/PR3913/.documenter-siteinfo.json | 2 +- previews/PR3913/JuMP.pdf | Bin 7749192 -> 7748288 bytes .../PR3913/api/JuMP.Containers/index.html | 30 +- previews/PR3913/api/JuMP/index.html | 556 +- .../algebraic_modeling_languages/index.html | 2 +- .../PR3913/background/bibliography/index.html | 2 +- previews/PR3913/changelog/index.html | 2 +- .../PR3913/developers/checklists/index.html | 2 +- .../PR3913/developers/contributing/index.html | 2 +- .../custom_solver_binaries/index.html | 2 +- .../PR3913/developers/extensions/index.html | 2 +- previews/PR3913/developers/roadmap/index.html | 2 +- previews/PR3913/developers/style/index.html | 2 +- .../extensions/DimensionalData/index.html | 2 +- .../PR3913/extensions/introduction/index.html | 2 +- previews/PR3913/index.html | 2 +- previews/PR3913/installation/index.html | 2 +- previews/PR3913/manual/callbacks/index.html | 2 +- previews/PR3913/manual/complex/index.html | 2 +- previews/PR3913/manual/constraints/index.html | 2 +- previews/PR3913/manual/containers/index.html | 2 +- previews/PR3913/manual/expressions/index.html | 2 +- previews/PR3913/manual/models/index.html | 2 +- previews/PR3913/manual/nlp/index.html | 2 +- previews/PR3913/manual/nonlinear/index.html | 2 +- previews/PR3913/manual/objective/index.html | 2 +- previews/PR3913/manual/solutions/index.html | 2 +- previews/PR3913/manual/variables/index.html | 2 +- .../PR3913/moi/background/duality/index.html | 2 +- .../infeasibility_certificates/index.html | 2 +- .../moi/background/motivation/index.html | 2 +- .../background/naming_conventions/index.html | 2 +- previews/PR3913/moi/changelog/index.html | 2 +- .../moi/developer/checklists/index.html | 2 +- previews/PR3913/moi/index.html | 2 +- .../PR3913/moi/manual/constraints/index.html | 2 +- previews/PR3913/moi/manual/models/index.html | 2 +- .../PR3913/moi/manual/modification/index.html | 2 +- .../PR3913/moi/manual/solutions/index.html | 2 +- .../moi/manual/standard_form/index.html | 2 +- .../PR3913/moi/manual/variables/index.html | 2 +- .../PR3913/moi/reference/callbacks/index.html | 2 +- .../moi/reference/constraints/index.html | 2 +- .../PR3913/moi/reference/errors/index.html | 2 +- .../PR3913/moi/reference/models/index.html | 4 +- .../moi/reference/modification/index.html | 2 +- .../PR3913/moi/reference/nonlinear/index.html | 2 +- .../moi/reference/standard_form/index.html | 2 +- .../PR3913/moi/reference/variables/index.html | 2 +- previews/PR3913/moi/release_notes/index.html | 2 +- .../submodules/Benchmarks/overview/index.html | 2 +- .../Benchmarks/reference/index.html | 2 +- .../Bridges/implementation/index.html | 2 +- .../Bridges/list_of_bridges/index.html | 2 +- .../submodules/Bridges/overview/index.html | 2 +- .../submodules/Bridges/reference/index.html | 2 +- .../FileFormats/overview/index.html | 2 +- .../FileFormats/reference/index.html | 2 +- .../submodules/Nonlinear/overview/index.html | 2 +- .../submodules/Nonlinear/reference/index.html | 2 +- .../moi/submodules/Test/overview/index.html | 2 +- .../moi/submodules/Test/reference/index.html | 2 +- .../submodules/Utilities/overview/index.html | 2 +- .../submodules/Utilities/reference/index.html | 4 +- .../tutorials/bridging_constraint/index.html | 2 +- .../PR3913/moi/tutorials/example/index.html | 2 +- .../moi/tutorials/implementing/index.html | 2 +- .../PR3913/moi/tutorials/latency/index.html | 2 +- .../manipulating_expressions/index.html | 2 +- .../moi/tutorials/mathprogbase/index.html | 2 +- previews/PR3913/packages/Alpine/index.html | 2 +- .../PR3913/packages/AmplNLWriter/index.html | 2 +- previews/PR3913/packages/BARON/index.html | 2 +- .../PR3913/packages/BilevelJuMP/index.html | 2 +- .../packages/CATrustRegionMethod/index.html | 2 +- previews/PR3913/packages/CDCS/index.html | 2 +- previews/PR3913/packages/CDDLib/index.html | 2 +- previews/PR3913/packages/COPT/index.html | 2 +- previews/PR3913/packages/COSMO/index.html | 2 +- previews/PR3913/packages/CPLEX/index.html | 2 +- previews/PR3913/packages/CSDP/index.html | 2 +- previews/PR3913/packages/Cbc/index.html | 2 +- previews/PR3913/packages/Clarabel/index.html | 2 +- previews/PR3913/packages/Clp/index.html | 2 +- previews/PR3913/packages/DAQP/index.html | 2 +- previews/PR3913/packages/DSDP/index.html | 2 +- previews/PR3913/packages/DiffOpt/index.html | 2 +- .../DisjunctiveProgramming/index.html | 2 +- .../PR3913/packages/Dualization/index.html | 2 +- previews/PR3913/packages/EAGO/index.html | 2 +- previews/PR3913/packages/ECOS/index.html | 2 +- previews/PR3913/packages/GAMS/index.html | 2 +- previews/PR3913/packages/GLPK/index.html | 2 +- previews/PR3913/packages/Gurobi/index.html | 2 +- previews/PR3913/packages/HiGHS/index.html | 2 +- previews/PR3913/packages/Hypatia/index.html | 2 +- .../PR3913/packages/InfiniteOpt/index.html | 2 +- previews/PR3913/packages/Ipopt/index.html | 2 +- previews/PR3913/packages/Juniper/index.html | 2 +- previews/PR3913/packages/KNITRO/index.html | 2 +- previews/PR3913/packages/Loraine/index.html | 2 +- previews/PR3913/packages/MAiNGO/index.html | 2 +- previews/PR3913/packages/MadNLP/index.html | 2 +- previews/PR3913/packages/Manopt/index.html | 2 +- previews/PR3913/packages/MathOptAI/index.html | 2 +- .../packages/MathOptSymbolicAD/index.html | 2 +- previews/PR3913/packages/MiniZinc/index.html | 2 +- .../PR3913/packages/MosekTools/index.html | 2 +- .../MultiObjectiveAlgorithms/index.html | 2 +- .../PR3913/packages/NEOSServer/index.html | 2 +- previews/PR3913/packages/NLopt/index.html | 2 +- previews/PR3913/packages/OSQP/index.html | 2 +- previews/PR3913/packages/Optim/index.html | 2 +- .../PR3913/packages/PATHSolver/index.html | 2 +- previews/PR3913/packages/Pajarito/index.html | 2 +- .../ParametricOptInterface/index.html | 2 +- previews/PR3913/packages/Pavito/index.html | 2 +- previews/PR3913/packages/Percival/index.html | 2 +- .../packages/PiecewiseLinearOpt/index.html | 2 +- previews/PR3913/packages/Plasmo/index.html | 2 +- previews/PR3913/packages/PolyJuMP/index.html | 2 +- previews/PR3913/packages/ProxSDP/index.html | 2 +- previews/PR3913/packages/SCIP/index.html | 2 +- previews/PR3913/packages/SCS/index.html | 2 +- previews/PR3913/packages/SDDP/index.html | 2 +- previews/PR3913/packages/SDPA/index.html | 2 +- previews/PR3913/packages/SDPLR/index.html | 2 +- previews/PR3913/packages/SDPNAL/index.html | 2 +- previews/PR3913/packages/SDPT3/index.html | 2 +- previews/PR3913/packages/SeDuMi/index.html | 2 +- .../PR3913/packages/SumOfSquares/index.html | 2 +- previews/PR3913/packages/Tulip/index.html | 2 +- previews/PR3913/packages/Xpress/index.html | 2 +- previews/PR3913/packages/solvers/index.html | 2 +- previews/PR3913/release_notes/index.html | 2 +- previews/PR3913/should_i_use/index.html | 2 +- .../benders_decomposition/index.html | 4 +- .../{044e7623.svg => 09820ee9.svg} | 1002 +- .../{37cf2941.svg => 509b86df.svg} | 670 +- .../index.html | 12 +- .../algorithms/parallelism/index.html | 2 +- .../tutorials/algorithms/pdhg/index.html | 8 +- .../{b7eca051.svg => 10c2f496.svg} | 650 +- .../{cd050494.svg => 121e9cd2.svg} | 200 +- .../{1fb109f8.svg => b5882ca1.svg} | 132 +- .../algorithms/rolling_horizon/index.html | 4 +- .../{18c34496.svg => 0c3aa301.svg} | 454 +- .../{6412e860.svg => a2c31288.svg} | 454 +- .../tsp_lazy_constraints/index.html | 6 +- .../optimal_power_flow/index.html | 6 +- .../{1effff4a.svg => 75ade8a1.svg} | 120 +- .../{7fb7d857.svg => 89a6126d.svg} | 56 +- .../{5f59aa73.svg => ce91252c.svg} | 124 +- .../applications/power_systems/index.html | 10 +- .../two_stage_stochastic/048f5528.svg | 130 + .../two_stage_stochastic/0d0ebf54.svg | 93 + .../two_stage_stochastic/215ff7c1.svg | 73 - .../two_stage_stochastic/299a251d.svg | 102 - .../two_stage_stochastic/3fdcc408.svg | 89 + .../two_stage_stochastic/a0085235.svg | 99 - .../two_stage_stochastic/ac1a4494.svg | 105 + .../two_stage_stochastic/d21f542e.svg | 77 - .../two_stage_stochastic/index.html | 62 +- .../tutorials/applications/web_app/index.html | 4 +- .../conic/arbitrary_precision/index.html | 4 +- .../tutorials/conic/dualization/index.html | 50 +- .../{66a5da6e.svg => 819d86ac.svg} | 4856 +- .../{d9cb1324.svg => b016d902.svg} | 4854 +- .../tutorials/conic/ellipse_approx/index.html | 12 +- .../{3ff39ff8.svg => 2a7deebf.svg} | 558 +- .../{053e2c86.svg => 437667c7.svg} | 66 +- .../{e0fdb18e.svg => 8964808c.svg} | 586 +- .../{b171446c.svg => a5a41812.svg} | 544 +- .../conic/ellipse_fitting/index.html | 8 +- .../conic/experiment_design/index.html | 2 +- .../tutorials/conic/introduction/index.html | 2 +- .../conic/logistic_regression/index.html | 2 +- .../{eb7e74c3.svg => 06656430.svg} | 70 +- .../{574a59c0.svg => 586c4693.svg} | 76 +- .../tutorials/conic/min_ellipse/index.html | 6 +- .../conic/quantum_discrimination/index.html | 6 +- .../{d6d86983.svg => c7c00151.svg} | 70 +- .../conic/simple_examples/index.html | 4 +- .../tutorials/conic/start_values/index.html | 16 +- .../conic/tips_and_tricks/index.html | 2 +- .../getting_started/debugging/index.html | 2 +- .../index.html | 2 +- .../getting_started_with_JuMP/index.html | 2 +- .../{15d638fa.svg => 25f00548.svg} | 118 +- .../{981f72b9.svg => 27fdea48.svg} | 88 +- .../{8301dab4.svg => 6111ee70.svg} | 94 +- .../index.html | 10 +- .../getting_started_with_julia/index.html | 8 +- .../index.html | 2 +- .../getting_started/introduction/index.html | 2 +- .../performance_tips/index.html | 2 +- .../sum_if/{8c11c9f5.svg => 242b0d1c.svg} | 108 +- .../sum_if/{624e5e6f.svg => 93bd60b7.svg} | 82 +- .../getting_started/sum_if/index.html | 8 +- .../getting_started/tolerances/index.html | 62 +- .../PR3913/tutorials/linear/basis/index.html | 6 +- .../tutorials/linear/callbacks/index.html | 2 +- .../tutorials/linear/cannery/index.html | 4 +- .../linear/constraint_programming/index.html | 2 +- .../PR3913/tutorials/linear/diet/index.html | 8 +- .../{18832766.svg => cb358076.svg} | 94 +- .../{42b7f33e.svg => d4f1b99a.svg} | 108 +- .../{86d4cc0f.svg => eabed534.svg} | 84 +- .../{96d80ca9.svg => f2db4430.svg} | 108 +- .../linear/facility_location/index.html | 8 +- .../{bc43d3ce.svg => 3434ebab.svg} | 296 +- .../{a152d491.svg => b4a6db29.svg} | 124 +- .../{244add1b.svg => f4e04e03.svg} | 292 +- .../linear/factory_schedule/index.html | 6 +- .../tutorials/linear/finance/index.html | 2 +- .../linear/geographic_clustering/index.html | 2 +- .../tutorials/linear/introduction/index.html | 2 +- .../tutorials/linear/knapsack/index.html | 4 +- .../linear/lp_sensitivity/index.html | 6 +- .../tutorials/linear/mip_duality/index.html | 2 +- .../PR3913/tutorials/linear/multi/index.html | 6 +- .../linear/multi_commodity_network/index.html | 4 +- .../multi_objective_examples/index.html | 8 +- .../{368eaf8b.svg => 0a5f4828.svg} | 78 +- .../{968541ac.svg => 6b5572c3.svg} | 80 +- .../multi_objective_knapsack/index.html | 8 +- .../linear/multiple_solutions/index.html | 6 +- .../tutorials/linear/n-queens/index.html | 2 +- .../tutorials/linear/network_flows/index.html | 2 +- .../{8d34fc47.svg => 08cb723e.svg} | 92 +- .../{a3410f05.svg => 145efc97.svg} | 60 +- .../{1fbfad87.svg => 229e7e85.svg} | 100 +- .../{e1f6800a.svg => 2a133e6b.svg} | 90 +- .../{3c371474.svg => 3f4cab50.svg} | 62 +- .../{43f926ad.svg => 44d93585.svg} | 58 +- .../{d214f116.svg => 5e266235.svg} | 66 +- .../{44499cb8.svg => 78fddfac.svg} | 66 +- .../{59d6ab76.svg => ad9e1c1c.svg} | 96 +- .../{5eb21fdb.svg => b273285d.svg} | 70 +- .../{fb2f660c.svg => e83becbc.svg} | 96 +- .../{83f88874.svg => fe59417d.svg} | 56 +- .../linear/piecewise_linear/index.html | 24 +- .../PR3913/tutorials/linear/sudoku/index.html | 2 +- .../linear/tips_and_tricks/index.html | 2 +- .../PR3913/tutorials/linear/transp/index.html | 2 +- .../{5248406a.svg => 1713b0a7.svg} | 1056 +- .../{94ba83d3.svg => 545de146.svg} | 254 +- .../{0909b61c.svg => 64f2376e.svg} | 1072 +- .../{4192623d.svg => 73490faa.svg} | 256 +- .../{a4133707.svg => 9da9adbb.svg} | 1058 +- .../{3a0abafd.svg => bdfd0cfd.svg} | 41796 ++++++++-------- .../{c2104be5.svg => d7ca7dbf.svg} | 1070 +- .../{d02cbec6.svg => f0d80e24.svg} | 2054 +- .../{b2535aea.svg => f9aff325.svg} | 1056 +- .../nonlinear/classifiers/index.html | 18 +- .../nonlinear/complementarity/index.html | 4 +- .../nonlinear/introduction/index.html | 2 +- .../nonlinear/nested_problems/index.html | 6 +- .../nonlinear/operator_ad/index.html | 2 +- .../portfolio/{fae64cdb.svg => 4709c5c7.svg} | 1126 +- .../tutorials/nonlinear/portfolio/index.html | 6 +- .../nonlinear/querying_hessians/index.html | 2 +- .../{cd2597b6.svg => e9a339cb.svg} | 206 +- .../nonlinear/rocket_control/index.html | 4 +- .../nonlinear/simple_examples/index.html | 2 +- .../{e676b1de.svg => 9924f312.svg} | 294 +- .../{86e291c1.svg => c6d6fc0e.svg} | 148 +- .../{71af12c5.svg => dd4a8967.svg} | 66 +- .../index.html | 6 +- .../nonlinear/tips_and_tricks/index.html | 2 +- .../user_defined_hessians/index.html | 4 +- .../transitioning_from_matlab/index.html | 4 +- 272 files changed, 35962 insertions(+), 35896 deletions(-) rename previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/{044e7623.svg => 09820ee9.svg} (69%) rename previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/{37cf2941.svg => 509b86df.svg} (72%) rename previews/PR3913/tutorials/algorithms/rolling_horizon/{b7eca051.svg => 10c2f496.svg} (87%) rename previews/PR3913/tutorials/algorithms/rolling_horizon/{cd050494.svg => 121e9cd2.svg} (86%) rename previews/PR3913/tutorials/algorithms/rolling_horizon/{1fb109f8.svg => b5882ca1.svg} (90%) rename previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/{18c34496.svg => 0c3aa301.svg} (72%) rename previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/{6412e860.svg => a2c31288.svg} (72%) rename previews/PR3913/tutorials/applications/power_systems/{1effff4a.svg => 75ade8a1.svg} (86%) rename previews/PR3913/tutorials/applications/power_systems/{7fb7d857.svg => 89a6126d.svg} (85%) rename previews/PR3913/tutorials/applications/power_systems/{5f59aa73.svg => ce91252c.svg} (86%) create mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/048f5528.svg create mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/0d0ebf54.svg delete mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/215ff7c1.svg delete mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/299a251d.svg create mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/3fdcc408.svg delete mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/a0085235.svg create mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/ac1a4494.svg delete mode 100644 previews/PR3913/tutorials/applications/two_stage_stochastic/d21f542e.svg rename previews/PR3913/tutorials/conic/ellipse_approx/{66a5da6e.svg => 819d86ac.svg} (57%) rename previews/PR3913/tutorials/conic/ellipse_approx/{d9cb1324.svg => b016d902.svg} (57%) rename previews/PR3913/tutorials/conic/ellipse_fitting/{3ff39ff8.svg => 2a7deebf.svg} (80%) rename previews/PR3913/tutorials/conic/ellipse_fitting/{053e2c86.svg => 437667c7.svg} (98%) rename previews/PR3913/tutorials/conic/ellipse_fitting/{e0fdb18e.svg => 8964808c.svg} (82%) rename previews/PR3913/tutorials/conic/ellipse_fitting/{b171446c.svg => a5a41812.svg} (80%) rename previews/PR3913/tutorials/conic/min_ellipse/{eb7e74c3.svg => 06656430.svg} (88%) rename previews/PR3913/tutorials/conic/min_ellipse/{574a59c0.svg => 586c4693.svg} (88%) rename previews/PR3913/tutorials/conic/simple_examples/{d6d86983.svg => c7c00151.svg} (79%) rename previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/{15d638fa.svg => 25f00548.svg} (82%) rename previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/{981f72b9.svg => 27fdea48.svg} (85%) rename previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/{8301dab4.svg => 6111ee70.svg} (84%) rename previews/PR3913/tutorials/getting_started/sum_if/{8c11c9f5.svg => 242b0d1c.svg} (60%) rename previews/PR3913/tutorials/getting_started/sum_if/{624e5e6f.svg => 93bd60b7.svg} (55%) rename previews/PR3913/tutorials/linear/facility_location/{18832766.svg => cb358076.svg} (81%) rename previews/PR3913/tutorials/linear/facility_location/{42b7f33e.svg => d4f1b99a.svg} (79%) rename previews/PR3913/tutorials/linear/facility_location/{86d4cc0f.svg => eabed534.svg} (80%) rename previews/PR3913/tutorials/linear/facility_location/{96d80ca9.svg => f2db4430.svg} (79%) rename previews/PR3913/tutorials/linear/factory_schedule/{bc43d3ce.svg => 3434ebab.svg} (78%) rename previews/PR3913/tutorials/linear/factory_schedule/{a152d491.svg => b4a6db29.svg} (85%) rename previews/PR3913/tutorials/linear/factory_schedule/{244add1b.svg => f4e04e03.svg} (78%) rename previews/PR3913/tutorials/linear/multi_objective_knapsack/{368eaf8b.svg => 0a5f4828.svg} (87%) rename previews/PR3913/tutorials/linear/multi_objective_knapsack/{968541ac.svg => 6b5572c3.svg} (83%) rename previews/PR3913/tutorials/linear/piecewise_linear/{8d34fc47.svg => 08cb723e.svg} (82%) rename previews/PR3913/tutorials/linear/piecewise_linear/{a3410f05.svg => 145efc97.svg} (81%) rename previews/PR3913/tutorials/linear/piecewise_linear/{1fbfad87.svg => 229e7e85.svg} (84%) rename previews/PR3913/tutorials/linear/piecewise_linear/{e1f6800a.svg => 2a133e6b.svg} (78%) rename previews/PR3913/tutorials/linear/piecewise_linear/{3c371474.svg => 3f4cab50.svg} (85%) rename previews/PR3913/tutorials/linear/piecewise_linear/{43f926ad.svg => 44d93585.svg} (85%) rename previews/PR3913/tutorials/linear/piecewise_linear/{d214f116.svg => 5e266235.svg} (82%) rename previews/PR3913/tutorials/linear/piecewise_linear/{44499cb8.svg => 78fddfac.svg} (94%) rename previews/PR3913/tutorials/linear/piecewise_linear/{59d6ab76.svg => ad9e1c1c.svg} (92%) rename previews/PR3913/tutorials/linear/piecewise_linear/{5eb21fdb.svg => b273285d.svg} (86%) rename previews/PR3913/tutorials/linear/piecewise_linear/{fb2f660c.svg => e83becbc.svg} (80%) rename previews/PR3913/tutorials/linear/piecewise_linear/{83f88874.svg => fe59417d.svg} (86%) rename previews/PR3913/tutorials/nonlinear/classifiers/{5248406a.svg => 1713b0a7.svg} (62%) rename previews/PR3913/tutorials/nonlinear/classifiers/{94ba83d3.svg => 545de146.svg} (72%) rename previews/PR3913/tutorials/nonlinear/classifiers/{0909b61c.svg => 64f2376e.svg} (63%) rename previews/PR3913/tutorials/nonlinear/classifiers/{4192623d.svg => 73490faa.svg} (73%) rename previews/PR3913/tutorials/nonlinear/classifiers/{a4133707.svg => 9da9adbb.svg} (62%) rename previews/PR3913/tutorials/nonlinear/classifiers/{3a0abafd.svg => bdfd0cfd.svg} (69%) rename previews/PR3913/tutorials/nonlinear/classifiers/{c2104be5.svg => d7ca7dbf.svg} (62%) rename previews/PR3913/tutorials/nonlinear/classifiers/{d02cbec6.svg => f0d80e24.svg} (61%) rename previews/PR3913/tutorials/nonlinear/classifiers/{b2535aea.svg => f9aff325.svg} (62%) rename previews/PR3913/tutorials/nonlinear/portfolio/{fae64cdb.svg => 4709c5c7.svg} (79%) rename previews/PR3913/tutorials/nonlinear/rocket_control/{cd2597b6.svg => e9a339cb.svg} (89%) rename previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/{e676b1de.svg => 9924f312.svg} (88%) rename previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/{86e291c1.svg => c6d6fc0e.svg} (88%) rename previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/{71af12c5.svg => dd4a8967.svg} (87%) diff --git a/previews/PR3913/.documenter-siteinfo.json b/previews/PR3913/.documenter-siteinfo.json index 14c647c4062..96e50bb2df2 100644 --- a/previews/PR3913/.documenter-siteinfo.json +++ b/previews/PR3913/.documenter-siteinfo.json @@ -1 +1 @@ -{"documenter":{"julia_version":"1.11.2","generation_timestamp":"2025-01-15T20:17:53","documenter_version":"1.8.0"}} \ No newline at end of file +{"documenter":{"julia_version":"1.11.2","generation_timestamp":"2025-01-15T21:36:00","documenter_version":"1.8.0"}} \ No newline at end of file diff --git a/previews/PR3913/JuMP.pdf b/previews/PR3913/JuMP.pdf index c8b94db3cfaa616ceed558e7e654f0730effba76..acdf608a2865cf03b466a7917f7c339095a9f929 100644 GIT binary patch delta 247589 zcmV)hK%>9N{MZA)_1FV|v;i-D0y8<6QJ`ihe@l-z>jd~h;(w6X=#loJpE3T?ZNA(MqPRA>AfKeVDU1Cf4uy(ldQ&viw#o{ zHhQPmba37Xq*Zj#@n8+!4N^A9*&-LK@IuNKpXCL)8IlDXq%qtBAIv$AppmU7X`OnZ zPR7q#ERQn>Es5Tl#wFRW+1*(yoT+vve+v=!BoRq*DIAcWCT+47^pq?o$&v?OZH|&E z#pYF(MNeJTM;sWK@I2JK(c=e`;=1 zC1UBayfo5~Z0F=43x_aTxZsLIFy|CL*~O}R?X{A<4(Z9H83TO+=HJT*JV#wmws~i} z)TY`q1-a2G2UH5(^?9sxM_c7qH>X-=*mkt4jq-?WBYc8>ylh?qva_>pp;$e)(km87 zvmXYX{mh!hw`~TpGN*}mD1O(`EQYv{HPJAv+uRzfGp<4S2EE2MEs_^LAG9qq=y^^) zW?&T25jN88)A02CvX_E?0dfML-&5hPBwVqA#TjiO%%No-fb9uJ^rp064oG!7+u}*S|&|JTxv<#w3KLsJ_)t!`!}O@ z8j*77nctjht7{0ol;Twk=V>*^+S_xMUPwvKW7&C%#HqG`Md_CFsq38WJkY6HKT3bf zk_8gw<9#@eatMR3|2iDEfM{Ui195zysLahcK2mxe$A{i`;P^lZs6;`h06m2FdyqO~ z??~CMQm&&SuH`~ljC#Lj=&AzZQZskAW(vGeu++@Is+m$zM8DANo?Ij`7tIVCDS6nM za#nEEo;c;ih83mHgHw-*zOM~Cm)d`Wl6u=0ZekWND|x*#%axhmV0KH!G8QuyVF3r; z@nAz)Gvr(}%T9sUENStZpDrEphHjx;@jmr9^4qSiz7=<|06~Zhet+kL-(P<4xNkV>Q+LmFFsEx_tef`QQuL+OM9P0aHms&??p}Hq+%5??ZTa#B zSLU=9VFM9l`FZL@%DU~Fa-ZL95CCCu=B^uLObneNG^VB)t06Y(m!bprE`~U@9ar@< zTc4KwTC8e7pY$BuSJsZD$GO|HZEM)sTDznU^E|72j(ledT>5h-S636>hAcK#M*!edLglX=5*%s%0H*unnprh zDs1VbgF(a_$-=y%TJz`TIcxshd^7v=ztjKM%FkAN%4r|b&}y-38x*Zv?k+l;u$=w& zUHW@NMXIF{(mt>tofEucA7D;MetfkYop-KP@cVzOLKU@;5&rM0LWTYWx>d8`Ve3le zL16XWwmUZ{U-#8(zNm2Km30qv#)0A;-Z)UY;*LXa^hfj(Oe?4*|GH=8qI3`{*1i1M zwr+U9(q2hS;J(2!us8dh7V%ZTMaoHyTgxGA$P0gNm2D<#($pnY%#$dO;3MmLcsLwZ z=3amOrf}nQ?OOm9{F@I@SLym%DnxkVBUYf4sNx|XMf2gg^1LOIH>``bWYeDLWSLy~ z@*o{mQj45#qP&*)jI$z`apL6h${;Ty)~>@S>)$qQZ4%~_Hcr^;sVQx8YGr1prsr05 z)Ea4>VmjNsbr;B)#Cb@^gm%{XKV=sP9HJ?Megw=h+zbTm&3iF(LR%omTQM74-;ZZt z5zoAu9e#y|Fez*DH%8@KmW2TnfBS5tU{IzgabhIxjC{=3E$5fHj8#u}QaRs|#o5Nj z3k~gnu{+?(+NKp?`9#8X0k1NWbJo(?E=Jdu&@BaA`^cebZa6pDX8$+N6?6*{rd1Xh zao9YrwEK^jn7;33xKZjpNinvgX4Z6v?o%BeUk(wE?bvc&6&BvMz-FkQf8^Xfo5~6u zZU4PrJ@)LfU8_!89%-2`-MfWbXPcs1xU)9R`+@*Q7~R!Q^SDwh7ul&>_HDi;38k4I z?$js_S+Cb=-!eMYynNjgkGSM?5HK6z($lxERdkU}m4j(lqO*R$RD7sAx}JS12RWIL zCnOC5@1w@MXD}*ZA&e9Fe^xWo?Z!inG7v)MdP5q5TJ3{96>4;i~}@m(_*=6_CacK!SQqC2er1AAJ6ZBe`)_>P2d%VM~vCO zcrfm{$_n0UcO3(hU&);@huAxRcJ$5Jzp1w4H7i2aR7>LzB5-Sv$*056ZGKMds>7G?%Nd#GRR=!W2D4Sn2L1CH6I^Z27`Y2MXo<|3np`!UL&$n{B zdp(38@NHKv5L9mJ1jMK*5^=j1fvy2 zi6IITU-eIBcQMji5+X;4k&r$N26P8OvTTxJMe%Jxv8{H0Mn&z6y_;RK~eOaFE+wFMpDr>8C#G*ew0w0KoADWkU11NHXZXVnugItUn?X5*0Rrm$Md9ae_(_yWDgX>Os)MvE?KqGrr{=Urx`6 z<0v`oB;OSlnBKQQ^mpwHCluTU6%JpNVo8*^5pEAI4KyHdo`CcFI~9cRm`gEJOv2g@<^>J{XL> z7O$>5%%!4SEYvb4L)y~NL!Mcwvd?3jOT&hL6^cEc@y9Qp%BYKML-uroX9y>^Mt}!+ zVvt52H%#n{QGn~A8T(zqMK1{WI%AXM(lV0P#k#(Yikiw-5tY>874`TuYhPz!=F0pu zBbQ3Qbigv?wmH88be)g7t3but4XJ&!F^mh%#TRuq&s1xVLC>86*(XMr%^@MLSk0q< z(K>Xnc9w=0Oy;D&G03;?V00WBxp5e^kiQ_Cz^GIRLD>#G2#1-v>rU&X^_<5C9#Q-HXtnoG)Np{DJaZ<^m`0o0KNRKc7l zmQ?Kkr{>jx0S%2j=u@r{?k>CQjS!W8>55S+JwSVghXSs~UBdA_A+Vlrt%5mLNs6fj z`k@A5=weNcF*P+5f0VB<$CG9)RZGh~)pI}E=qeFG4|%G!gxYDWT+)KeR=tEx2x+?& zU2KpW4z*YrHMYKOB#4zf0Ti&8_Sk5?>D^XRZEi_*1p@A%7&!TJ_8KV8b|(*iZr&1f zP+q%nx7h#6=MBfL8NHky?h3N-l$~)c6mIRJT*%kPf%4R_iFHFy%E*5YZfjzs zrYvKurYzqzE=b&>;eM(n4PBw_8j!}4mdigR8rBbUvweoxIU#}cd9%AefR+aR!y>^2SRQBbU?fyRi03(-i zI|vhpeT@N!eT@RQeT@SRvzLZqStggTKm;v+Ja%k{AwMl#q|x19o$kJWIe)%<_tjA6 zRj}Z(`~0&5exUg;Xuj!e=K+*6(0zXEe)*y`IzG;Pkk-cV;rTl7*`8hv1bzef4#4Tv z6Uh5-<+(qB`%>P&@EPQpe8zkhUpzWg|sIz|?Nk!k0wogf3v z9I10IDkG0FGOPJOt%;2xHio`tajYQBC8M5T=-(z%AxrnOJYvs9XvG=h;*+9VlH0Ozw;cR87b$GQMvhu_v-r z%K9fQ_?m3h=1K!b#f>4P0Fu}?T^^U9g%#0nAnHK zp3+X_Mr|0c+h`59S(r;~+i3L2lHNXPV;k~!lZ><2`IxO}m4!IAHQ9!x2NgS0yV9VO z^;him%2_j)y20KLc~Y#MB{7I8-iB|cEM%R z*HSMurN_H+lwKmF>X=NnQu!=@Gyccjvkpe1d|b4Xrd9qJgVGciZ}(a!jr84G7_fqB zA@^ z@CSZbX2So{tKa(H(cRzO&k~0;1arR@!QQLLQf>&=9jeHIK^8lRuqLLVakq$#nmL|K zOuQ|Yn>5v;4Y zgvN4wZ7|eqZm&wsX^c8DC!vc z0hQ}ZU}NS`nCm+K_Q`dn{Z=@;X`fHee3dh830ucQ=BI1c*CQ1sJOqK ztU#6NAg{wnD3hIK4?NVQroS^xB3To(L0Vst^dZ9#Q$1*L_ou$HxYUo6_~2o#-y}~B zYcc<{?wdG&7Dr_-vzq2Q86+M%dhyG*vyDnC1$9`tqzO4`+25Ix#A&vjt}o^Dq=Sni zU9hfq8cg;M07In6A2k3tL{R=o?K&SDDev1fJT?{myjRXIRtAw!1)e!~)%>`(DC6z( zYkmeeCk_4)r*XH4jhe}PiU$?8jCRU`8x_WD)U;ZE*c!ZipL6UiZ|%40HZ6>t+qvge z7puO{mfPzaxVIiuj>EtyV+>asceHAhJ=3;^+pTbegA|`F922b~yCi4&prK}2bz)3? z-1iw*twHq5+oxATph>r{Yc5S%yUl9gl7e)^gK#-crTT7TMj4SEEg1I|f{`;XdDVLN zs_2G)Ziu6eFPBo^m`3(6ymx03XIv4o5{{OS8+9P)dsZ{(lX zmm;>&+--G(rWCF{9Ym9KI@c*qM)t?xl@iHwX0x_w=gLF~*Y?m*35_-uy7!yjK#JLG zKi$baS#Gbd)PLJr zXxq=F!CPm?f6S1RP&^EouNlgj!x(9~0^?xn3$WCz)0Rb-{ef(>!ms&0RbPR_8ldqT zG4IB48#BZlRvdyEBIk=ZY=0~8w&A6ac8HE#Eo5|c*)(C42{4S@uRMcoNcWrGKpIki z=y43uU^$5m<4ux{&32V?9H#!%2K3K5vX1cavxU_Bs4G zhOoCv>v%t5veTGbs_w@V-i@Mx*yWhy7{rd0w)0FTtsl`GzpW65XB?e)bRejE}@ zf&m5nBKx>v@;2Elxv7WNuo(3n#@xw9W1+_vL7MB*OXFq1f*;ANA(ry?< z9525@(9@75?Iftvy)B1apUe7`E)&yM(7S;&KCRNmZD-%x)SPyA_A>8b=CXf( zB?AUyCpaXjz4XCxVq*b%1bPH=MDiu`6KllufTet26O_!EST;%ye3#4voV$_@lm;%4&RrjGW3TU41nurYtZh%Vr%geOvYdH z#Kw{*HnS%NQ%3bXA=@(lpe3J)?2)Ir_?X6jzl^g~9QYHkJqBQq%%jYP?ET~H{-&oX zq$5RJf!?)JhHA`}-jy(8?9gtfi<1*G;I@=(1bcLIDYL`f4$A{2= z>XJDZvpGI1_7?1?&f9L$lATLjp+SAqZQpD~4RT*kZ;s2Uk1c1?XKP3%WP@&9h>|F* z^mo%WY9`s*+$j~Iwvw6*5^iQ73bY`jZ^UZZFxDFcA_)T12%K1q-GobF5DMFl4Uj3t zbch^8Q!_+^na+k=!K8n?C0WHX2v zwr-fIQmLl2QJYi{gC|#`=Ta-KHejc*{zh`6(PC3blSo?_wkYGVo?C8jmItBSswQi(`b00Gq%!?Jd@8*I>OD?gIx?|AVw8A4( z>0{NaTP!r`sOgow&+Y+*2Hi@%gcJCQ(ziO;Uc^8{p2N?J80KTx_cxL*d8*{so6_*f zdLQ?aOKIwUI@e0XtA2M`c))OGZ?lwiiJau=qp9~84;-l9(G_J^62o?X{mxUsZr1gW z^NFkK9`d7{fkJRb@)Dcs zL9FM{O9U%`aA7^;-X3j#X`<7-ZuYoY52O|pP4ArbKw4ppTMhr2kKp|#3mSxR=E)|J z_ah!>5kl)8f$ z-cE?-NUEvpQrtzcv9xVza~!AhOG!%IA9!W&)JPup(i*jJs8$kxw@ITmycN0Qm2wbk{uJy&*;jH$$3}%!&>TS-x3ki;lbKR zrs96uy7Fofz_OF4IX7uvo8;nsl{A5ID=z7b7gsoq$yMZlb(ppRc~vKG5LQ}tRU$?x zn_;}+msZ+*L8xHSY@wZMxs!E3+WXmy+OT#zs2Pf=o;6p08beOjf6bNm%$1|~bYMqC zEL=Sa_i3@KkgAlPHZOtayfQh3JKvO+@Y>sYiJS3h65TFD>)Q%UMj@o z>9RD?%9?Hae48x2)viB&X8?>liH#^*YJ?i|)Kp?=P&k&14XDJ|zgLQ2QN zO%3^|nQFh(rqnPjerOx9m3DDq0a!6oXm@@~D)6rGpfz>=b7| zGNth8!lG+t-Jl2Sqe4+tNo=x7BK)W|o#j=}niL)Agwk=h1?*%Di zEknQFFtrT#yrWTwwD>u;3r3VT4Zl`>23CE>@#)~MBQ1U~?nW3%BT1ux@?y)9waqSn z|F1M?dkFkh{DJZ+TUr zko?TS@H~RHBBr?*lwuuec~dPd`>J$*K5hzxZmeGFwbfF9ZHn#Osu{mi`H3H6~>{`wQ00dW=ZvaTQR$#>##Nj*S!B-q}>AWsjAcu0z3>v2VfUT z|5Ijd>Z~xze$Co<%-Z7sb%3`q26+zfHcUyF)e`u;shvpGRv5YZQ-Yl;8tzJeM@41| zDxRYuZk|JMUNK zOfgwj;g*zfK1_KNzN@?8K6Z4cn2$ecby+DC&VEJkcMY0hfI7fSek=2?yy}}p>`NtQ zvHH5$oBk%J^M`dtl+j&h+xGvErTW_zSN8jj%YVueS0?AbXxV1F>pyTK$ycD%zD{YY zYvzon^vu?K1=#)r+w$*KGA8LvM)*I~8uWLUAp`{!m%!iz7MB6U0VaRNTT64?HVnS| zSLhFzxXkiy$=8=CQNAK#w-c^VsKtr5~u^T&^;&;dpXL%LB`cw?KNe>LBpejQ64 zLPm-qlhz_$L8c_*2rS(T6S@*)z~&+w2s*XMExdB;xn<+Pr9OXP!%+=>Fa40`vmC%v zKs8JcU6QdtnMJxhocrV@;WKN2;#LjXd4!Y`R*wPFMzB8=fQo>A87RJu_R$xUi@frldAUwmpAXqk9c=B0nF9MAhjPrgG z8#QCRJY&BomYsjb<5=#Zmnosquy7|dLGd!=?Z#7-nHkatlD1lp;Cg>BF)zls&NMZMUKmtAJ%`YR zmu|#|G=kODv4>SxALatrdO%031WJ8SKu7C@bG}2$C$q|GbdfkBm<<3H(f#=Oy%|0E z?Ne_9fM7Qsy+pwk#r1awJ|{|?ekq&pY0%m~%5=#19OAUZtcx`K_VM`R>Kp%f#thjk&u;Y}71d>B~pOdIkjzLiGiW$d)QIqsxqW*~W(Tdal^7 zTnv94?^&6>A~yPBC<`nfl<&xfhAi*jF3B|mp3@cwJQta)?T!F zVU*4s4jqS;r!k>}kj%yWK1+lln-y24(Ft=U?W@OXWept1p!*k&yl|E`1Zh6;xXHQP z=M)&@`8=USPIV}n)3eeNVqD>??|_^)Qx*bQ5bUoi)f>J7sCDB0pIf z!=|IeElkth4M5&;} zz11sdnv~!igC;BQK+SIYHskOxR;o691yG%`n_~dgBpm5kK>czmIuGbQLuj?(D}bty z+8lIdQsMKiHnV`*p6-7iRVt~seFamQvYTTtl~$02*e1AEAzWn9G*n<}Vl-GyPUk?f&Nc>kxyy@WJl@iXV z!{?8~&qpb>!_OH%R!U>=0#LAI5EnK)QRY?(HEH;~3 zP-tq>Ie>wwp^0fQC>umX;bdxPAyV07OmszaQ$XJ@boF%4(cdS!=crBkoL`eA+CU;h zu^l$efxR>ZZk_3Z0wD?))kDzUD`KTJqkmW%^%iR$yUmKY;&ifv1~wpY7UPOVz^qH( zYivMtrA27L*Cz?f*KY|^aIKZ^Pf8quSl+WA_&x9^sSi-C-Q-Ohi?!rl9gPX-`a$pG zTX1PI;8j-}12j|6>0W82-pJmf%gV>g_t9Uo@d{!P*6VS+QcgtUYP=drUE^yAKY!SR zlU8`NrK*0IAG~?T;QK-MPSggUX`p-QZ}cjg+L8<#v%kr6(hy#g*5sTH?up(2xD09a z%;*hX3uW!|qc^yKVZlA(;&+Q!IWq7fM!!$^28Y)GEqp&EbZ5U*$NNI}_GvDu4}_HA zAz<$nvC@{oiXh{k6uUud6lEJH^nVl>TnQjGKBkCjr5(jsE6tJG${wNZM{8>+99?*e z`t+XI-1|5O!K9gw-+8tTIh9+6lI%?Qxy3UicO|VD5vAQoDu7A%d%O1>W zu;TW$I#wj8_e*_ZY0U=UYjIs&vrKto#cy}&BF0u_&$tC4Lvr+V{&^-c=P`3SK$aw& zZ}x9auaL)zBhgvY)|HtRi^?*t`jqh~%Z+79xc!z*u{I3fQs$iIa=!g0U z_LH}`L1|sdS~dp?2}#XbXMg2D0lKtn&)pCv?$+5APc*K)^i0Nu%Z>oA#^Y*CCP~r+ zIAjyNHA_^eu+~qc^{{YjEJmit4ohRHOpDy>+E|RiB_~d#C1=(at`O#;>6A>TG~Kv{ z3I*p9q}yFz0s!H|Ly8|dT|v=}oQ~dWx}6CGq2bL!Yk6;g`Zyrw0Dm#>dO;%NYvE@D zRbN~VilkJ+usRnZ6oskGfp3H#t^pR}(o=FxV#*~HUP(S&3tpuk)RR6kZ}DveH$(6C z#KRgXv~**tjRu(#hes0+3+QBg^=Q#qcOz))8Nt~Nit>s{n8~hDrt1w3OVK~Sr!fxh z{Ox<2F-i~$dE#J95`S(5kQORCeIi+?9~;K9>XBsD4uCpYHVNHs<9J5)(g5yFLss(+++i&!@@6C#?s+9%I8 z(V%q=%cM{F^gR3jSme42!FGTafcHUoub&LOM`r2LptV3|(b5ja^UygdvC8EWMWvN= zJ*B5Q>#Tk=HBsjb$q!gJwbYCi7N$9nF=adJw7*$P3)*)WaWL*aSNj%ns%5+qJ(Qmd z8^eH0y3ZBSx_@L5&!hCOY7Dg{Po-San0C@2G5J!YE*zif*fV|_dv!K3>C&?a9iNT_ z%cDFMVw>D-8-~hmYcbob+Xc)pwM?tvKB3YfwXpgtR6Y_aHv_Z)Jo;6@40j*kZ4@e) z#;K^LnB5In@+Whe^iAnf4r}EnigtF?yhT6Cuc|+tS$}C8xTmcz)U_BcCz7kT#+86= zR_p>`#^$Z3eE>t+u63`P@O7tVeq` z`z#l`zE}fq6 zVqBleRk^2?xNpX10e4v#^*&xBK^W_K899?>LnS{utD#Ud)3u$o?AVS|xQ5t7yLMm! zmXT63F1C_YEcCS!t<74!jh2pyf$xHqj#ik^Pk*D-Gbd+e;eJT1N7$L^hheDLu?oI> z$m%*ndF)-F^gt6v=hgVHBn(^ix`0+l+zn@F&InQEA-P#8s1C--+ni za#YNfTT_Tx5ZuxwV|>k&*fFJXe=FhJtmp**UE$FC0O++~v9Z!U*-sEuh4w@@Z+TTu zJbyR;pn7Rdyo(IZ4I8Czd-e>n>VbB;cg2a{;Pj0C2N_EmJwkj9+UKTyG6c*`ks7uvHy{=UCW|b_c+7|x1k0*c> z0KNRL=<`;pOzAjuIzl&!4M3kWeWuF|lYfy8YIhlV*;pG}HqU%Pqo#1;eT)|e57B;A zeIBU#YzJrocwI>GlYs{T5?x6L;Y`m{2du5FA|KPb!GLQG3q2pxI>GJM$l&u4pi`yV z?G}653Q=#vr@9?78`ALpsE?lS54H+L-WhakCvXYp&3G)}tO}vt$H7%OGxg=*4}UoL zW`GuemxY->7kHxu=p@_;uNrMks~)rjx9xbbR7k$pRJeK2T*lOznci$cTHRBls;}Y) zmL~$uVy52vt^0S03&l~hm3uYYF}RJbikY-O7h0XpN;s4a!b9KHhF%M~0@hLH#;*``*B5c+RS(V9RZi|jqLXfZrOj`th9CbZU$ljU|&*=eE{}G^xp(zh_3r@ zoH72`br@MOlrpUQ%Y=yw+TsK}B_Fg@SUX?l8 zin|$Sc+#omV5=xFSj?bq#8;*#ya z*dpde=HGj)ERl{Dz|%F2U4J`0GB^b>+%kk2dIJ+#Gy4?`$-q|JG4XPDAh}uN3rMPx z9qi-1Dh>Xtobb@fwi%!W;AKf0_5nV15_CoqF$HYf9+a3kK8s8?(bJ9T@1uDhi?ML0lRy90o=v8&Ty5)Y2qSo z^7k`*Nqk7Fr`HaULZ>~6oae{k%!su6v!mV559gPMH_u#jnivV1buXVfz!wz%0>y_) zb{c>v4&BS=?!#M3nZoOgm!On$yfpqcc$bf_IT#!P_ypkbwHDyUf1l!e{Rrx99Dl(( zxOZ-jc2AWbq1|s!Sw3q1cA(BQjzmeQqc7qmA3wgld!SJjO004}-L3xb`ttDiL#-H- znn-KA-#$OM7lH%fhIN85B0zOt{^&kE{8E$cnJJCWfOkMB?Y_7H#gq5Zwg%9)R4FM7 z+X_L9?Ub^FyEoCae`rpL3JX+ND)+lku%E1{7qFTwE@75H(?}jKi5J5Q9Y)XL&aZ(g z(LBiO|9B0GC+`Q23^ZXNYmQU~S;Z+_j-z;v5m_PM9W&|vBor4svO|x>=U>%eqpc-x->o($DL{7Nkgp8PX&skiBFi7Uth6yXtzrQ{@ zh!u0|d9Ot4IS43!&h{^Nn6#|kYW=u_~S|Ni+ zfLN-V(bwB%M{^dn&=FEJ-k%2if5*t)Xas`DA%M)7#hdPFFsmQS z;^Mpvi!sm$i;adyQ~W6>in4EktCI5^t|~ciM4CArSZ+LTIBzIN!leoH(i$tQeQ6m{ zf;aofd~~k~8O$niW7?MbRI~4p`cxeKc93yPsGCZ6gd*0qa&Js`V)9f`13u1M34-q$ z4Sc%8fA*(4%yOcwXgsK>$qRKM150a6(!QnwDLqq*nT^Kx(DycBBeJ4Aona zTF$-)QcI2=sd{kn&266%EufKk>$Z;>Hx)It3Ago0LM8oS5H*&_MwlH4?J-}ew`A83 z?U7p5?Fi+X7-6;|w48kpgq9o+=*!hQ?CZ-_)TV-J?90{K9Nm|zy}Q3JSL?UDFIVe& ze_UTqGDVEBcj(JWw1VY#YRi?(Jkl>&9Xr>Z%g2i$!w@Xgzt=l<=0f-^)Y;dU!@Yr6 z-G8VNsS_jDcZ6bRq@p<0pG$GC9PPU<*9;6aMxtJ>)NB}QGzjbRF;)c8rA{901UUhM zlg;`##w==PYN00V!MGs;yF;3h(?JQfK>LvURjic;Yncu~HjOJ27}IcBfg_-Ymm3*V5S%Q;15K@jbf13HU zHGmCxo|O9ev61OLcM6N6obR}S9OkPmJ=vo*!>Uf&WzCZvnyXrKSgg69e?DGwOeFcT zQhbNra;M(`elLO}#Ae}lF=^5n2TafPK9RfVSg9yO81MQzHN}R-kSaMRs@(NoguNV zy(Qkn7+A|e)3v((ulL_tMu;YlMPTo?(_x*4)TUt?P0Yn?LuiFgK#9Scjwy~D_)Ok0&(~iGiW<{0#mcIsM6~@=f z{Ls%mAKLxZ{pyZ_&Jf1pf7=m8dvk>N4Z^fz#3I}S*@1+_vdh))t4S=A43NAMaGNYf zZKa{6n;#dRXhMPe8ixRfz$AtHsuk$c8^UXgTWg6{D-qI_!?z4Qlj^VEA)g42Sf2g4_NGf}ERliH7 zPWE{6*^{G-h0(TkP3_iz+g%vF{ zJQnf^@3G0c_n2(Hf4&3s$6-I_4})To2pCpG`Y3u6*ms3}0;mbUcf$T0$Llyw z8~}SQiJ|I$*vtL^<^JzbYa;%bPZTD3LtQ=tees<^zXqv24E8oYH{sd^dx_buG5-mUbuf?h`d*j!e;H@2zTZ5%gGa<_Elr)L z3u%jd@5i5B#VKNZ3d1R?obtn~C0z2=JGoC(XS@4tcl^sirZwT znix&Dq`LnL1g$C(k(Yr91{Alz-vz)*m$O1ACYO*=Rs^@IDh9v_f6tA+8UCbe7LA4Q zP5>%PE~fnyPok^xSMAnb5N8S~fwjlMZVBk93Fo|^YSSAC^(5BgJ*5X+kFW1Jxp+5} z-mB*RWxm7ZYo2vR`8v<5J?8;Rcv#-eNV9A$b7M9{1y|eC;5$d!h>Uf5&!n7*sVmUk zTAO!=797>YJ+-h)f3KujAFyrDU5YZUoWJ?Fn9|toQX%$uFg!ZU{TakUp{&@OqCex= z?BUi0S7-3X?XyC_cKgU`@}JB5Bu`yWsO&42_CoF?s}dxpg=FxI!c-dK*8CecgR|I+O{ z-sZX9Z%$6MaEtUWobTbS@L^N_YhSIJApRzs`#(_bu$PfUXcM=sH3sAd128r?mqGOk zCs3TW1|rtHs?~_ug1>pimJ9O2vg67p)tqDAm@D;=qBT zRZ&q)cl+OwW9W5(jei_PpwB_<}S)oO-xX7TLVGeRIw z^0Wk!l9Cb<67V1%1bT)%$rBIaK|Bcb40)0#9>jxq5a=25Bu_ku2k{_1LkQ$ao_G)s z;z4=_$df$rARfen^bC-HCwbyQJctMB86Z#c#DjPc57IM0p5%!K@gN?gXMjA((>#dw za*I0rJ046APo6xvY{Z;9ckaT43zyB5kdP31hTaD9%yi<;c*z!yh>r@#gXy7d+qSi8 z)oKFS&ZnP#+P!;sdWPNx^2}V~FQ0faXMpF{O>S;(w{G3Sga65YS6_W~`t)f=PWIzm zePviw-S@T$f`JN(fPg_rNrT`3g3_soA|NFpQc}_!Wk9+Vq#LBAJ4U)&r5j1eVuWW;*b|SF533|^NKc(`}nkW91yj%v`EBXCcvsvz07Hg_WOa(#VtSdI?5)dCnt3$ z3#KM})zRpSSv}~Hk&!DY_96K%nCm-+4breHd-qJE}-4Mx4#_?J%O(}QzcO$aW%zf$7C98{|VbUR+47Bm<0&ij}22DZqZwOQ| z4ttfm&Z^9UOPPO?GCWo8A{g3R4tCm&UrOz^vV@}VJc+B@+u8VxY`J-)C}zg6#O?>V z5Kxx!Ql>sl`edcPJ=c@1D;vrG(%?*wcs$ZES&zv6@+RYM>Fp&wyshb&l37a4KG{8v zDFF{60-Yq>)<}WKh1e&?tHU$bG)PMA2T#h%w(?rcOy%RACyk5zMb2Xy_bg3G&s)j| z_jK2{muBzYUENxp?wp)W$JC&~ob_T7DR4h_uPfjTNVPhhz^)mIvi`(iX@u0fFLv3s z&6`HpZ4K?@G*j@|{76%_e2Q<_o0Ftcm=)AeSX>OY%DYDq#$)z%5Ur}Js*v)`!op%8 zTi3_;)mV+!(haQU->PRw=s7P{FdzC2y`+BCR!%O~s8VGwu=E$2@?F@ELfh62+pBEB zjK+f{eP949pWLr7?C)(LLxFc+(!a>k3d#5Rrdnz<{Qbkn(6!kv0gD-bhhocxK^uY# zWLyS4S=!s-l7V-t(f)X#&~%?lOhYQwtDRRPa6jN?m!n-SkT=L@xK>R(QX=pk^rJ<} z^}D{64rRYJHI>*Ky!OG%%S-j$ki$+|5PifwlhMtkF>pbeJ{b{65EH)M{#uvX=mh8x zuldxCcXwZ8#YqLT*$}u(DdoH#nVn_O@sD)arlW|H#cG7Ne?Vsq-~GHvavC2imRY_# ziiK}1BJ55t?;87R{fW@J>AlUQ*151uOrM1u>~A<+o$X2&uwK@h;oF!W$j;C2nl^uv ztJL%-H8s`gDj&kfw-z~&ZycGHmgeE%(f#ZWQMPXD{(SKQxQPA9NCdwfCCl?lbANYh zpx82!%P=G|a;PDIVNLCxc7uOdDGf12T>b}CXQf9#=lVB?g!Bq@&sg~+9qqQ)HO{XR z&AgNW^vbcSw`U_0aB*?jjh1edo*xeumoJA?4ZZ$rlb@c#stYvlg|?0b;bQc*X8{*<>xIDFOd}o zwfW&;-Az{y#=*srs#(P}pE_7GAT5BM4q~OC3A3j{6f67u)zasrQ zx3{fLu5!CC=|Gw8iP)H6reVR;m>^`<*?CVtxQyR^J5@PJ*h7~*`R0Drowm6W_2op@4(_hSxSn20KLMhyFqtGv2j6G z-u9ZaAptor)p|j3F)_1hiRteK=@5<=88^0)Nw!udeZ0KvBeL9OYQ4!B6q27N$b{p7 z@jLixo>0uzX+Cip-!)yS$UMn))q}b0;*O~2H9v;ucTF<77iMQY4sSPq#q@U$8A%Bx zD(Dh{d!&#fMt0o}NqpEDq19ewF$)ro8ys6$U}n5ZLE*4AqcFl;xo@*Jv$eT7wHBvV zDc!W=)b34wpC)ghzn_%bh;bbh6Eiq0X!4zV$nMpqZKOk~QF*loaic%o?TG-r2{dnb z%i9`zFijfSh*ZRH{pU}4Sx9tzW4pQTgl-)wqAFr7EGGX<=6)!ir86%3u;7-)MjexP z&&nms8iwYvOPxiW`oH1^%@zjvG-7;xeYvgW(w;5!7n=P_eGx0-b(x)$mAtdq;AgVJ z_U(ni($HRX(!n}0DQS^G51R(}QtsCBZ$b(C&$z!$3xj$}wed)g;?*fH6utHDoRwfR z;u28w$BO!t+HQbv%mJNPUtibM zgvOQ*rt2%?^|6sGqk@oO zHL2vdEk#S#^4%|D==}P{stwWNo0^z-7V`*C;|}^`k@@s3sSVU`&L+)j_i1S&N=mhY zw;H9m0{fe<_BioRt2u1N529bydUL8+PIqU%N?(h5s|L5f+E-p)K6(u{d*S-j%uGlP zTBvIDzA7yDl20*F?&cl`;h_zt3nz%r9=PMrtZ5t(hN56`pWKd~b)}2mPKVSYKHogG-Ye_aftd zbZ>iQ>ZOWGRrs~}MfmRMpokZ#1pyvxbw{Q0Ii?lsA3XVj zLc~AQa2gMy?%r+Lbx=L@Q~tKb=gk~i13DL@oUP=V&d0{asv&%W6p(VSa#@G)n&=WV zOc4A;d9=9SuSM&O39{qBt*O^r)12Crm_wTCVClmI{^KBxETORVhEhX=-bVJk^6+5> zZwR^m*dy}g2fX>1Wrqh}9EcCI;8JOb|4t=}JafIlj0Yk|D}+K~U)NSs-GE$op=+UR zxiB(XZn-oJ_qqNck6r&4BiIT0_xP6P?;MP!PG=P%!B;Y3;y`{8&wv00FtnW@x==2| z7~Ltu3@4ODNSrHYw&r?jL*9ZbZu7^gsz=!2VNvlZh)#IB}6%vie7hE3CJq=dfnO!prb zACWa1FCN1_%4PjY_d-mGB_CKb?S|RRaS+APr!vuB_=zq*#Zhf8uYHeQp$}Hzxg908 z*PzGGv&(W=GKHd$diK8d^suXz+dg4ktk_K&f2Ot8$v*Y@xeOVzz;f|pDQp-#Wdjmp zC&NBjsvGZzq5#o;fLmB@5;;o)9~SBjnx$POC}SY?(iteS5ZGJ&93KACe08=pmuQEW zQSpX%Fu%Qxy87RhIuq;s0y>*&&|C-?S0u8(_3dRb&be!CsV~?E7*aAsL_{36rxQlA z!H~>MO?gen&m8Tb)5@3f9f1XDth6h8vZyva1(Cq&En)Xlr%p}Le*E1SC}1-BDCE^w zso)MsomTtF{_Z>U@um%JdKirlS01hoJq5~gUZwsM^?B}{wOM3xYAR?V2>d+cdBsIV zy*)kQe708!P8_NY6;=PeNHjx2unR693iak^vUUNFMupSTSZxB&*S8}Tk#@^&zQgI5 zeWm25bR$*V1EB!{0lpI(%+s9-t)FRSN2S9O6BE0;yRGV|Dk>_@d;lTJyOxe@n7qaUvqOBBoxL) z`I%5RUBCBsLlWxdr}P28sxAqTL(SkUCA9lQ5L@Juh;DI+@g^V@bB!W9XM_(Jh}>5x zBjs1h!Nb8-$f1<>nq|Uy3kwS3c)lWnXq<1~zHQHSCdei@kOy=Lf9P6*G|z09S`;*8 zpI>C}hV;0_<8Ybh5O2coTe{EH`cM+nKb;z>bkW>_b3%OUpd1?>ZcC7*+{-I1#Rj~^ zzv|{Z@gk?mBxv-{%~yfB(_!2ui^GDf)wAufqR#kNbXp_QhLA!?XQ1eq&3~n-2~o8_ zSs?|K;aT!iajBdCv{p!K5pA1|yU7@CvN9o!3UYIDc7~jPe0{F(BOkuAkN~UQ(yWWf z*zBzBL=#Eo0n-NhuXgfs6%}oJzBXpJdR?|JDUmnTUM5OesN#+5g@0rxi0)OBnbwC1 zqVFQ63KX&)rybO>Z|Ao>JNYm7bL^Q+a>K*0mCZVlU`VMF5AM9gC}7Lbzm+k|7>cu9 zBWvrS&O80vFUSIaq33XCiBDA?K?&n{I>8Av^e-Gu5)NMX6eehmgy&Egbll|NAUZ0V z5ntLM?FjM5(QGa^P55!E@^-vmR`YsFF_o)i+Y1;Ew7;%A1Tw(6wVt!4+D-bgUt7SA zyT)z7JJ7ZyFUc``i=_j4wojJS!Ef7Z@2`(Ul^ZNe;oIJ#N-S7>9gR0WG}2d&W8%hxiS6wMj&Bv0UJ0o;{&)1UH7|p9@;S zP+7@?ZjXjD=#czxYp1o_&fgT&9#$|r|GzEVDc?DMGjGq|a`T-izv};<$+V_#p%nL1&!GNyYkI-((H>nm_Z_-h zRTcj7<({&YuZ;nj#-#zJVILPsAN^*D}*VWTtLf9Hu6sV~D7mq@LN z+7BZdmo==lERf%L)%!yMGO9e7t$H^UC}Rq1R;PzzVQF{7XQB@9?04 zMq`>q!>K0~SWM7xIVTn6d}<>VU+u#w}DqNF4kMF2U2&$Vy*xOw-lN{&x#ReX&504IX7w!Sl_ElDBk zC;RREyH?+R`hN7YeG7Rvbw@McD@RWd4z`reK2MifnB*%Q%1cwOKCn5#YDxeoQ=yPE z{;%m9&%dca5eOUY=o`l~F7MG8?C~R?^a>5Kb+_CfybyrQa1=W1@n&8t#D%;uJmR+5 zWQ!NP9z?fzb$7peS|G18su~gFN>;ODEO?pgz@GL@@}9_Sc__E>d~YrTpXgoXJVst# zQn*sc5k_*URPLMEKIwYb$+eF;CC@LByE6@F)A*|#3J#^iu%IVY6~64>d$8EK@$8c` z@<9)!nA7#A(uIJ~kIqKUZV1AQJ_pZ=4(*|X4#80}Y#LOE_7K(AtPqvie!}X{zGmTYmmb%Ikm^|2=bhj6BUFgA5Nvc1c9|WqTO) zj04?^E84#5^V7AYc?O869LV1G|@ryPx|sT}{rZSK#3-jR*HevGs2(!K71v2#Q<*F&*6AM3-f zRAyJ$Jr4kz7b)lJ4kf?c9aK;_L;difRR%qVU!>zrfaLg?bx1Jo>6MA*Mg&57q3Lg@ z&1c_Kl7jHr~Zq#W3A@0 zw?6`~x#yDN%I?dS8@FZUmxkvDiqle4JIu5Iyj)wjQT^BM1g~7blS_7O((FB|`6pV% z_yo2xxNHqLjJ3y?XZnl6g{>h!UiZIA*;(kxC=(U>UU;#u43E2ooxiyc4F}w2As3^% z42BKn+H}cjx$JdUygJ7D6O!vbzSi)}iFoebo9@k|7u(X{Dxd67KJ__C5;*}spxc#x z|7&Ps;+?-=b+}+qlzNKCY+U^n>IR z-Jl*S$nyOPWGd`KAKobZ_~ks3Vwi(x;(64TC`F_rYQERicT)cn?XY5L{jRN?XVlzp z9H&rM`9)dO=;aNAx=m~hz}l}K)t|n}$2p-Ey|de#bEz1P2VVmWAGtP}bQecZmjCxy z@XyyAAs?CgCdf*ZvIN23a4uI2By5ng(Gy~vXGWN&`}gtHjB5@%B)$kJ_U%W}a#9hj z2}0pC@%r3JD(O903i?jh*=Jh_zil~nuS=KwuKjOyJ-s9IjdHMwL@h-f50@b(Bl9@& z7&_k1$g*`65<9O+OPzvy=7ZwUpd(Hkz&nPgiBUuBmh=69?ei~*LBI+$HFE!>4H5i;ci9--0EQSc<}(k{QJ0JFq<|YOI7Ph@(JfC&f() zJz2kNDG{jjCb-GpZ6Nalj;GJQn`%2wfUU%Oe3Z83c#VB`GwxfDmj9^JVjC%b|NcD( z#nU@PnwZE)H5&@uYWFLAe0?Q31H{ z(dnA++`aAx`Nz2;!3e9x+%slwdLb8kAmd)6`0<)UQx-sm2m9Zy6fcxP zu_R&E1ZWMEDp$zJb|NXl0PS_XblbaZyeXI+rxIL;Zrw___zPZTC@!CL6C%*`G9HBr zW_uV-P`10=2$hG!?ozEL@2?!aPL)DauytBKwKAiDq91{5e}*ua@bCeQOZ0rGaoN_G zk3iKrVw0iU8u2sbx$({?@LzmZi^IWggcKAMSFWs`W5Y{&Dsg5!m}0#BakP>5lSw?& z9>Qe~;h5Oi%8H5(#10YBxehT+za!3VoElK(=`#DBj;&mPNG)c6arT26i~$VOVU=gM zwd^53)gJ3oV5Y09t4e&@VTh)cQJ9R9xNK%pjN8SNIb1qIM}U&!##g4}$B#pU!9F1! zK+4C1CDv=YQi)HK0aA*$w)84!C1Jkwxg6?@mSA>VGbVvHJ^;BF6&NYX~?TtGW z3ZB<;_SYQXBv8wC0*)=P*8+XL((TK47Cs+`USl??!Xi1O!v*ZB*jvU{dt3(H>bknz zV?%K(jbo#u28M>k@8;eZ8XDdU*awU$y-Y)-prg9_^wBFH3B5O7?m&9D;j0u<0`v3p zpppS%RHyNY?(7?99lRJjysJ`iRo*_MsF|gga8uKwDL=0=JOiZGNK@kVxmIYHfYL5> zX#=JpMC{e^$k~sU!j2Y7%_^xyh=C%@sgT>Tk8gdOdfHGYjd4nkh?aJ}4VLl^d_+gQ zq%C4=OICm6z$c5PPhDBg`2FiK=Kd^)IGk$8hea~=!ijNm$xqE--T^A-B?;$qIB4d&hTlur>gKB8&f8cPj(JYdpg4jj8_xEBT zp<(@`>vd>p`O!ZgExaI^;SeDt1RG(Izu5V`H&@?ypy*|m5(T|599eC zAz}Gb#Sj1Y0;@V#F~_k1fn>Q!!@Nkhc0*!vU3Pc!7Wh2LV~2Nw1MSkfW^WCQjFh`S zobE7>C-G>IU%Mv7*ODHhLs0_Y10cHgc6L>HpFel@b7SEexKljZXAT^sSSCf!ry9lLsOrl!ad{oqR#q2W#ClJ0@nbu`iOsg|`%T5OC>Tqs5 zd;88mfRS9EJUV_huA!zK1TGK|t*}@-Uc!#P8{p}pclgSi?K zMuyzbDCL z@U9XvwO*}BllX=2mMjZBfsL&#HVuQ`8TtPCzo)x8(*{e&eo{NDKnI6!K>zyn>#|!M z>{iWw?aJSWPBW{XEwu|nm3N~O+h5~fWxV(9kK)pt=g6TIH!;eFD_tq=6wZ4ar?l;h zDnG+_jg*w01|7(ZsBs->Giw6svk;}rU5fB!rPsHt9ot)Qp^;!V{QaMzsf_MCgL1*yV_3NHT`V#CYljgppcw6~ig%FJX*o73~?tlOQ1czY9_2!4` z2IPUD&g{J}HDratYZQOzM|&c&?2GCy|5R?_(Qf=0RKgJAsbpDh5|CcO%8sxZE4#BF zQyxon)v1n>TXc%;;Px&u5D^mwQy-2OgY z<1OL9WUdkyispJO=;B)fRgckj>}zw)$x!tWcp5HQGjm$y(tWWLH*)Lmm8~r-&^yBQh6J zghpWmnR6R|y5}c($zQ;(JJ3pL>k$1V;yW^E@7^_Pj}eC4XdGn&_M&JWvE3zvki^+o zdH7$8)R`9a5@9zPt%9!DnV~Cy`3daYe>?mjULv3>0@wm!yzs++;M!`~R*)Z6PA*K5 zq?zTaWU{@Uve|3H;6a@iNIBnd=rjdgWm0lAjIIV{cbmJ;ibZd0#FnK>tZ!E3MM930 z?#zbGuU{6KZ;g5|SEb4s%$gTLo9N6HnIIOyz}VZA;0!;129XFM^$Tb17YXWF_?rjO z5ZlAKjUz@TY7j3nXWZDB7}NDbOUdGC0vXi(UY@K^cNTGC%J=S8uf@ve?2l74%c|x=q-#iRkS_Htzc)7Eym~7w!2FEc9}*bB`n%uOZ_6D|w={jaZfvGJ2jh;kg|Lv=oHAh2YnvLl-1xXzGvCa^)D}#--sHVGo^M;-jVOH7B(xy}Q{oMi#o# zcFw7lFn8euyp7SSa0o5D;8eMpbDe;c7ECJGK)rUE+NE}505Q^6Zs(-xc~3`K__2^l zsmSx~wMbYDdpn-(N&cWpKDtU?^FKtg_}gy?*5hc`xAqMcRd=xdtswYbFc`OB}uWl zE*A0MRs>&jnk1ke8tl-h@yex8%l=y^^ZE~2bVV5L$MkI;x?MVJHvS`+#Pc^2C7+^M z+F!*XH!>UE5+GFn-%FZK{w_ThJeD!ud23Yje;+eqi^&GPOKADXtAhV~GagmsRn`Q| z;;_D~$BqBq%i8zF)t@@@>IjF(6+0Ic$v??DwoMb24FbCO8*v%12%%cmvIEQu8_*jC z$(L{Z=@K7dKxFW3h5q*f!R!aQ5>m(DZ1D#Zfw zY^ikWf3nhpj?Ot{E*{`l#kJM`Tfp)6s^>_KYk_=3u!Yj8(&m3Vp!vWy_0eF&)%EO6eVI`LRi{A{OGwU!NQAgAEifdp_;O&tDUcfwb|y&I&R! zr$e70SFf|Cxq0qq>tL~EYfa5p`<-?2`|r$6O`p&QU{x9Jr~mpVSr03#P!O%y z%IvlP1F>l=zi{CKpf}&q>L2)GJE?%Iaz9ko1As|F0-clKMtJQuGaRsx%4Ij?5yyeP z&+5hovr^6!urdbCpF{tO0hWplr+~3=2l?sFQDD-i3eZ|G%pUB&Fw{!0bU3Y2x z)#Poz>3Yf{U4moVqtw+-F6_DMiP%2oKL=I2#`ud%slmG-Q!&`j6X)^=|ngf>(b zzWZ@;cz75}!nBvg>jDe-1db%DO%e7KxuNz725Lr49F;$;;TKO8D+j%s{OS zKopaX-CS=jbf~uXMzNcy{s?Vhsw+^TfM~z*v0G2{yU!tEMwsm)i^!yv0r&mk)vbeG zeGXFWQAlj%WUZ{M#KgpK7ETd3if?#wY_`X>sHuhjGENJBsNGfj$?FZW^f<0B=VkGR zFX(;KAUgO2#VNu$l5iUFky&z%(yp4vCzFf$JIEHRYdz&pib_*~ZDV_!6Fuy_FC8&H zO&VeavrU!CU043hEi&V|`@GQIzCbAocKaPrlcqG?RU8!-ltE$cvcvZk|9q!_H=7ou z1XpJ`b!XpM!Y+|RvykD7Jy${s*j{&5z2@z;{hP07iRanGvv_G@2dNdNaK9peJ*HH`g8Y;fTI^wSzq*$n}~J=XT2PH(<4db%&ng^-aE5g*xXQ)oU#L z-v7_DyxKy`@us>PZiA&lw|!`2Z(t!PWGTvd)l()Q$TV}a>@kK(99ymU9@Z;uLN+28 zj>I2E>f={y;}#Rf@t_6+zn$YBA)d>TxLt4m-yS7er_N8^W3<+5iz55)v9Jj1Ope4x zE$t`)Ye27#z8e(bkrtdR9G^ z*6+ZoYB<3|9Z`U)A9?BE{5@K>jd;QT$u3=(knrxgYtV3U=pOJ4#EHk+Iy@}a8aJXQ ziH4+(_}|@~ohCV}Lh28=7aV^Hxxu&6@A$tjydL3uH6n@rZ@>K!?QbCQZn%y^%Y1%& zl|K_YC5I>Bu-#weRZP*F&5GpQN-~r@5FdE>MOOYa?&Y)p-Xy91VP#n&E$!n$)>>Ti z;$HUGed9k_$!j4UJpYcugdE=@Kj3_(w)bjp?@jS(HAW15PvTWdYuq$*#T@^)(5yJr zjt~Z3ZEQJcK3(9Fw}()4W5$c#mL6BLyLUSGPrrx%f6q~ZTilyo9QnphxNCnmLO?C1 za|#icvtukf&`yZZ5(eNI;(%3~9nE|3HyV5+2tRb5Mg*nJgB%b$JG&&(^Hj5=^0q7s zQ2{H&_X$b=oyF|h;)v{L+V^?(YlPpQGoQbgQ{uSdPLCZ2VQJ8{`_ABbFEO-xe5 zMEV{&y$g@x2TcvF?6E*k=$}bO9HSp!JqNOMg4#Zc+KOfFlw3kA?DYnM z)k4UKfj3<~L<@fE$3E_shNYp(Iaul>R^MOaQApw2hiwaqwdN`vlEbn0_lGZNT}bS) z2CRA>tB_G!)-1PfLA)gdJ}H}LQ6RC<%*NNVH`{?)b7;;w!-7lQA7wM{D&z|3s6cHy<5dqaxn4^x9#WK+9Cw183hU z65#t_&5LkNU9&%Xo+cp3g)h}!!)s^=G@=Xm9IdQJ!&jMVD^j(G$a3c?}4mKnJH&^NBSn+b@Jhb?PbT%$s ze!6KR%IBb1H1eEzRd-X7LMdOE?7#KTp%T43q!%~bwhhJWq*4F~cvaf}DG(7~n`jkD zyD#zQZv47>^uk=2$}=q0=ujSCX9UA#r1p>q@;>ss{_P~`R>+hzXA<1J?B+6|G)#M% zV6y+A<#KW3Cz1qr%WLg>fEp+NU7pgHP2?&-wpo0?oZ&D#j zCLZc5e(M?C19Z?f3`)ueYF&E16aQD|auf+@ge9Oyaf$4Ykk0C5c>&h*Pa7TojV}Q6 zDp5Yg|HE?-0BEe(*l%NmLwHPutkdCmrF zQ=bd6OSWy3{_5~=^kU*qc~_e0S3gnKWmu95g0apY!8D$HjKTv>m}R0egh{N%I?R`28DNUlqDdXQk1+ z1d+K#Yo?gX`nOlROzIGA`_1AH4@vqCcRnmgxE}TFGZCG1iM6UjH=n7;tEm`2S!Dk1 zzSp*4efF#3YKNts@z|W+C%OExwl6W~lb0hob^g6rx(*Gww)XH($i^$oL9h|MtNuLa zF0Jsh?hu+i$o=E@b}&UP{#lCTPrZm=XtJNb7a{%t)gRBQ&6O|F%SRq(02CctZmE^X z@>)J9n3Xb-|3ehnk)$wPlJe$!h~yWS{YLazBTmCU=S*oVpX>w$$7O=DX<1uH-Cgmb zf^go9X%6kQY*<-cHSTzk^=JAl-rch2F{%thW|PtDl)|?>w58 zVd_LHIjfk=%SIP2{$$5mEG6{0G}jC9XOk#)U!k5)RbrvSPqf43O>636Vs#s65p%dZ2x{)zvFZ{$RbFhl@Fnf%ovx<~#0!;S)ACu*#?BHmLt%V4 zzXM)$F;w*=6}#-gY)Ogphc)HAYV1G{cAiIaQN6G?5>q52nbaEch66~it;et)mp(!$bV;Jq01QfYTSms9JeWmfd6LK9<3bQ8seYS zSt6LSu4`}a#d8Z50C7Mbz6fCf+NtdQ0Q}4V%GP;ZK2GeCfPlc>Is$F7CzO#Np(b1Z z(_=O#2~CWPl$7b#CvV*fkcelsfq4=0opr|(H{n!^0sI_=0eq|2Oj`Ho62tmPI=5DH|_yt7$SkT z4%aR<0<5x6^;&K;ElzlZSMRC>oe6&Aag_;p)*=^zg`s!z+mwe#3m^F4sn63Xc(ks< zLf6@}#I}7}ld^G6oH*e$k;6=!N`bPh4b+nFADbHYfZ0zBMVCTgsiTGPCQb_sG5C%AKQ%?ikaWPKR}%UH#{oHLPmg(g87F8so*T2YggLFJEGCR zfO~y!7)nQAHD~4KmI56^dA_!xAsNWJOR%)7W&E)(1DBd6ZDse-;BJwk5MbN3E&vK|4={x1LukFL4bJxn=l*AphK1i zEQfx=#0?Od0nJTT%AElwVm;LuP#lLV2?VaQs2_W*<-0Q38VIHbHL0d+*>8FlUy7KR zm^VKX+u=4qgMqw&MSE#JTWU|XghL;V>2b^>u+b+A#5jyEi&leJU%mO2%45`j&ykJk zNn}$8e20Wx$5$K&ar5%Jf>An0$$ygsy&pd47BPi*DR{eam7a=s8d=bns=3?SN=e2SXBj`GB?VJWR};v*x!;_mpC61HlQ`KF z+?n|JHUmQn%rh(prZz1PLp$|RL=r+c;mj%j2-u>DkI_RKY_3Al7Z1pRYC((SEveU- zSXe;gF_2m9YM+UTiKY?IP^B3cn&B!_6jCOprV0RYg@-rh`U0ics?p$>zdcU}^cEV+ z=bkg4kiQ9Jm0c;|mOdaN(E^-DvzLwD8Fbjg(1EGx4D@n=DZ+Wd=3>ZG<%&aVc zFn)q?U8!$lqTRlIk%-q+PUr->{?5h_Li=Syr@^02V0RJipxl(c^1IP;Z`(q%z5rJ^ z=%WBVu;cAk+eM*!c$1ni2F^o?>@Fn+1|hYaf}Y1!iJOVON{7Nw1v@Jvu!5gs9PDLG zn$N@}R`1#XWCP=LTR_~03rRy-&y{p86vfbjQ&%jpGRa(mA+wnck0hr}zUJ!ccrdn@ zr+5uH-C#lR8xlOGPEu^nptpdTd0uC84Z?9BD%EWXE7Yj`2w2UDJM}l9HDLbkU0!bP zK$-o0TImv8m=d$l0FTzTNQb2)Jy4(zICVOZ)eq-7qJFL^QUKG-u(`cmwt>CC4d_sx zI(zIGP5F5JXX?vt(4F6Xin7~WEM3Teak7s;8IK=3CRKsPcOK1+goOYsH{M#VtE&S% z%iKop`qsKFAuibM;=|*|-e2Ds1}VUKZ;MBZ`P~vS)I0ZkW=5&dRD16@P$$~dkZLSN ziPCOS5InO-0t>W;_sW6q3mwrf`&fi&Zm_iPt$+tHGqA$`6q-%04t;~O@5&uJb|aMU zPGI9_)fmh*z~s+@sLe(yoWV`%g2D*BfleWpT>wl3Y$o4)2$I=^mUgyZxQ-JZqJU=navstBw%?RY6o}d>60IPI03^h>7|v=)rjYy@tX7`{+ztbq3H+cG>4F&?vzbW zG>2}zICkuTjP+aaX2oiz%j4pE2~~(zTY0(0?&cD9_U7|FlkPO-{HpzvxEEaK1P*rD z!zmb*^HN7_rfj~-gooU>G%6)oqmWt=6*+e7{h!t06ois!VtcWY0JAj_YBE;S3~mYL z{YEpuyLreK78bf0?&(JyObf<835GBSE+c^-e$gy`lmaMZF&pX;D8zbG5Y}3XxszzmV6zOT>oEBOrkW~>~d zms_}lgTqHYG%f*`l^o4yHSiETjKH~AWC-xNjQSNb)CKqM zi$QO*07hGWP)JEgWMyX7gWm5e9%JPr;_XBvf-+%P35Ym^J7BE|LqK7)*`pAQ7IF>? z4?jNyeeGipF2r!VmIDl zt&0S=apd4w-P;R+Bk!3B1MBQ@Oiv6q1)>~qI1!8TMzJJLRSFF5ZceKY>4~!AR=C4k z?POvLm^QP6bMT{!m{Hm|T|G}(%a;z72@Anl_Uqevao&_sZ@U*K^O?zuSGpEN3ppD+q)4=> z892`wlid~?XPy-~SMuSP|MSbW*5hZ3PTmv`n`wC(#`c)ZNo0=5#MjwNj3iCV_Q^t*(-t6uj#G`uSN&>nXhypvZO4g+$H{A6@A^^gru%> zF*5-f5+=z}x{squ2nTm?PFqHGT504&#&q5jI=fnw72*5FowK9V+Fyw|>}ObV$#}j? zJ`r-4r67pcToJvlq;i7ITUV5xfw8Jwe@Mi$|HA{7dnVNRVcQo@IsSYd_?=G6OIqjG z?YGwN)SbvZL!~d;tWjA;TE4b<7hdF`$&gN%F*Fj^apu(rw=a+CHM_m`@hS@H+*B3< zzun`%U1I;6MPm3JO7fV%&k{V_Za=#89b*4$r;ub{R%hqAWc7!m>kL0Hz16zsxl=K_ zHJqq@-~EEf?=_SaO9Sp=c}}|6&VJ~JN0QVzKf>7AUf>&WbaQ;r$rGj#&%|Bbz|m5f z&2?SJCA;#`)}~+YVl=f)kjJi(aN{rDOQJS(4xEA4MN!E?qeItmPk&;5UzS+XH!Lqp z%5AcVqWZ@JhQyGNA8@YHNTZ=(dyHQ z>r2k%#AkH9zT^naMKuR~Ss(Gd*VHG7%Mi169`}BGv$k(;lX>!a#qba9uEfV=Fka=) z;yJDjDK3!G$7*||ovfzT6D>VQn!cJ%pY9xn^A@rAo@`Z+J4SVqGT`cS&&Y_c7oOc$ zFgel0r+Mb*t#1;^y0mxOX+7)jaruAuh@ww0zG!6|Og`~?%D*AF;W(@LIehxTp}j46 zfm06~3U8L5A-3lmr`3{gN4r8+ z3A{x+Ii)t6rz90}GTcM#Y-is!y=T91T{j=iPcpCHK~>5ZZ%D;71gjJy$-gvxXALN{Vy zxYy`qvof>tO|q#8D|(jYUXtLp61&t&(&JGsjp7RF4lTWhPI>n#oG|%vyinEeKEG1+ zCYR@dBxoENq$~BL!7AUyCl7D;#LNyTd}o}WIo>IDFHvg7ljWA7b!PgF0cP_h8Jbn^ zWPP!pI-PPstvp*Czx@_s$quG{UV4U=b zhUV$hyEsJ=9`xkSPj!+9#l3Ai#hl&o3sDxDLq6{Fp3BISp;l^NtNrz0FAST!iY@C% zLH^S7ceNqC3tgL)VRf-TNe72&cB04u?zmnxohI?TyIvf5d`ms@2 z*IYX>XZxM*(leT{pBoJNR?-0*d)u6{uWp^ZIj^_V{@wSz>AOxJr7xUIe8mL6eK|j* zF$shOcL`Z8BU&83;0P#}*Jh9=v(~rvWDoQX$e8d+BZTt7l-#uWnLVn0_1c=gAP$h(?F49YuFM{}w?SnyALy zHfGW6sLG7?<-LMVHl9CRJQr)YW<&wSM(}YTXpKVf6bucxH!RdT4eelA)aNZ z;`pvp{iK~w-EiP5XRzHfcm*A$#JpzY)AZCcj~DTep(QRfI!Mw^Nfq=CzDg^l;yOW8 zPeY1(tby-lXzRzjR6OAk_wk+Za(o}UM!T<&;%lep@V+#TxJq}*%vzPes_pX%&yTkb zbS^Ze**)iJl|DY(bUdfgJM)b|cl`7e{`QH=B$Cszsi*muOP+bHgd({28>|zk=Xnfl zf+;9_`h;Xx?)QpV;%wZn3=|WiWqWH}v_X7gc$6bLVv2r&HlVCd=8YyspU1)?ilKkQ zK>v7)f!O2n5Y`|nljFOoaElxlenPt-bclqJy&Xg zw`D|zQ~pw=_3bN7&{+3*D+Q-zxyG;V{`!BsD zjy_$K+SQXR1t!Iz&7%XE5|Jl6Z!QTA^vUmc#J@U0A-2^hNF$=xZXNPgpKoA+oL+Xr zd+kB2%cLvjDw{6C5>{`>;#>5Te(~{gk%4iN^U^+}txvRk`g?J=ao^^hS3FX654jSm zW51fK1}8+$@9n&=*+cNs>Q0wxZxFqC(<)m3*;`aD?xKRidA?_47g*A=SDQx)W9} zrCCPgnbNl24e}%kR-ZY4Ma-5@__($tzwB}InQVpks&w~PMVbdv6gx8Wpg$?%u>V|Z zDsP_by^X{=PFzCzL~tSNPIml916tZ|S04^04>%OuVYP@RY?H4@o90;fE;FqqRj=I@ z{D#WYIg8peE@R-=J0+&3mDYS8mxB}0ufhV`MTiLV3te&MaZj;uuyP#!T9J|>;Ur~k z?5~&42NW*hK78=~gVGh{{sM;i$J{bce~dnOaGLvsd*b_Zrvsv&Y+&3y=o{od-pM*e zf~Qe?QB3Ia0dv?_B00ZHLd$z7Ydh~1Qz|u8hsa&;;thU>KtG1NR|4P5pCuEOD^>vn z3kU>k>t7#H54$MKpE-5H={?FX0rh}BLGF%!zGW#Cf)8CT)OUx{Gct~^Y+dW%tcIcR zizk*JMJzu6Fi=qNcwo364i_T-QCvz2h3xN&yT}8R3iH5VyPC9>BMS~u_{guPVqQF~}M+8(y`BX;_-i@+}fC)^Ri z_q=HAZlaRe-E{)*eo!Ic08M}!BLxr&`q;Sm_~@1>qm$z=(09&X7rgJMP=h89$n|h{A1-H(PDn_IiD5e< z76upt@I8|XeAxbm~;Em`R?LIGrx`Q$jGeLhzlpN?p>vuw8oe>6xTW5{1~hC zVYQ-ah1!WmI>ZU#MHij-)jfaf;+Y9XWj@Q%IA1SzqAs3%vTPMmV@*|63e*{b3iQ!= z@%pLbn`-st61Wyc0$bUl76AEaM%@2}sH`MQQf<`p27AUun)`R`=N3e(!?&CwTlR0fM)_e${q)^?; z=XS!So+^iS5RAzHE-?@E;d3}APhO^YG=Nhl|H-xBwAAeR)V@i{ba-$~P_xucUYBDx zdda8Zq0+fF;~wQ%7aHlnR7Hi`=-|qcA2ZC(xw)Kyjn25o;Re=}9UWtukj`RL`#+7T zF1Xag<({6N^QGHd?OWmRR`)Q3#EK%E^5jWr?5Th=g&6DB`QF4zjcd1o3y=&RyUn*h z*JWedP0h^U#!-H{d?I(6OmiDddp0urSECoBPN534wi>?nZgbEY^%VY*$qb=;qog#K z-eT+K?mp9<8T;+qJp7r<$;Mq`z0oRm@7~_t{iRyUfS#MySAA;He+3f#OwQk|o~u&B zB{9)aJP7_`+WHN*eDUn79NAIJghf{ce%V+mOuY=>$O4KAAb|jWO;1m|JukCb5)u_n zfLaiKw`3qg)2jco5$qS$*T_dCY%<ZdW>3fR11Pu6LQQ(#!Xc2ei9<0(0aO!@8NeJjwpGv#m$=(;RWPa7C=0NJsUo3-KLFfl@y3IQx@^@-yfV?DY(?MD zrL~VIC{h&&zQ)CIyhgfx-=ShP2|`@BjCxZW^0$KEM{bIWiZt*rd+VW&jwkefqfjVw z3k!yYasZL!C`ugmiU9pYqtQM-1b$;c)j7KSz4#k!zD8Ua*Wl%~=3(q535vf=DMy9k z^KDiZco8PFB=#1ovs{B8RpGIm4{OyevRrW3m`4WScSV3M^?yuVWk8k77Bvt=38h2n z5T!vnL>g%X2??beDd|r|Km?>qkXEFmL8U~xm2RY^q`Tfe;Jxqi^Ki}=Gkf;zSZhrL zzvl+jkS-IUh6IXNpk<-b0#)b~q0b(>_T=Q`7SjM89~Xw;nxHeYmg`hwDA4fKDClCb$axk4^O}~rI8@3e^h)jp z%E%>!{G5$>d||zaeaGAn4~pZl6|(2B&QZ$0f-M|}lQ5cXoR#$;S7TR~Pe4EfuwEN) zKY!-CeED*yOzrHttf{Gi!JVStv$N8N%b*#6C@3fZN2AH!%j*c3=O2_3ZA?v}hHXvr zHkkf_yr#A`I5)739H?wCD#j-ze1`h+y#CZh+!PyHv?(UikNicKX%g-`ySpgUP#kF5 zCy&Y1+!l`P8FXGuNlUIU9!gvut7>@VgP~G-b}d^>q$ByTYI%i0=mrz+IhQL=2slmc z_eMBN>hEWN_=09-)1^GI-uo|mPQBN4!8~G1mC0A5@=Pw!;8`$~kVWPZTPj z&|xXC`!md6@Vumi$Gm~Zc9faoJk$l30aXsWwhZTE+&3f~-$A8AMFl$j$Y{h`<6S5* z`&)xHmuxRU)`~3q6vf0ILF;dSn|SPYD)e+*U0o^fnfxT>wRs42w(jn3?%TKTRmpUo zxq0grn0~y_0`%4BI-xopwh6U6s~<^c2V%03y$vRzSE%jHxUtMD%GGKzdIshg+*kQj z%!|A;O+q_!h%sBikDeZ3`ze{Z+khdgeN0M93dJ(IBfQ+cA3rW$yqL5h(Kar%C-RsZ zL6CyQi3v`?au>`PHf?S`#tp-+52j>0a;Lnl&r5yd#z$zdd=Hz%eZMajDnnN};RVbK zlu`*!XH=r_CW=MMA7-3i@bh%`bn_^WkwWu! zgi6i3K1cv~fGVJl=H1AH4@u8Y&0i#O=12P@4F}N`11BNPQW6ppgoK$WLD!rL`&LsJTw-@`4`8RZP}nCTA~Kr({A3b*;YSuOF0Om-%0d|Cii(Ob9b11! z+(8&(Z5SFWlG4&hlXsef)$r&1l@=t=_w>FD7jhHSO>nGTluLwvPfT=Hdb&Tpk?*^) zxrzACi9}tivFiGOZA^pXw+^H>Rf>bT^u&+u1bAM%)5Oi*uvZX{J#B(c;ayz3?YZB- zm0Ms*GY%$tful zpp!H`Ex9MCuC6|RApe-g7%`p(mQ~1B(8o;JCL=JKbWnO$;5JdLz6>?SW^V`45S8-ry zl(tOF%z%w~4_Z-yffM`Mc!q8+E-|sOD)_!}Z{NN)onp|S-+u`0lUPyYF`kT)oWiz3 z1yG8VR9hSc4xy(3-4&PpEtb>8bD@2&9kuLZw++mpK+I>%!o0#c);qZU7b2+}8GZrj7i76*U^j z8CMPTtHCWrTqYy-xk2x0yu(%vJUq(V+24I&dFy<=JJnBb`IGhtIj^~p`MlA5u2oNR zUfv3Hc&R_U^7r2zokhQJ!9O=(o;uA zZg%#MZ(~rF=yHWhX-aEB*}*I^XX4u6N>YT2-B$U4DDHzRgn7SsTg<*IbJkeW zEe9>e4WS`4aNDbgWS!uDJ3E_21DcFp=c*ICufYD>U2b7q!hBqYM7@10SMu^CBE>Vm zAjz-iOv;!g;>RO&1DnFAa3Cm-o5EwKbd7=zH^^FCz-j4z@zZ=Ta&U_3JJ;3k-$#%5 zQEEH(AXiUi0VwW`djOfXw6IW&;|W^(1x|5uW230J7+PnZbDi`SEh{T_*w{f({|DKv za1Y{nPUKQ&Pgq-HS5J30v~f?PJ)PO4Q`oNaih;FzNRqH-+4is(p&OF7 zA2Z4|OLBin*Tu~Z8f!el!n)- zUf~)qHZX#Z^^rqKmgT|X%ct*!KK%I=gofo)n*N^BF3RU9Q2gs~6NTGG>M)M8*qN1Yw{4fS0eS9uB9bxUNs;GoA4-E}%&vjv(J`5l1H*W$W zrg(i&;bJD6WpBAwwAe^wlx3zh+3-_;DMqCDll4$(1#;|ld#nYzMBsLT!O#p%y^s&V z+ODAd26~^dv9Wax4MPJ1{=8eOt6HFx5gPgvnAf6F@x=49vy2p&bolc&o0Rw7q(V!w z=f{s9_4QK2g)NgkupCl z%Ffcn&c-oE=n2ceE5iIG)@}VvC}8%-Xer(Cz%ku%&bXMr>y>Y(PW%;nVx*T{kKcZ! zQx6Be$36@BWM%rCz#7~bxiM|q}lS7oXz%EThCBxo!?@l0gAe2MlG5jBI@ zwV|#K^B%U)nnVGEh)CrIA#!MhJLNCWP`D9!-ROL$Q;9{->jSp9HU@G#zH0>{fEfYT z0_sIZ!vEyWV-W^#wpRxeQ0{>jSFg-j;lYD#!zMa&ZnCz5JhXyBd&9W^y>zU#2&dA z83WR?e*MtWMunpCt;LV)E;aiDd)Lj)&FFcN?R_O_pojLO5FZrTD~K&p>j@oDLbib1 zu4Mr8C@U*lAC#k}p32a*fbzI5Pn*?fR<0)CIY!oGb+>fv6A|+;S9WiQsy^?DLNgGT zT%4PeC5niQ^uKidUS58_d2cqUlOxPt8Dvx_wQBIffEZ)jGO)5@7P<(frED!e>TPz8lAtB5H*fc1!;=S`1jtLC~ zwFJllEknNF@NZ9Mai@@1P^f^kbmxyKAs#-yxFf(>999V)tt9oM)EYs+jHQsW6BC3< z{Io>?HxViP@zbZHsV00d97Jhqm!3}4uO!elr27DbGCJPg&VuBVfq`L~_sS(7$m9Uz zwBDVe=H%#j?fP}&QEv%59Z`sX-r2gb)6t~?z`(@B1Sp-5a)W23!tXmHF_)v%XTpLj#gm9EjNm_(JH)QB}(cBP9l9p2_#m*0Kc%v-1cF5{bV z3H5}Uni~GtknYa(WmTgZZwc#?_ZP9S=wf&Fh?L}Or|p}_2^j4Fe$d#cv|b8^1z?Zb z#>U@}katge(G9_K!5~)G*Mptw9qf*;jMq%8o63d9#oe;G>2C)L1&4EX(vJ}8-Ls)@ z@J`Gs%Bd}#zvz70YH<%fZrE#uVMZG}2E};Iqn%Os^}G1^7$cn*rH)VZ&eJU-Pp<8F5_@O~Aa*OfsS7y08D4|^X@{l#I?bE?lion}* ze<16EBF6+9FSuinqvISZGW+=$qVw)spjIbZx9%Bf3d=|$noCqXKIZM)=3OFSP`<=i zX!Zuy)07MmLwM6!)E$BkhOhayeQ3>k(}^6=z;+3L)1}AFvN6SS1_lO@4Akj^JOc{& z*2LtNXE=axb(EE_8g+#@vkAM;1qoBLeU~X=H zwK~+q4#KbQRV4tJK$sUhNX5xn0JYqbk`e%o0yZM`6Tvf79nremdWy*$bM12)eyg+S z9qqewxP=t1$~Oq`iUG?8?)7!uW0hNDkZS;ZWEI|nn}-L0Glf-E#}Aw@po*G9jrfRb z?_0FXT#7awBFOJlWo5SSwdEFL)79V-_|N$p8X2KMuIB9)nx4m=Xl@$sb<}t>HRlqU zfao@P8kbuqtjS+u11m{cSy{;hg`jZ}dFugL^9`V4f8_c&bf&sRiF3AMOlA~eC?L`nHIN|zFpX7pTj5u1H%d3^&Dx7T1btNCad8{ z#SOhelS0|lV!h+lUm3XXB5yBPkP$(F77aCAuDwxW1zn_3_XdIw8kdtdp8wmLN5oa;&L#mKj+F0>I zCvuGep7b0{rN2-WvDcnEP4z)inf{nO)kloz&KlTO?~F(#G_LQ{#gHlS#x-DmVIzNp z+HFrhE?ip)Gn_M7hYC=me9ZrcCL3)`@_lSO(<`iq_w1;ePLd5R#O|b@F>`;H%@Ts& zG5mWG1aR69Yy>r+Dizvmir)UN^ISjCwX8UpMSD?x@D)hgErRzJt4KQ;cc%*Z1V_RnP=PBTpq zn($ejuFPj7|GdzbW;M;2jv}u1)q?#Sc+}#5txfII+Ua7m_fWj^@3WLoGfm~iHUzGH z;-?k(=bNKz1RjmDqD2DBUy;l9sHOyJ=}ogJodwUEM7{6^yq?P{O}P&1CDk)-{HYIfF4Gsr=82l}|S*1*ONe zO``47BJ}@%s44n}&bAq12_Z351c+MY>F`x|;z$#LbSlm(yWjqr{aO?w?>M37cKP?; z$}i9V|MtV5FVcwF$diPj7B-eS%01e;5>;X{;7wJy2WkF-bpSh-RKi-6>7(xT$CwO~ zwD_?8QLUGgTWOt|@aR4X+BvxD3e`N%T12T3e=_dxnaevH5@~1u{ge_8BCvks)M&Fb z@!6V7gsxJOO7%}Q)Z$BWxj{$<9v>A9S3h9q80&lV%`A0OFwr_8wa8A1x94m!n;sRB z`4;$0%TgO;q~!h!kP@%0mHBgp_vEEbD<;QNrLQBgPYiNL#sqsEh3k^|*UkMV2)Z#a zeeS-bZKHq!Wln1pHaQP!UBY`}R(>xav@8$8e%HqQR;K0BH(L< z6xH_vKg6-wjh4roY&B--|_Y7LpH=61<5sj{`VFStW>x*5SU+!fQj^LB3dd!N|P zpFgj6`*yxDeMR4I*Ru3HwVpasAe@JKY&#s#ln$_`_$vm6sn5g@jPmiWLy5hb|7~;laU2HYkes zr%L0Rn$AK6V{3U#pAN73bn4LFU&VY~ARNpYY)z1N|of9jObJ|r72pQ zn`w}dv7yqsXpaKTY=8_W@;mr4Gt$w8Y%(!1{WFPG73cllJvugxY7w~_93W&|;|(R! z+NXdsG}?uT#0YgXfKhD2Wau=U$nw|3eyM4-r*Pq9w^rECPeunvQg^t`LP@k6j>r%c z6f6)jtjD6Kr?>EYj69}UO`3PTK`j?HcbeR@r&i0D^oLSqhk?YkISm7IbaYhW4n(38_=cd-Yw+k1_3l$_*jq@a zm~>xBP##o}?nkYWE{CRLxhuOpJ88s5AT$_6iDYgs%?o8$s4-ms&EuvoQO}C|9+oga zxOX+tPsq5#8?KIyjvhInDkk<^z?CVY$4v@TOhXhq`PeA0V%j5yH6iI%?!X@Wp4n++YKq$NPy^v9 zLDPFZctTCQYm8PYb~~y2+{ue*@!~K~n7Usx8MMJGa0msJ##3`vgTsvrITfv1?2Gq4 zsfqvRA4IRMO~`62TnQDiB@<9?1!ZX+dpOIw1S1}28Ij+tYp6wpdT7^X@?Ei~b7iwn z3~T;#g~}vF?Ba*o5eb1px@xaS!2vM+DbeQA`m)_y@v0hV(& z)F&VnSFvnuZDnR*`RDp1b?LqoV{fN5&ZE8^yPA}Wq|ydS#Q|3ZbWiFiHa0dELAU+i zHN_<8belHvQL)hS*Ly+nFv4Jbca!rV`+)q!XcszSk8v63=&tZH(9^4%Fd7v?#Rd{a z&yC+dVT~Pinm}KL%cM1_lK7;npZ;>Z{^if79g}Ed;t4AT<|J6?$f_>Th@gUO8oCKB zrpSRNfYk%h25Q{66ha@<(jgT#0O|7kT zp1kDUSD^h)P1Vu7@?6%m-|BI~$Tl@2xofX9w7|JIId4`8ubM=v1DQ(H><1N4Qn!}e z0sAZ`($~^riGo_Q0SUv(&`{0I8wv%T+EUWe_(*DOTwE{-$HXn(&%7KQ`FVMbyI28r zcSSF*xRSeSoE4$<&$q>d-pJBBve&CjT!%>{DY_Hc&;nX^(*SV;=nT4+D?ONie0v{A zUGI56d+s|gcNE!ZAdAd`tv?l`9!jj-z8 zU_?hlLuu=^M(ylV-2pH|vBFW|@z1uICzG_W4m4eXi4-3n-`dtzdK@h$0xXn=;^L`L zmr9$Y-AmPg+WPN>h3J9Kkr7X*S3zisy2ST%HSuWKnQrAkuyd-b8sQ8IX5899y%{=; zUiPf+K{!snh$N^xQYA)v{yEcS6TqJ6152!#mf+G*kvW%fGeIYwTuqtpiKogwcTNLm zJw~Pdf@NsZMVR2R3*k+4?+lccLn6v8A;N8^>R9$sQZiaROx@{LMj6z&c*LC_&@_bV z?_aNz9bKhwtDhFzKK*i38Z0;R3F6=YwQ0BGBjJBMgXB@6AS_dc^1JW_Cny1cKA7e3 zXO7#L&gQ5P0{ny=Q+GzPMoR#vDr$HXpeZ1e`jdc=5b6flr=FpZf-mGjjFYpiZ;kV# zv*hr&Juhp<4*-2%D?-zxD2#UM&2FP1*;XHlRod$eoxCh=)Tdjygb3(w02N1d?bGQ} zt9o(&Wah~!=&X}6Gc(J|1pn@qb5l?P6l`U|j>>i(D5Eu=wNm_j9^Si`Sxig}*k|jT zn~}b8f>3{jg%&mQY;*O^+f*}4&nPR=t6!hg$0XMrd>TXUz+1L;LN8~K_+%p|ozn7y zbiKH**V0v>!KQ=yc*$4znyMKiry!H1?E3Wqc9DftjHRU|T+g$p%?{?;sS)S$z3JQO z{%8F$bojg=SZSJUh&2J2ehD*<-^_poAcdv#?6R5#xP@;f`v75{V7cvXXw^MLilt;+>2Ciz23EwD2jiQtdq_Z=o zU$i-Lf?gN=Hh%rc%MP%Wd7vme zYh_N7Sg=$L-~v(4y`t7;sLwq_L}5c}r&5wtwr7q2_{56Sl{K`^$!b8K02zm#+{K?IZO3rEm-o8IH8Nt@7hVjCmBmEwpiknuRDa%DdhTLRH zhejMsE+=rlvgUs~lN?G13`AY8XI>Kg6}|H66&dSe(u_IjK1k>Y?fXd*@4VedO`(37 zGxo{sOkt?%xP8P#uL2hDGWW#zHbfze;-?m7Fd=aI@b_?iomsmKZ)4sH7Y$#J6=Bl`PE% z%1_M9j2exGa#9?O<6;Q9`^_&#!Qso+eOCNJM6bcL5#bvkb_uV4jy<;Z&CT=Xj1EVe zznC=qyu`!8!?Q}nI}eQ$MdQ8f2on=tt@@uu2jf9qc*CK(rBtn|8aukI(^=R&Z|$LU zF?IVN^@B+&QTl{O#pOGiH-ZBUI8e?474EN}E?FtxzjyI6|G*!N&frgM&GO=bCzB2gCe3e^sfHr0YmS?22?C103%Bm#x>oEPlU76WfC7?NIFo86!X#I&+z|q}z~A)~ z{(_uRwp3HogZaMl%VBmA<0fz8cH+&oH386|1v&8Sq@-t)DKJ)8Ys?>}G;fSpd5y;z z(D|-1xkKIELj`&l5CtGjRVSO5j84K`XPcQhUD7S&(pte4;`(%Xx4hQf6n}sJG@HJj zlU*?I{&Z6icB&3DbEVIx+F+bV9xuKg?o;imQ1IEEIWkOMoLQJXD5!hZjxJ@NXXHA0tD6CjqnB|>x)kD4-2iFE51V0QeM zq21aCOhzE*704I$CyAXec*uwj4c>YAky+X6mq*HCwplMV8F)08V{8Kc0bH2e*YCk~ zvl0Qo{*$`@`B4qJ$~&)fC%@30W@UF3Q>0tC{;4dY(q9Nx!{5|IYGypW!f?>0 znXfW3@rc6pvBznmCO|8#OO^OQNV4^hYZ__x%HW+Te{j2}OEg<`M<6DDJD8dG7AhqE z|8GPuYVy<1)-baK;z%M1B#Eb4QG4T6nyZXE6i`>0Sbwx5^q(sod`oBKTndbJ*4YW9 z`_JdsoSwsVAe=fJ{ZbIhSpPR2_l~$guiD_%8u$QZ4x$~cAQt@n*Z?Wr7@NyJp<0tyhOGxV`CH?lU+D>18 z^z!b1p6TG5f=eA=UgnNR%rMq}Kc||?b0`n)g8k{`v9}P12r4I|kU-vr-n#Vt9OT?t zt|D0ff7B00J(5irA{q~{vii(VtSJWnAddWGjKP5I!r-fHhMuZy;*g>1M0D+o4 z)cT8|@eXZ}|dh+pnQ)a)$wu zV4$}~j_FZd>5fFH(mG7mV_WP(^c+Nn+@`@}t0Mim2hI(8zc)i=Hs0$3BFgIfOU!*y zaW`?At6su>9wJkAd>+c;P@w25>w6fo!877^e!aH$dyxd{fp6{ys40JYoPV>bB9F(E z>Hy674M-HGM1jyjKSVEULs!)Bt3#ca7jp3%B%cRfe~P#I*|kr%Q+^hi60O)=ZAmEVP!4xDUS3PI6>#tZO|;Zd%hPKIGr&TXk~zj6#Hd_YR}x7Xdi&2F;`C{#e3DhXXP+|=UbgU#j#b?B6iyd<- z$PZpNKAGGh@7v%a=WX9zonqIgKzO_=o^&eSo7H&prS@4O#SkScH#f>^PHaBAmy}wt zbjK)0x6u2|TgL>;)!efg4eiKGwx%DL|5`{`_(J)&ELj_ zC{T_PfUy*41uCWz!!K};Mj=6XjU5xMK7(3Y`S>^^J?KuVUJC9e06Ql1wa{7QwECp1 zI3FmZeBbKM`UU6?9CV{iVTPP~Q+rj@S7-UFw@LP+O!yXm(Kpa2Jrg?dT@ld&w0MLs zFR(L56OykS>iqkYHC59a=l|$e7Y)$}mo`iObNh3c-J~|HEgPu|F(q-AQb7O-E`*@G zU__#TI96j3kDO@HTW;@0e5%teX*#{#4nKu+u@vRic#`gqG7_KI0qSKeQrlNXE86+K zynA9m&$u%x%~UChD%_oJSlw3d#_1(Z1!B9lS=$k}g;eEdLL49e|3*6-wXiGgCDbh< z(q1Vv2g<099!%zUZ+P~dz-ZN*Toq9q!#5o?PF@6!8B<-6?*A&O~UU#KcH=FgBt8j>%K+6bbUX^b65PI;b@k9ceP+0dA0uv z(pI0vhqXTc{aLGN{vVes=ZVG`5+Z|={(U@{4KRv{q1w21CLRMlBAUDZy&O6F(7KEY z!}W1gyY1xRjAIsfZ8yo+EKPf!k94Ewj2gs0nWceH5Zb;fQa8VgA^-lK$InW!=&XTPlxKs%kL|e#JW+(6knXSk}FCw87Ix!4<;ItcgFD%X(3bx05%oqe`-mF#O+p( z#o6Tl9vL%P(*kk zHpk0~Y{jF8AIvh_d*-`lJk=*Z|! zJx;9gT?o2^;`-d^pdjFV=2++odA@r3S&0!}jQ7`4bI5O(U|qcz;7Ov{4-xKGZcuDVRsj;NkX;j+{aD zr;76Jc4@5FuNn(|8mTEMfr^fy+2)(~R5`z+y*AQ3}Yni+M|EQ$!b^QaZK zZ~@TZ3?GJO4>&s7kN8x5z*u583^LH|yq=tok<1N`etro^UZ<FmQ0T5S zf7j)gvnRx;6FaNc_9-tfwD}XzXQf?b-3JlMYd=aZNjEa&&IuptWE!)D0lnjHj$_VY z$!5J@!w{F-7H4AjwC#R|#hDXw)QNM++xqdd%l6B{IA0ti#@3*uRjlV|x8vTy?FOZU zyYIw+8HKu|@sPLVTodV2)`xmRtZpsK(eer!lq>UpLZlpKx~%37{eq=VzKfiExx<@= zBAR@ibNTD#$!~IB2gL=`Ib~L~B67|s zVQ<#)!$=hD66I61&x1Z*PjZI1q*NVScM093-TDx!CVh>CeCV!&!Vb5ntM@ZeUpTDG${ z<4D*X_^W zxsnw#TQ(*%K(x8h@o{$MXEMg)#^wj<_^BhK4SI4xNLg5OU^5Uus^3~1R<5l932sDX zzf=R=Wa)$TQntXazyQJ1H$Qf^$WD2jQ85{!$Rap@o{Nrm=}GVYF$ex9qI*ll4tN|7 zYW-gl`#tt%PGQOjy)eO7;G4}z9@5rWKg9%(*67eg(dgBP(`3`s?juP^0C1p>_*;y~ z7UkeEoD%@6H9Mns`4*5z#sFszp+)DhP9WG}sA*(SJ)6i@5;2@hc zcdid8U+kmQ#N6FA_wgAhPdQhONUIdJrN4HOwXOF;|!57L{jyL0bv_fN)!83to|ZKMgdcKgK!n)1hvyMD19 zpbWdjH&(JFzJ{!&v4~3+j~dg-P*gZYys91-b6rn*^c|y) z(R>ZBL4u`KIqxU|>XM z9}}K`ueDw-UtVc5r*)6|`Mo!)q@qse{Ak(yzE8Dzn;rfVo028XVGnp91w*5lEBw^R z$9s~Mtpge1^(-B!$Uj;&oLoTyk7;i=n*qYnI8BN)XfbxNYL9Wf<=YM&C8Oh;AlCh- zrPZELIDEg-Q(srdFTg+8Klswux49=bP2P;0c~v5T}gq&7A!2{ z>{aR9-mAdKjHUFJS;UZg$aUH%`hsUs1TyC+P;W~3`L|R4@{ZSgdOm~PKR@*SWS1`2 zAEa=8J3gw+;tse?H9DKz&0O$U0c*8k78QusGpXWy)3Z1a=YKq#6@pT^rPot z|D*}NA>ibjH`s1oE(W~p%T=ul5;Q;OgDl;!=Y~4Wl#iEcBCz+eEVl2-$-MwmM6}85 zO3Q_?>w|bX1(ytL2)|l;eT$OxGoAO@b$z`f)UD^D{Qcr3pSoG$4-TRc0?Qn`UQ)jX zqIp5|%Kl*5GCB>({lXJKr0;OOplYhTL5;rep}su5)UC>yJ+V2H+k@YlvGZK2l# z&5`-UE^&=uhoLW?>F?KDQ=bxEAB`Sv81D(;2v-Roub%g;-P62Jb)$7+I-O{yZZ>@M zCM|dL5w~ESDDA40TfFU{PH-4c+tEl%>J#cHjt=JvYHRIZZ~DaCN5gnnkYU#Gp4eKm z?J0wX8|(ZSrL5dKre+0JM_+dhqtV8^niQFCv`(!K5O!?eaD6y3a(~7mYBi}dHxrJC z|F#o>@k`8Hs__xjwbv3yn=9-yca+oT;)~v)%a^h6k2U~GtPxpV7j?W(uDazV)qe2l z5dE=Li^se1^<9uL6m;1^l4dV-K$F-u@cmc5Eg6e@xn31cZ|41{IcrVimDDAP0_fFc z0Wf{jGSke4a%;}XO&G0?Ms$Om?fv zz9fc!)d^xJ3Ct)=-&S78;8razvk!KP>x&jyz?wvDv6j<$;YqJLWNu!(Y%sD))oZw@ z^Y*K?#U4_vUh4+X1SlpF8vm@aC#U5&FBO!oRe6)88eL~uF}4)Vu#BRcbiUt^hfOqR zs(*3;my}KJjqvF4R=zZ4jbOr%?Pu+W!WGM5OJ33E_pkFPj8J&-3kdTu-g*&9UK8bO z7>p5oO;uMkFA$@r6pMpng!P@MBSmm@e7wAf-eUw+Ni(q440Z|X57K07X?wl%rhr0= z!SWThKmIMlinW)1eos|Q9tS)5^HWF02Pq}8rhWs88FJ7m)in;)7+A=N zMsWF_tfBdmLh=Iz(F?9xwQgyJw1?Nb+{81RusT;mE7>3@VcgNn-?aF{WeO0&YY~#_6?0lCyI(cF7A%(2cR&;bij`FHHS*O!_&>~ozY42}?6&FZ!;DK@w6v+x zqCQtmH|yB!f#pSEAq<6N6?X{LlNz0SmlEV^T`#*y1M>w8%*qEI z?i&jkU+tfj>|X5YIsXc+!#zQI9OBgKy+75R=}(AsI*ibr$QXCSvgwZ18M{iL57Qt| zmQ}nU8f~`uE^TIFM)f+9;kleIT~N>}L1X+z82yONtbao#RoEoL>z#OT@S)R$ZReKd z&;xPV1~K;hFfrI-O8V;d_PyhU7isUL7-}fq-{MdNjJ&mJPi1Bn5N(G zJ2J6$r|gYzn8v3Ax_WhyEuaB8^vD|TXH%CLdUf@Mm&i0V-tWDyvRhF#zxN!xyxYgE z^50HZA)7&4F~D{M;zO%`Wl2qlZ0dtQU%oy{9{HZ(N2Fj{;f8|o4-Ktut^Rr6o4$SJ zy`J}8rUkNH=Dz(YOsl2-R2$pv8r*c@0;$lEA5AA_@76w5 z)#Z^$_lQbcGS>|qfnPsV%*zKOijJYV$>%Z^5{*PZaCYXI=MlR2tNQKcuS)S=7Souh zN{Zw;O2!9P{WR9gb(1OS6DySyWwJPhl<7%1JHN(jZZ0cp(oGZwq)#)lsM|0L-U_S3 zYFD`2C|4P``bU7aoiXU*t!566;ZL6xE|2c>*fm&oeh4*TaTyzmmY$S}Bbtub=%tOd zk{$et5FBIeg)c_jnF$=5VdbxQ@~LZ{l=U9N*N(#;L$bL-sW;^G)~+_2CFl*52t1|nEz(cbsL@6j(j`9(^N$!flxaVd@|6&J z$RAbgPIBKH>QG}{anTpt4r?<(9B5uOyX1wd9@oG2jMTtph$4NWQI!~~i0_lI6p2ni zMAX|RnESim(Be-09+S>Cr8A%NuSMB=O0&Y1bqy3xM=HJ!9*G5z7|TE zo}QkhSm=NAuwPF(09OyasZbx_h5%b8iY*QL(I6|xa7Z?X0gRL7nHi1ixFyR!pF}it zbEe~zER9wk#NSH;!_3H9r;vWrL;r#mIi%S?=65{myg)K^BJy!gYt2AgTN?_@oSdAs ziqOqsDQpX&7JsO#Tc>zU*v%1MP;IHp^{7ktxZm2ddw!+K5Tl*qt?hC1obFW9Q?{JR zyV)Wg+n*0%P%m}3XHOdj103>Frtoc^xj?=w(P8tHz4>a-?tM9=)JFjE7CH+>v#J1q z1_9hi>|oj#0DmAuXhL344eG5K)1Y?>%}XzHTY$0L=HQUsk@qQlfl2f-!!b2(3NbeCqwG z;jf-$eo+(b^9QaS88z1#x32Xz)V2Ar*w9#Bn4Y9> zqa;l8(7Ww1DwS~YtZNEoHco9H5J&=og5FnN<2F;?Rg+?rk1?>eR$xI$3tOAY$sr7ydm^>havaqtYkB(LXBdA;Q1&Bcdc8O;NSzo7Rd8DlT1K7Vn zSaAfvCE2Qh=Qu!cCOR;a_JGQA88OchgVQOl+{O0#UE#b$X8(~13KfZ>h@QU4akg%m z21q!-*$2RyCm=osk%WL!ey4c?b3$MY)iScihn05nUz{Kr1!6_#3?;N|={(oX6kXk!=5lTc+VR8Rk;O1g3a zx`muM0v`(tD}MyspEctjNVfljxZU^PBH?F3vR_at9CC#MRBSsZvrfP7uKtFQ`zexk5D5nK-d zAt)v61K=R8nx#aq9^nunVbV7UfPoCG{6D~b@$vDwnDzlg16(%e3GF|MK-;CVvU0W~ zF*q<#f~@Cd%XHY7KZr}=-an%oC|OO8?3G;<941#dmD4}^Yizjm`OPv zzf4JaY+-SeGeZPI<^6F#O1Tcb%bE2+IT3JP{Fs}oEv%Z1i{LOYBQKtm9p16cWBuY5acErbrZwvseI8^X#89!DkI42g}E^{NKWwCbQY zVw429o5-*Cu7)?Em|LuP*;OII!*INk6i$!PK!Gt(b^x~oS9Cqtc><((5s-*j85h4s zkP})%0P7l1j?GaUY@mpofB!irg~!&S7H}hLAA!jC5fIU3GDOxu4Hiz#d+Fmt{d)e_ z@^Wr^y0nOWjrZ-&s*O3MOZwhDOJJxOJwLd&$(dvkau5HI5V!IPO7vtGkaC_5P`$3VctVk4{2y=y$|G}iynL< z)4#Bg%UlQR9tocvl~#Sj_xWG5v)f>QudCvPTniRQ<|V^ONJ&FAe6(4anXN|4`P<2I zuHuHZe}&%Q1Y46SmZha-+Wp|hrY35_q3_?%soYNlwc^AM&}#?;s3Z)?tM>wlKV)(~ zAYF4tT6B0BnVEW@?at=kj|JQU+r!Tx+6;$IT^|%c4&=(cO<|eu1ji~FNl8i2>4d!P zj@;%eIJFB-)>ZON3=MLBA#`dQo^yt6jo4rdO7cEmLtjOX{mK?ww2S52)8V5pNR{x`oFu*(s* zLP-DWxTOQsUOzr$B^E<1Hadg~8}wkdZZ^QakX0@Y{4m(%Xf;74ee;Dv9M4ZPZsMBks)4lycUtnPnVAW{ zb7#&ZwF|p|`GK)(W1=wT7Pky>69k|Q_Tse_U!B-d(L}%dppVScp-ThK(hO3`Z4Y*im?r3$`0_J zhkM0fC!vD?m9Fh5C@27u_*X~sJ9q9F8KwF8`Q_v+HG~NkFx|ZQhC+Bx4|A#t`4}nj z2E}3>huui+gFKw~^n9oHK4iyJNK@hB;^Hf8KnDj>UV>Xx$AuA5C=K zS)tz4Pa_=$kpTn%w!mhT#h2y*!4GUL1f(bmJb*1I=avU_%ZdGDHGl^JIWdHjcDkAq zF+zg}p_{8-Ln!HH_P~LGR!SA1!lCiZrkVH53b=|~Yx>|JjA8|5b`@~#zYGI(9Kilr z8$1BGp?3#Cv}B=vU~wN%!Ifl?U<`abyvAmj{(!y^5tYSi(0U1(h7%<~8I30NBiM9W zDsx4UzdvRuZ9rX$P(KidPk$PWad>#x)cot0!RlK$FyIxc{V#)23b^P?Px*jN3GMtS zz0|C%As7mgL^hsOH_Yzn71UkL*C8AtGoJu$Y9taGBk$gM0zDDde1Nb_f4Qpz3^KgO z`q7~~PuwAJYC$u6zDgro^JlU+#tCm%x${BT?Y>-n#tvOj+_1Oj99V~Vu_+oDwB9IH zXu#rOg18xw`vJn+)7c4F>RU_IDJeAg_~CF<74nd+kl%rOY>(>|z*obu;J(?3f=^kC zJAeKR)fPX6b{6lD1F`nZnfWWBG7`G%niNCa6D#HX=*!U&TmAI}hNL=&KFt_@!5g zFbvF)_PI41O2e#g$02%>RYe@w!$A#~TEC|guF%B$nDl-nnhpHGrs&)s;7whDAJw+S;vSA`0cpB8L$rc2ll_-OfJ@`6UIzKa1o?6cg>E z!*O3W@XY!$1h=PP2jtnm2q zXJXTbg2#vKy&vFR!!yCwQy|K5K%ORjl}yI;x*x7usr0Zvk&E1NrrDyw#7O39)7or@ z=!fwpWX$V+!bK}8E;18BkKgX;KczSn>UjdAh^yMUdAGxpj%&JxNATaqU11NnsF|qH ze$|e@ZLZf5TUrc9jJoxShl}Tn16o-J**ia2tOL$`V%4WIKgN2w82=|GS=DihdMR*X zHs#fY_jHw9w*y%-H_v#;v8NhficXjK6EU$&b6FuXkqUCNidwhlCKPZT1)akzea%c} z&X&EWW?I2F6 z1?;7h6@&<`FVp8+8*jLqq6PtDKo; z_WSG%h!wuoXw*>0%B7I0;~-bJgx{XN$&%+QUj9t{wD#3q;Z`|WX381;+N^0Tmkibt zjnw_VqVHK!%~l%$ETMh@-K3nN3F-)a24Y_(?5`NJ);?sHV z%m|O0qR3D4Nd{HSgZ>Y>rfV^QS}CFVKQ9D5q~e*ZnZGY#=b~+@bB8VGW|Lr>%VP2S zPZYtM(T}k8nWivaQz>EgBqXN9a#9lC;3{soe4qDTNsXG8XShtq8wSV5g%ADh=Dww* z!AX5C<5SY^-H)`+2O29zOqta3%}r(>=nInl98`=zXlLBM#9LTcd)bgay3oU8y{4OP zq`t%x5Om}0q9wgqU7E7t5zFT^ver=>dMl>7#|PY{gV-;^JRfkiV!wHsBX^#VcI}Sq z9J{8O(Zf!wo0tj@{D_D1KEBCYboRXdD|L@Yf3f;~ABR4>ioumju~|b^*Qpt_fT{6eI+W6 zkH(tG=uh8J@MeN-MfGvnBrn;3Y@A4nb9mm-9ZeGHXL*0N+zrhOdYt7^EIAc{ zZnpLj#~cPghPG55bzVlB3o0zltSNX0qEb_cgOSp;ezQ`H%A8?vNoye`&M8F*J-
>)|DhZ_=TBCS%z>wI?=~dN^eTA>GVL zjcHFVHRnFUTFQSK{Ae|vBoQ}Ig|XL3r73BaoS>u~-IFB*eLtdZ84HBr{Mklvuc0R754>bnJ`^Os&WC5x6#hM zW(BP|EeWR4rX3cc43i*Ri^#=S+5cBL*R4C1GwH?6yMfx(_105kVP|B&@cQ{4*_%od z9td99ngYWF;5a%s0N%1EuvWy62+7APRGpC4kJ~Npo5lz~P+S+3Ovl%~z<6=hPpV=B z`aOo(qK<$2rHPIibTf)q#Hq;|wH-$XRv!==`D^L0i#57EBa>ojZmX4+-pvi~f$9be zdrskzcVox-ACOVng&iqgkx^2SelVVP=vq>Zo)Uar52Hpf6f@RuXZY7$KPak%N`8wg zK_obo7r1>cnW{a{y@^myC3Y5T2%9xoQh4kB@hE?L4qI0cR22`<XPc4Qzm&_JDN~H zEsd;*>s4$mFhuuaZ2L(9wyXb#*5i5u(OB9KQ#|3+Py&cTtloKKD3zHVg(oa5CE`8V zryd~|$_ZdQ#RJ(`PE$H^pEm&Bn?_zoKnJSwS4)${PHLzSb9$M z7%8=;$I)+3-}v;Pm8Tgh(4(FnoKbOq{)L`1y;pf&f@^aV2BZh*&2xIA!(*8x>9I7^ zx{Q~`6s@N8)30BCx|4;4nO^IRAgUU@w5B0QLv)){UDpte2>CHC;rroYVF@Bwux5~h z2?AUg@ZNv@kU@4thfX*!Gb!ejNx{gJa&g2of@~oueiM`Oa!3?N5Z3#VsNV{IQC2Tj z1gAZYAT$^vA0W`^TlfG4LfI7`L|dc3auaz#QlN?AzQm_-Hq7Z9lh&JJ5T76#3&PVw z)-}CE`aqw>fi&BkGx{{{8XBF!A%QD>f} zv%*-nGKFe?*hIN$r*9R~kq8Va@nK;k?f!ce0d9hLlA3`L1U?+D60|^6Bgmf*WrorS zEn$`!#gquO@|W(B2Py%Eml=`=AAjZo3nV%|k|>aMo~!uIWwmqupXis3u1d>DLmWNr z!d&{BDuLwkSz6rI^Ze1)H??Y_rG={1V>9O=DaoZ!I{8wSSPn#vVSu8we&S|f#JtE14cWg>G} z$OZ-_>A1=0KUG>XR(aXRT3t0gpWA5TW(fUzuDVe(aQs-3V09TDj`pN2y#Q~jwDoi0 zy9Tu6Ms}=OF3jCsOS|>0r+;KzoeQ~}Zb-UnM6C)m(rgV}=vlaQE1me7PMdod=_Lsc zZ)?$@3T(2BOPM8is+*ODDvd3;L*c7x?Rh0B)q~#wHP0o;nasEPRGeOICS}l+02M4~ zy$HQfPqapC725huXhZ>|e{^0@bk6?&^KrOnaCwPZzxU;{yDPl>?ZQVxQ(Lc&1g{oko~`*3J*j)VYY zK9qQDh5GrrmZ;)J@PE{g_?s+_v;=B|xMFag7NI_G0J&mtfgFK`IRD2z1O#GQPcr^^ zY;al`0c2==m1BF;iqHU#%X~dlrG{vP`>NcgjPPr!Z#d9#wV|nGkk0NH*-ocM{$@rY ze>~=eLWg!Egg;)x(x40j#IfmXvM&Q8>&K0d4pMkMdSvc{W`CEZGSd)_TLKGu3X;UB zQnaAEMbXh`wXx$Wq-iWr6xlYN)>4%)(I&6PNgth-gWRY%4sxUBILH-Kr%Xp{)_uk3T}sG4k_*&dx6q~bYeaZar`6V^7jRpd}=`#jof*{#akI22O( zR<~_eu0cJroR5C-0)wNluw`w=QB~7wd2mc?=IJJTg?~UbrDwgDYZ|~|m-2x!2bU7y zBdc@kW(I6-Nu*ITQddX$ra{KZy(Hs1w3@sLO`^#3Ykb_rSZ%S5uDz$*P4ghm_u&>G zYU-@qEK~V>1qy|sI6Xl%-^{c=PuosSHgTI?$0y_wzA;+4wUt|__`3YjbvY(E1M5k! zY-Dx)oqwkoVMqDp*;w_;bVlC2=@ZIP5eCivJ~3}Akt}H!bc&`$JE8T1wcqW%TJ`HN z_NXNWG%H~Ja_ivSN_s;lyI#v~#E0JJo>+7mcLt^ob6QpPj7oG=yF70Rv#s%sR_Nc`Vx>aTQfEAg6|`_lRk2nK z6@N3yEG_5h_XbL@jsn|;lm@$~kYR{dS!77@VUVqKcH96(On73%~r6_JRTBE74a<4Jk**k7H z4%Z|*XWK5D-i+D3Mq1~OA<}M~i?+SOaaXt2{Ts*Et25YP&vuUWB{{Z%IkiO#q5Kc5KU!tvm!}&acLP_H?0==3 zfFe*kJ=6VZ%J!O7)2EzjhSYN@bW$@ag(@G3&S8Yn88-$|uIP+xSInlKGr*Q@<~>U; z%^J)m9yR4IbhujSJl2R+gN|xM-xDwNBc~{d#QCeW`lQ(D>uZFjAe!VvW5gIebcg?F z+wtDW3{^`78I1_zhb*==jL`CA^?z>5>OsdnM3^y~ToH0w_WTA+ygstxD4#5i`YB~p z+-U-6oy)pci8>k~DM3*1&qoqrT;f$)s0isxE5)^tpMmq&Al6!F1b#}*OLTeJy4cf? zyV{`H3!bpZ_7vOJtN7NJ9(OM*f^QkIOTV5Ctdj< zP>uO@F!PCEE^gZisp8LbvwzsnjF0Dcq1AbTIJR(xUkzfHdCrrW=!xzo+)S(4F_ZIq znYXe|VCYd+_uB~RMuM5-eBPtC%<N4!CWs?0wu75MBl;|A*&z+`RaVZhQ7JoCUqH36BJm%^r^w_K6c2h}BqPf26 zTWry38^Eb8e z{|A9`(|?m81{1gFng^UFmsE`tCV#z~%Z}r=5{CEv6ncT-A&bQu&@fetqQ}G#wW@kaH>NF!Z~nvpRi|!cq(2=n$tb27iTb|4zr1 zu8Y_%e6O?(Jt#VWuAIXa>0VPSPKTzJ+Qfe8GhzI3`t9?l7oMgd=q#G^+vm&QFa0FY zNG9Fz`}Y_BIZDB#g#ox`8r1O5e}_L`el9)ao;kDrH~RT8>e4b!U23iAYFzt z=;BY*SUNlW8=8Li%{g<*4S)X|exd$(3*8EW&b3x*1YJ00G*IV`Nq;Fq_lS_-DT1%) zj09Dg(-+M>V)UOvyrM+Bf*{Z{`|2A(pckn%a~hFS(lL(ifoZMaQi{><2jNnddeQ}# zNw^3b{o{CzU=Tf=^tT5lGQt4X)D{7yF6;_LZ>PoTuhB-mt-||8x_`SVtk6Yd0^LD$ z(J+*z(B+LW>c|Yw{*UUECg)FGL(tIv#hZ=<<;)+;onWWtGqXiCk{ z*i6$KD85CX>g_U+yhJvhbl{Wh*>jTfmMW5QD%qGgPY>ta_p=e{?y0XJ1z;fIY5kV* zKDpmAUW$5P8sl^I738L$dYk#PiAB zmeGRGRm3rQrvlBab<@OCo|FFy#mH@!)WioUe-W0C)0?nbve&vK(G26+e~~W5Yg<#A z-8@z}^O$uU!RGJyH zf07#lb2fK7H?%vuSQ}YZ;x$vt=~b5JdDn5T&u`egK$J{1rT_V)d{XY8s1znkm0ji@ zw51#eh`(Z}DK3!q>ebUznU6yp8|CyB0yBi){`qU@KKYiNhM9L7Jlq3;&bFl8#hBD+hw7&50h$LrwXT<< zoSzex^`YJzCnBTu*$*>phin_7GE7tE*!PfY3!TL3GUS;46cEXSDqSST$>h0Xe-4Tq zu3B*}=bZ2HcYc|HgPubE5#WqI`SwxoXpm{jHo7|s(QPN@)|OhS$@ua%QrZOJdE>`O zx}iuv!Z=2sG~)oudQeTq!BvsI%9aUNvtt8L6ku`E!~1Q?=V5wafGL2D^dJR~p5DdV zK_fRmVA^R3QsAJa?OMxBe!Lymf4mpiv~>)$1hDrpzM}HyJ9mzg-_lg+I@}Wim!rPa zKu=9S67}!yV&lk^V2I|JvQ{dj#a3jy62f>A=5m^Q?i1m<(29uUa@j?PO(mI5CEC() z-k$UAXR*Qm)@H}<%cN5w@lNCb3Qf___AQ0rQ?I=}ht5f|1!`VCh6)NPmwKzzUlRk{O z623|*t(zh~mE?GR0;1h>S!M)Ihdl8RM&Kxkz&1k++2PlCAU=*||L|9^SVa{I9)!hG z=3_;z>}t*z&gKbRc8`CBe~XC``xq{ixpRQglDZ}?Z!=6>VscGkT;37(uc@8g$aD9+ zS9t0eosZ$E{Y7l6$KamEs+g)(VSVMRp`7(@o2X^NnEo~!j`K#!yJ@UZrlQV1B&yxr z#kPvVcdP7=64ii8cU1*vX-2Zqk|-spa8*aLX@zYzJo3D zxd(WUU@0{XQ1m@hP@NSlqt@Fu-eiCG56${_k0z78rKLK*t!gKT7VSMLmUBvG)j53* z_Lg&uXpfD{wN;A0V{VcIlU#1Z9tt?}nq6!8cK>~a^42wB`t`zakVq`NKGj~6F*xwWX$ z{zu<>;;E)yYR9Ug88JbTxVzgejXmun>=;{ES#vAyI_FteVoq_dl;c_yleF-fQ#IQP z9B(J7UaR)gM2MP%*&3s2N;HmTN>))nNK@DV~C| zv5clrjdI2^>_f~OY40T%A8i26y=a?T$=REKPTM+pOVEA)4=vaamyyn26SsfW2l6JD z;8sy4f4y2eljFD%&gWM!ybT5h(2ZBsl&Un`nXS4i2ev1>y2!r0kIQ;qB@cro@RYVajg^&Ny-*25vPqNHlt))*FW&ZN39R5Q$f2P3@{P4dt^hX>n zf9U~X_+$7N$(JqaUJ>fjT4OrYRS?c<5*`G^TN(9;4-!uJl`g^nX%`G3kA$oV@wd~n zl@agsjgUgZ-S~Wm&`bb+je~T7Qt?*3Mo6bCikENv-Dap896ERn1R*ip0L2xEjS=+! zgCI7ZB-zhH97h?Q;WdOJy1xSA!%$p-e;83HlK&Wp(Fp`sAvO%{d$!RF@SgcDoSsoD z>|q6l6_!^AE9`{z@ba&~3LsQa4}uk}K<8^ncI@iO?Q0;|WzYIT$Y8V|XU>Q5xq`da zLW91W+^X-LV8?Ge$q*&oNJ= zTiJiyPM{A1vJJHHnRh${XcM%s2rbYBP6M14qQSjZlN@_9?2?9NGqo$xYNxp#U+onX zU8WX~LD3T-_gJHU!No8}W5MfYe-wA-(BrGUf}+jr;V~#WDV&}NwqmDu9Ti!G#M84u z6?&MW>*7wR4ln5%R45RyutP0^FJjkJ`=p3#nw826h2ADur5ckn!Six#N3m*1lnoQ% zj8yWqSbW-|ixRXK7#0%bd3zQ}VX1(e&5GUx%9WJynr$kVyvd$mmQ0wrfAI**b4DI1 z*>^c9Yt6<+J{N(fk8iVYt3@!`wotiBYl~nE!Ye2>@J#9+hoY^I5J-xpQxYxl##ZE| zK$=ni{Q3JZ`{keCCY3d*Oi=eimFg;gg5J?g(w&NX7TEpL3Ir{bwljemn#kB_S`CmV z8%Mhgv&m_D;#O&%+;IjDef6BtU zUufa9U2bc;Fi_C8wXGAC%9OA};Nqt9{>-EpxLrT0ZGav+*Dr#t_UT3jt#Glz*lLpR zwdRqxYfA2f%HE=>ry|IOg{E1z1=gN&$3#<8WH9A+OX8FO~{vY0*df{OQ%I0 z%t+D&Zxzu}48*7$S25n#FCEqP6Gz6W$JB?uwJ5!-6$+M&ZIJ|s!Wn5l+X&^nf>b|w ze_~aaYu}YfexmHf$tQ~1yQ6NXLnN=soVnU> z%cG`&qxKX1<14>{s3Pn0`ay_N$nX?04k8+fOrdOP-dmo#){@+b;^Ea^L6O|i>Ib!w zFiuqJFp7#p**VusFt#12o6tPG>TNWspcU5QW6*>UXkyoKe=007qNCkZ#%J%n$=g4P z=<$_bLDU=Jq2skWY))N4la|WBlFvDkLfh)S5`(N?!#4$RKJG%}4yPn|*qY8(Iqf(&#|XC1r|8 zeDG9u+>B*Jf2w{<4C9K~_$iaH9G@w8vb?TUyxp29s*^2a!>C--T(Py~!cT7XOqN|6 zGpU(VPA2QTbXHj?`n=BxXYe z=xl}Yjf;ydU!ONF9SXj$mr0K7mW**Gwe((Y(bpq!e+a$Mw_tu|WZt>)fd#({jkLBo zYfic}Z1adXXSP?!_L5@W!d}4Bx+#M!*4?3X$=Xm-c&DaC8}UNFYKDe zWT`Ace{CY-*xsoqV>!TCd9NbvNZWYEFui$oLVRhCj;g1r>S3uV$exvC$=hQ9p$!xR zX87r`wVmmSH6z%yRh769c}Mk^xO+OJEVY2U29wc9R7O?xzU8En-O&{C9|+JUw|rkr9y zbIeuaN*9Y-uQC(P#w|U`zcfCuIIZBLim^ensRP=4J7L8-Ks}nyPi%IfIWjZNfvcK( zqrd2lIp)*uRW4TWo(^vrnVChEw>PpLe|`S-!UShwH3uk9C7qhT-DZ&Yeq$pKG@vTvd@L`X4hUhC&EPFE|L9f=Rth-HIr6IKzbn>?sn3ktR*Z$e|K&r zn{;9p=b@KR+$hn5nM;f$Ew&6G+)rm?g;e)cxf8fdHLGdnZmU5JFI7r90~0O9a~lXb#K(O_*`bUaYzHweTI{L1&Gk#41oWbx&H1zsRZg#A#;* z71L`Z4!p^a4C-a0N#e0I-7Ymrf7&pcWJZeX<`lPivw$c(%Pom7UB0JLSyl?Ug zmBM5xkua#2l{Z@A=hrn2%>svflHKULMf&rMQp)g3s*dHwR?R6l|GF$=%FGKbs!V2T zS(Z23>LHMYX^ZVJ;g{4_dY zAapbSzKLI~zjTo& zt|dwV@)O%mH}}M$Fb>)vyrgc4t@l14Pl>$CsVTDw+6E z!a@QdZ&Ej*i7NSa!;9Ai#9sIKVvy}<(|P(luVJgv#W?R-?bEj=lTH1OS9ix!;-auM zuC*-D47NQ>`=&3z-I$|a`cziZo?L&0d<=r9}e+@|ON7hEV~LlK;d*<|lR0YhgO|MAc7c?c{I(TV?V$amjwnx)b7t+TX4HqO#W z?ABS@Asc6DwsGq$?T|dnQWVvNqa{9jAdtEppn((0KN30KOJQ5A3}9)@o=|^z8k27* zRD%Lx^l0Ob2i>{xQ!KYxEWw zJS00bew8)6${Z(ZZaSmt3hdD-kNsLp&E-($hmBDBdSrv-TWTd*D@E4NFG(1j;_;SfLFS@K$}VW+Z7Rk7{9EYv3`Y7qg(DmEB42_4suUXP$P!sI8oN6!c7c-&Mc5+|489Rsw^W@%XmLqX7^e zW>}|y^?d)_v5q{4=Q2CexQnQhDVUm49lgTh!n`4^nJug?>H#BGjI0gh?4dj6$bPP0 z>5`rQ;X=Wdr+sqPEct(SN}2_X2Ox$Ox`fk{c>dPmWTi;qoRXuN2nVOX^um`6=Ow3Q zQBBy_Uh((UbFxXRJe6$eZPBy)X%x_!lf52STMBPU({^~=4QGJb2eOHwvn*E^%-P;G zdwE{018edmu6JhDK-}-d*fI1(CpPLXPh&`Qw4D&trYWr1>kfZ~kCytuC7rI7oFd$O zl3jdd2`%e;Xv%FV70;!s#_it=y>-Ib(Rtt0w1#0no&=QIU(%ay_RL(*zysBN8v}lr z9d$bjH^J|#?rTH#-^1ru_ce{Ow8RH;w7W@c~gpVq&J{yUU%%!57M?pQgEVaL48uQUdJv}b@h#yM~pcQn2 zuV5owyO*^Bm$NC0dk$O_g(@Fr9v++U;byHCmj$fWf2)5W>gJl_IoGarKI7Sj?rs!T z(6yMt@aLdQk@$FP#mGh$Ib4Nfxlf=3KGy1nlZk7joayO+KKDP+I>*>3K$=~jM? ziCg#_H`dr|l#pKl3k)*NPi^bvpE|gkKMSe;H|Ug ze~!v&BuZl?-!!L)RY%r5fw8K01@Zn{y@77CJ4p9L`DP*%SD~AmX>KFTyWv=YS>>?e zIWQ{_U~GG2kA5q>;L};k-vsY&7*^nwIShFYywZONaIU>TnDX+s=IU>;0->`Nv%})U zE1~N9@Q`l^=8_*h$MF_NO8ejW-EV|=Hx#!a_9+y33cx`NRQ`T^0sHVfp2R&J-@Q28 zM%TsIv3B&<^C4Zp@1g7&_e2{K&LCz)2 zPN2I1X#lMh6Hc52w9*WWt%1&PqKbeAgS!@!yiLszpi+WNW~vLuBii-=lHC$Fkd%^1 zB~L<9B17Ry{Lk26!s(VVdm2f#6UA<68z}l%X4FY23Sd~`qfdsx?@jIV%c%JIjv(9= zCGWkk6RB>0i5f`Jue9)(u4K+;vMa0|CDGz6=Xv7L;v=#-_wyOydG_B?8lkaF=n~C? zp$o57U*4FH7;3VUWR1qcCpg44YCm16bAesD44FVwI;B|;0R4QQ{kK~BfCW;potHjV zGVOBZGb37{=JW(Z|A)^0`eT?~`6ZjaSvP&s62gFgs7a3{6a%LGb;-C)%DGKPk|YkP z0fEXRS;Em0;e?>~lWRhZT!1r?{sb{5SAO|Ef~Ey?+|1v?F?gblr_<^)J}AlX4A+YX z@7ZtRr=;FnW^QCYhXPD#-3#H(fu24pfV6^9cvMcW!S zO(83PPa)%@zqni*?y~^!HT;YQ%IBFw6#~SJxdWz26}!-K!C93cFO`MrY!)Hro2U7g zLVCaLW?xc*HxlLqat7B`C=#35+`nk9C`omrC=*9?NmB44ihW8+sC`I8oDV<&yc$!>! zXaR;vvEWgTS!bUeIOfa(?JQr9nRZMFikba>}?!N+S^LoBshx2b7R^zeQ7wy)HQy@1AdfcKqj@#&srIg zDylNEg=iFD4;zAXHk9YH_iscy#U)c*Ex5hLSkZx7@#`gSd7VQoz&j$K0>=cG^A~ul zlVV2o0Na#$!h~RjZ8EWl;A2Zv)=;j0TS|WG!jUY1sNiAy17AxByUN82%RsUl;Z%u= zB^%BZ(02BDN!B8TU$ZXTPvKlWzxwH?y zZZRA1`87;wPJ&NbW~usq3}4ld*Bou#RclP5vv7mJPCnF{QSoU&h}22>^% z0_Q+wfN{Amd`b5zq`D<)Ace66I0q@M=%$=>kla%`bZhlR?T?qu1i2S~vTo5DkU>oQ z=Rk%uL*l9d*+xwxT&FYM7Y;75u5{+L88<^s;V|JQkUfdkS(6+ zj-b{pT>~{83xRV`)4*WtjNX84eFY=q(;v+GMQcEYu@E>1GE@wIjCu^&T9vUGz7AVj zw|EWMR4fY4fej=>0S(wzRy0=33ztY9SfT9~vjLxs1;RP-DZvnNXC|ktdAA#;24lH z^;#dRFoxl{Yg#^kAh?k3IQP|$s@qi|w5y7=z3O+=W*>Q^5j^#$+{cbFPp-5%^K|4! z=+rlkw@5*#%RP;}6qH2HZ&#UubWxh*)nA@$Xjp1RbN$>;{n>`2e3tqu);U{rL6jqlYvb>jvIW`&+h z=sk0@AKykb`<4>8ueYNZGIFxq8P(#pPw?v(n#sWD{ASEA37KR8sd+DBzu7#E@k<1m zcX#6m^RdtsBzp4V3^UShV7;(pWtmoT z%aUQ2CC5>J(`N`7Ix|(fUwn!}!N*$nXBq9K%PpP~t&dC$e0)=wnpGB8XAM(SN^gl} z%WHUKq&Kj5AxRZ#3@lJ}>PN%b2ri3`9qn7b-JItT7_Q}`m}rV4{}YLF*eGu4+YYXI z?3!X)p|?`0sG4`}=t7A`RM$v*)ySk~+L%cr#ck|=rVWAE)B&arg;SZf4VgQpIj(6u zxwgt~oz7+c2CjsIB+Kl}ii1JDc7^I0S?=W!%In7GG-?u7s~}T{r(l641mrt~ck?l` z+GOEXl9)>flP^l__-$Y%L$SbFLrc}ZJxy%6!#Afhz)`-W!%$CHstb))YiZU>W=0>* z-HDJ!y!JMBEQXL?5_{=e{FcryMVdXyoo3@o!b@_y9Zf6*1ihVka?5dm>^^3%6}3%7 z{2al)jGgxRBcEI&re7+G{|{SjXF!+HN(vLV?ClA9SAUmG-&LiyeAz~iW+=}bzYL9 zoHi4_8%4Ph#oe=AK@p?#a32&=F>OZg8tT-`r7SBda4k%Hd!}{&lvbcpmWa6591UGf zV%uq$Cx0vUoQ3s=ZX50?NLpKIi(?d4O-?f^i)ZL7IhJ&0e`?O_Csaf|ni}s0l$}>4 zQ}>?G3kyscJ2|#AAy@O-6M8{@gFnE`C(9E*B4#U(B(0=ix2@aawE{t2ni-FQ``P8qo*fB1T`vL3QBX1&X-OJ=dWQ5^ z*E-MYRy<{?Y)4s>%8sWSO64YOid43(=cMum7zs@#M%%5t8NpD9>(+1u*O)4Bn(=t!q&8Kw z)%>y3t4)g&)Y{f1L_D_%8GdZlUAk^YQ8Y!;MOs{P z?9Z($Uv9_Ye!FKZbF@J1fZnMU3-ik=sekG43JwHUOd<3fENox$cnyVY-RQUR0fe+n zS$weqK8yiYKSiVvg#v)K6F=vGW4mFGYKx!eB@85~&5|CHPuGi1 zy2#j3%BrH58>wmQL*Ke2qVi#Q;+~&(h%%MHW`2y104MyY<_hMen0m+>8^FrrMmk zw&K|mH^N`+cDX37>VEOYP2#ps<$u`hN!T3t>KPB8Dx~%CH)^Z>4P{5n2GN+UX%rcd z!Pfl@{o(9lddbEm2qzHd1yOR0Q^4L)&8q)3{945vhzY-@@@ild)PTKNPYqy9tcjc) z8q*2gTB#&2!F`#?i?lRvC#Umn&{~o<#WCE^Z+er*CbDxei?u&;F~Tlj9e=jhCCLU- zTjTbcNVeJ}*|AkE*~(rp0qxHy%8u1l+OpoOSb4a%-qE3^^cOi(m-OoIJAVl@!`Jk#8O_}h3(Rq;)u1c`nxQEjOTnk%pvcyPL|c`9 z^`)dpEveF~bMVWJZB5G8^Hfq_|4RLHFaPSF`aL(L zUVjdU&%@zkLKU?Rzp${DJnisv3roTK45}2lf{{=on~Q`GP86t&ihnaC8VjZMe8;Bb z3Tq|9F|y&H{I5OIXl2g1q?&gwB3hY3E-I{bP9rt<(ol7Fs;2S-{%@#C9YMmO_3L_ZbL6su74oWtIiPtLos~JyIx91r`D-)Ha)7CihTSk8l$~xVnTb@Bm-)9 zX3S3OnS{Zs4XTukbK6ZS-&ifd?NerUdY6?PvA2y+l3EH~!SPhxtqJe5woFPx&R)+< z7ctJr)VO?eGBwIal&QbM{}T44&;I}?$$N5jB6$9X^s$A>d=+yM?Q|y$fcc1#|FWw|65MwtvFs z0nb@z=YN;mdI}0Y9G-mmC&GP;ttfmnwA3chg?0>jXX5tT_n+TroC1R@E3RMP-~Rp9 zPC_|BoUp^+f4t!XDHsu!4^|Uu%<$(whu`1+nkgj8lvw-*e}Ae-T0()O*6@F0ZII-z zztQ0z@bG77ESw$wVnh7KUBLq#_`+4>5!{zNa)ggO6DFWt zU{N8ggds3wnaPq3Yk zc29i+QYi@o`mcdh8X|?sl8bntT|5t>M2kFy3_DIO&skd)>s*1&&-Jzl_`ZWuS% z!#UxCUq&~N_hPzvyx_aJ5m$>75LE(*OQN#vq@y5wL}@|U`pPn-YZ>yAW2l(1B0C-0VG>&-O97%GjO#VBDQKh(;c3_i5e4=H zm-fGzjsZqyRU4UVN({u~F*0pP=8h=*ged$2-~Rk#Xzu)y1k}t6D1f2l0MbRc%N|?0 zq`p;{y(s1!<^dyZsXU^jZ4YsAeBiDGbULAo2BaDrB@)S{KfZsL>dr4K-U75}H_aRf+5 zs+;#L&lo5yK)`>p51I!x0<@pO0xY}WYyuFS1wtU4Vh)GMn+fg$k`m*xB$T;d!EI0B z83zwe(eu*(@q@4Kl-z|pjp<1*h+Oa|9;h*8q}dUv+35k;5NeqTy=VHJng)+Y0q5Ki z2Z3wT2V?Ui64D1#?TGG46I?Pv;6{Qbly_Dv5(kRXPUe5gGiP>LOs+6~S^;b`E|2On zNtotzAgf4F1Ad_zSn$M-P0(0S1E+{<+XgL&pX0JD88~e-Bg=WF&kgC7$WgTZ4TS~G zgsbFhis_+bg|Hn_%xEyHPLP}GzFQla#q3+QL`K<~CfSFT5kTimHC-&}B4V-(o);Y|v^7-Z#o?4dD}^Fig2 z+NV^UC^3mJ!Ak1GrO!ywN=-r9wgah|vTceF6Bo*gC}=x%Zg+s30&~Yk86~2>!LH=(i@%Wa*XF=sKlh0(?*xazdr4^qzM zVN{QMy6Y35MXJJ%5spV4G0ham)H2->=Ek&(!^XxQ6dQ(w8Y+xUhB;N%OpaRNsf(=f z5PVd_N4tU*xO~U6&ZYnSvfJHH#IGjFk6VA9kBP}%?gH%vV}s?Tg8X7FA2(2>>f({AA{T$aCR<`zLZ_=ANV@nU#z|sRG96riAqVp z)0f1~7g$Sbrk`5OyGv>x3lbMfXJyL{U=1c-HL$LK^cHdlQzNVTsX0cpwHHxKrNQNy zjx8mTik(E3GmeUR(coj{qNH{|K`m4;uMyc)hg_zXTS`uhJPmB9Se8U||KNX>BSyK4 z3=7wmz-L8!4^aaTYm8a3Q@N#Ogo+B-n6ynyKbSsRl$-P@mObXbp|;@y>egr6Kuzfc z|C1|d2)gs`prLqyOK2#nb+^#8KH(Y~O7gsWxQ>0vMKl!e=iS8W7$>gcG}_5sG=%JV zm$51~U2fw#iph2C13S5o^I(5R7jl`7W;b#jG|81*rYqTu{+A#@a z$E^)6V{6e;T5>6I4Xo`~7s-EIfDA6KSkXITd7~|@ds%S8%)sxNZdc(Pj)5d*y5)3PNs)FB+TSIac@mW?6uiYM!Mgo6kn^Rq7^e$C5 zQ_ZN%<`+N-+ix0bi{q_U3VY(2iv&B8pDXQTKnbLLJwm=0Bce6){cS&|B}T(%@k`Bi0odEApK%d=x?7s7osWn(~lcF)HOK2QG+ovJ|j|J_jBZ<8_~t21L=NW(xdG? z>_2bI4c(hr!6ykWC(HC$CuO2iRdbKXa(q|C)h;;hy&_}gI|Fcz5G(j;~qrkFQAw|piu$#dMG*{}A2BpbJN z#dvLpfAD{?&cvJT-znP9@eN7Rq55_8iRi28=J6^C+9F>h`3hoS!xtof`U;7Coa-L( z1`@c;uyv5O_s}zw5G5Cz4d)MVEFKNNy-UtyeZ<-AgsXd68*t$ogVryC3l|cUtoG%m zm4N#yHOB%@z$P4Fqvrn_;V+^-6(%-po@zl^hGbzVUWQHr^?hN3!|<# z?M8ug#j(Y4V}G&Vv?!=f9NL&7Z=%^f>kTwLdK#+Zfy2i>;phcr9cnDlnisv}$1E=WGOTynla#r+{ul5@5PFxv`q z;G0!buCm?jt=d~QecRg8CcBr+A$!T+4@i*|3B6@`a!}hNK_G|^4-$ljcYk)g`|0iW z_4c=iRGno`gB9J^A06NWj(>sUO`|&tz>I|M>wEX>H_nB@>xP%&TuQtwes}n(FYgi@ zQh>(`F7H-Bpnrehb;sw>)5Z4+ZRDWw68PjApGf~LQE|KsQX1RyMLNLIL0x|P`uUBg zDFA*#_4)br_MbO82?H8uXu99OzW}X3Qon@rM_WAM`kmcRbSyMN-tpOIL4*Znt=eh=iFc^u&1-9LYjKd+VU0F};-(YjGO zcxDX>W;~POQLpr%9);6aA9$e>6{X+O~075XqZ?-8o>*Px=MXI%LwRJa0-)(pSD2pa8>li3eV zpwgm;MWZH_Jqv%D>vsCh&>U9b3N#8`4*8$Ox5#@k-y*M+3_P4|O2CAc$lNexT{a~? zSiv=!N-(U?VnC)fplD{Ur_yF4u7~Hdq9-Akkm5xyCp6RGi_0ZF#2D8`zwCHC-woR2 zx1gWFJ^B6e4vw3~@!+1E=$0JnHhd2+;-lV)wkrCtLRNnijXDuZF7p-4yUcb%w7o3W zB+EHAuvbfLbKd2I@i_BhfDI$z2mRN0V2xaTKX8-WIkUK=Ny(kCECX?Th3W7Izy0-R zNACQR4b)B>C@Mp%PCLQS__Bd2pWU}vsmz+WzI?+Pa9d@?n6HIOvFT2q2AY zoTy(2AB;G#vN0#y5x+-%PmfoQdlfE(XC9XtWDJ05iKL3ji%N9Mp5Sv35;}Q8ePIg3P9fDRfvsEhubtQJ&mqv|F0;f#M>)8;BF#z*&rQFw(}18+gq;rR}{SUHffW zfn{JPY`M(zv0}X{AR3}S;V|QwAy>F1$Be3k%GmZeW(t_iAOTH%+w6^im?)_zlT)1$ zl`cS&A?AEh08{8*M4l5|5m(h#(24H##O#01bJ`l$BX(=cIEL3oZCSyz5F>2`6L@7F zYjwDs#v0nje@|HPs2Y*p(tCL)M8k{%Q{A?^5jk3X1M2#F|d0T&# zZ^J!VXVLop)LRX$T6}ArZ#Ba9GT3p1R*-k-%^+TcypzoOVU4FZA%Aa>SE=%G4Ec35 z_gKmQ2l>MYtsrka(^|d=dCY!J72wS#;8kxT1bnj-{9_=U8zRmF|1d}^;A>2fUcCr> zT>U!Cjv0Ns8GS!OU!CCkjply<`m28yxEcM!D6OEcEHhHS2z`w&3R%#1o6#Q!e)+<{ ze`+w_V^y2cKaA1}`qD6C&5O`S;k_9mzu$zu9!37^3;q6Cx8ZoS z9D>F-3RSMOho`stZZ6-%(Nfu4_Xe`o2_tcP>r^>kkhYhkug8ZmVx7=kzIiuC!Fz) zsI;W6nXc^mLIAlJ`Qqt8eja~DjR@!q*l+#YQ7)S*>yJPgo`n7cfc#!4!bIM=J;C)= zk3gZkPV~)5%{^H{E)iA--tn2ryh9g8M7KTw4xb;D9o&-#>qnD5fl=$3`Vf z>gimM*sN{#?^LIQ4B?P2gamDziN!@O`ij)#le#pqT)ySIZ3L37= z3_2;{8ar$5&r57M!|+d`l}TY&a-?=AL8N!a$r8ChjxaKsT*6#9?4E9BQ%s7{akudJ z4)@FF-HS_!zH%s)V%mR}C@uN!qG)K_keC7pCsGyN#W9^85RP$?E2pdYc{U+&f~vb0 z^SSh{@dFn(;x=991t}N^L#gHG%^_PD-L&$yJJ4BgD}dw*Cz zo=9FP*54*o5L!&DmO4s*MD&&==%;%TD90zd8`3e=i85m3Qeb~Z9Iw-WWwrBglx8;o zc1T|>cVaw;^hG$%oZn?#jAl1wdct{ThZejuOpmZ!@tRWwNK>a0m_;)XVOd*s*G-$j zDW;L-YexjTET0K!4-UvT6LnH*5ZbV?0?3Pq87ifjuQn}aFuVf^gmPO>AcT4*frMra zKU966NFan0v73J*u0R;7WmgzYWNQKuLNQ!}pX$Xe%M+T}C`bErK%^X>Paw-2M`{Nd z){!qtAcXq~372xbE+&xi>?Tc*qpxy%s_C^X*SzLT0rJ#|1j}Xs9vCS10}}`taZNtQ z890A>0s-UMP;sBhAAnm{VM~@N8|(esDZ*(kcjQTvaZP_!5J_EbeJ-oo#`btr-vUWS znKRW4TT4w_#InYeWfF>B$Ni{>^Bdtjr@`I}39+2&48F}zA`GcjqkcE^AD8~y$58(` zy9YT-A~ePc-IOy@Q`S&Nt4kR(O6hyN3Ab5!ALa1jRu(S1AVUu~&e8FnNdmrKOi_*> zi#@r7IyQeMJ`ObeiBN|*Z!)=qaN}fB3*p3M5cvu$Q58X-F*#67Nz<6zdVzl_$q|n0 zW+!37x);2$eFhfaRCyR(dN!5Qn!HYloAY3;DB%}d;YSQ2i1;)4^w@WXW26wVq zwoHGxRkp*gqy-}D5QpGtOCh>F$56=RmhFU0?zovaU|Rc=&7@_zA+3E@zYE-$OFS&d#B5j~zg*iP zpVJJljcRtDjqLtlJjiR2MNJRO5cD{pia9Al%CIq$Zkr0E;!OLIn-+M~{kTTL4jTN( zC7*K3*rDP^YMwqKl}=*3vvhLP`&rz{9bZZlhQYZPjM_KqRW=3kzH^_hYKw z<7@Kx|ICE{f9Aj@ApQEO8GUBtv|ngO-l#Z{x{N}%MEEYv0S7dQ@+L{M`|Xyr{sq(I zkL}6l=hxf+0D3u&%9qhf3KN$@nh_V5F?|6hmw=iPDSv`bQPhG%4GA`Y({D7uhd%~B z{PcGH{`QZ%#KADDz=+}d?*q^aPJe;ZL#+k_z_f(n`;Xz*Z=4HF*Oe~hTuQnO{kC*h zAMX+@wE#yKe7qY3-~LY5jow3S7rrZP0|iBwpf{KBM!IjQ6{ky6OKl=uY6sfiKYsiE z^BYf7;D5|%|I^?4|GvJz{rT2UNFy-NF#P++n}2~4n6zS$mN3BKum29ezx}hP+QMal z;Nn^xJH-{q&(IovXz9Aj&XF4lh`*hX@QI?nM8Ng~a2Q6W#ETgH1b-7;Qdm?I)Dk$hz#c$Im{H;uFQT-7@{cX-4bNCjw` ziF9X|DxDD?e>gG59Db2Wj5n74@3tc?0G*$15Er2RL)f*QJGA~~lx+;gF ziLr0dVtVT*?mNLf3c?1qs2B)%5x8h6__GCE-iV@3migkJ6>)S4dJi$r&}B~$+lf9< za+PHS_dYNW&w2w*iIk3r7ojOBSgaOK&3W~SUi0YRe}a!~(h`6SrEp^lfTmIVIk;!y z(hzs*lq0B}EI16+1`9+Cfll{|C(|wCr5sKmzQ`+rVoHjsR}@M8BF9rO)mX7AN$b4N z^nwJedK&ISIBXJ;E%`W%%Ld*&1`4lHQI1TR5`TMpUm|9nqvR46-5_tRIMGJcDnIYvWBElPB zBxt2=ytRJ^`yf3&^$kc(3{_qOsTEAu1(xmHt-$PRmKc~oZ%9z>7-C8#;Tm%|kkczH zpM2H-IT3@~{`PxQvEvYKutvu~=QXS`z;s=Pf7;I)R8!Y}4r|N{SaTS{4c4d-HJu#} zoJ_Wi7Bxc$uZac_NuZ3K$&uUDm#^jAu*r>fX3)pyvw@S0fz4|a&X*6s6@^=jvPY{% zb`%Tgs+<(@yo2RqrvsNpg|6wscn<+OPw(~ueHf4}paoMXpIJzKn8d!dV^3DD2Z&2+ zf5+2B>gBT2v}0i`Gh(t1E;Li*^;c_7oN-?eQT`84b&}DOU$TIjwYrpa6lT`NF3c(1 zxR|ym=7Q!y6X>brz@F9R4JS>r5mLp&L~dde+=XRg%6`A?f5fCEycxk=}*WM{pzN6sX|gV zJ1-5)ann-?+|y0*sato!wi*h}|M@*O>-8!YrS9v+Q7ArWA*Xz_<|xUsO92yr_$(08 z!zt%*=*xH+cSFImE{;{TX@(RZsg&JKSOGRFZOvvdBuUQjZHbO!rO=zF2SR_HN z9PMPTqHt!H#T3d1P%D7#sB{JOndC}yI#5(3s)0CB4XhzM2NN_F)W9j``nFLE%65Q9 zWf{RRFf+1TW_sU{ULTyHxBeZ4e+A7Xn`U?o<*pB7R(#r+(gJ4Wml(w{UE>oJsu+PW z%cL)u`#J!sDA`;(nKXhzS78}TI?iVQ#y!b$(W?V4T~XSDeUCm- z6-#bCIp6UY%^0FiQA%?_e~?jvJQ)qnk0fi`xOKHR@;cR`Bm}}zFepYUSJs&E^SB`& z(_Qi>na$Ht9Cakw^o}V)f1jUi3wNRDfN5(dGrFyMNbrg(&o)lk?~SSRewS(ZK7gZI ziuuW^|Fg{bSg`BC)C79m%j&o{{o}Zo8C`p7E-#N^?ei3VhlzY@dGcWrJ4fbsYnT_+^#$^)>1&O@>GxK%WKG| zY1cH0D_>x?Kw;m0eyWnx1e@$0&^{`EeD*= zjZ%>Sdw?5#j?EnoT;4+7>s+A#(SW-+Gk9PFGE25zeTp1-Vgna14c@kZ$HY z8YM!^l+CyCuvud2<>TEmE7xCBp&_i2e)<0c|F+J%5hdoN4jb+6z2=feKDSmj2buAg zN}~}wf85Q`?^`P8GiJu*;SH*bUJjAAMo&K{Z;C`d`|DLDml_ zT=a&)3RTGDUr4fgNr4qM;r4tNTm-!1= zCV#zK$#U(s5#8%6_yZ3{V@B00RY_NptGr91oy)5v_9kx;Z}R(T%pf>`0!c3@>hj_? z&X?$5t{{_;el3O{{FGZ`YSR(x&zN(+LcOylP`et}XXj$67r_tJVOC@F~& z83m`cKokUOCRNfV%XD|tNXpPcpf=*ewbI{X3qOkIZw{gGdmVr8rJ5vB*dR%Kgn!FR zeTn@dqT(g@&0{}K^82%w=RdzheepTG1>}fT4m@}Jx%u?|`SjnXh4NGpu+u+(Jh|tB z1L1~E+#pHZ{#h^4{AlqLI zxcO{Fjn41me86m-akkJ#Zo7F*h;Z?_&}P8VNFZzh3vBo|X^ED0(e2wgI#Q16>za<9 zek{;KMk=O6GSQ|<&wmRgHBpkcQu~y2eL4c2q2s(yup3kizJ13tJ4!cnG1QV0b zZxnf5S0wSa(PV&yiO&rcPNq&$;*xMdFz+S!wrwdx@LHfcPH79CmgS8v`uo&aOunz$etj% z!9_XPt4ThWdXVHQJzFxDWfnwMDkmLdp$U$K2x^bU3cx!q=EwrDhCM#gGXseP=tWrM%LRhop~D{a0dttL~4FD5SS+_bT}GAohns)SvF5)i~$%V zt8B{qeUr1bZ-RlC(LU9!x^NAv)qzW4dI0h!xD+Rrve~Y9$|b6Q8dl!v%TYLo(RG3) z>YsfgC?#f)qco6fu;ZqsHH;eO#8irC6DB5z-Dc8al;kD)?Q!S9H#Oh zq{FIrAY~zJUmoUvE|#0e3yNrMZwhk^Gi9ZhagM2Go$`qHl|2-B*Ex~@W|KepQtC&bH5^x3cP~eV=%UsjAJ{_D)NFMHB6By$* zc+!@lUli{Iy$$c=j>&z+JB@49K}v^w;1;B`CaT(f^~Y6CIP!zGH?C3#DiuQbEl?>% zRN0&ihaOg-x;TX$SE&P)4B`9g65iEv^LRywqqmgs+*t&7oMgFG^-{fa_rASFQ|(Y3 z+{hY#*QbLM50Uhq_`^BgW&PIUyyBl@P+hb(vjV0n3l@sW5V{n#?v|a;d5tfAsuj0< zus$>nNC#*LvG^XK86ybH?Df*>b-8q;B_!SHuuDzD<>uJ>7TD1h-MF?L6sZr@_kf7j zZA3ZQDytJY>D`Cfv4UX`kNWaaW%n_(A%@>$gCWIU%NvibFkAMp_O`6006PbX9#5r) zHR=E*hyr%zh|O0e96MBmQpJ8Yv~{MaJ-l?_&3lEZR|$1xk1D@Vn#gYQ>#L8lX_>>F zduE?~ogdeG^GYgzB&iX;_peCbypo3@ zcq6r1s_K~@X>VTlZM7%w=={O<5mKYfzm zkODkD@bt+l2=p(1_&no#NOW;tp^Y3gJ_6sI;v4B7iHhT6kkZ)17wG^wfO-1m^~VQJ zCgjhew~!39-;7lZwIjXHTsN}{wG_;v;VpHvN}-j?1x+oEXz}zZ*rQMj^(DN)2YsOf zCEBNbO&#BeGy;zx&nk@t$}m$yn7Q-DQJ;MhIcNHF9*z8eaa3#KqDYsQG((87ec2mY zF$r?j8x8fy8=AZkG&!ZW!4qg!qEyL7wcD7jx0#Pyv^@JV`iwjty`aeRkjAcgKq{u4 zU-dvkJ&6Y`s~F&<)k~q0`--)1qh*bk;z+Q~^>jK%(@T0=p#C}w>hT0HFC6@ z4Ss?xyIGolDjsQtnuw;q^)u?CqAr?dNRqFK!jSxVHqp+Ze|3=$#N|{xK=F*bW6Doj zrZx2Z`02_l&n)--EN$w2n|vSrA0vbbBo`ZJ3Lhu6-2TLvIgbAH4dpr*$~A%sCwsYZ zJ<*R!koT8Xg6I$H@D#(*Her3q5yAkv@1PKTA(Op-2@Jx=x9+d6uMhuzIIODSjH7-3 z{QeMLC<#oWbHFe!&GzSS+wTv5@440$D0+<>qjlpoK+kH0+zmrEd9j88NO~*2?f=AO zYDRvlHoD?i)^x{Q@Nrg9o`LE$`H1(!1?Hk@R~J!?%BJ{|Iq# zg|Wj(2#k>n*coHK3Fa|JC$>8ajk_GH%G+72X{M}ZTF5zDETGowp6^P`17;T7m_jh4 z%-feC5)>kTKV>A4D{<@_P0rXYm^hPkg5$e?9LTOwm22`hUo;tb0?t!CgG9OD z7fYJSsL^OqIA>P4QtmWOIMd1EM8Yh+TNrQ6FUH;EX2?dn%AiZjxrdIq;vO{$n}tZ% zgXKI;ms8cVE-q;ab=Y+tESho%+Dw7shh1Q9c$(c);>W-9$>Gq1#3+}_D~GvzCs25E z0u}RrC9#e~`S3cAl4pX;8iNnCk}(OTIU#sCkzwRMl{#c2(5I z?7e{t?KOoP%{jf;UTdjiV>mTX$!aVNLfETq&q9SOE*|%qnfO#u0AyX9Vd$V8T6k%H zKE^>k-qcu1$m3NPcy=~uM`uqc8u92Z_L^H^_{Ax@1=iZL49+o}!9peT{vGcT_NbJKlK3LEOp z#t!_X`yQ!F4_cX4B^oLH=bS?7zzXkwkMN?SkMk=xNlYUGsjnJM#Y*YK`IZ^movES6whFY>sh9xs(< z8Auw$rWzJAP)j|`KvL-C>xWETd!WulVvvcXP*o-(X{vB~VGzf9&?i}Q z`Qu(chF60wUBDaT2!ZBZpX8Oyp7Rql))W~_1=suLx_eS=eHHbyOs15=0}Ax3v$qlE zIm94}QMRAmT(y#|msfbIpAOej?hrkPMu9taA#>aTqIFSv!_AE6`30tbFqolK&!NKe z%|*3aUB%|2eY%Q;vfvbObqv=SCDH2YBz7VlQq;}7EYVk(Rt~<}qae3Y_^~lG^`X@1 zq}p*Nd!{-W#SFOXI#sREHJwzrmPZWUa~|g{;T^Mh+RJ&%KS^ECTRGcSs6E=o+Z^`Z zyIx^A<3fDUU9YgA^!oXKWiKYRuVfg%^-fd>!Tix2#FQ4`eRrZlNv6~X+=&VmdJ;F? ziN2Y|qGrP5vbi~1Tw4^x05Z|uHfA2UZtR?jLobXoqDbAD`cX7Td9y%uU1G~a`C*H zgj5%rik*G>JgpSM0pqTp6ahd4{bQpOpe}&qVu1sTrBU_V={|2-R0A+^6TKS9kaV(@ zyKBIl4*_L?(otg$8aZc19fD@J@fYIR8Q7)L6i?y>|zBF{!J=jqKsK2J^iEh>Ns1*h1$W z`cdELmY_LR)<4U=^z%+g=V+^)7IntYLGwjNod;0PLihHy`}MQd#_{pO2Wo9CAD({)KGWrs zg}@^q@&T7m9zlP`-}t!ledx!fd39`(Kzta!^PKM3_&JZ#d^jHId@q->Y4_F%3=!n$T1omP&90*iF9+*%Zl;y33|t?7GQQl=&zZXbIQ)k*5O4=NmE0AON`ZG zXfZ4K7U|y0l39~0D=uec323G`#;iE)ayO1a%6eRNqz7~iR)O_1=?TDn+o3o*dW9^h zNRVZ?<-_C+wqv=<8t|<&9(`IO@k0>>uf_k$qy&G&tzSUQ9xD%|nAg2{HReEd8^%-_ zCi};DXY5w^ZvVGFs1R%m*(};UvaFt$6K0DNhlT0w-L=H1gK}=BZ{8xaBw?LGADU6i zIS2R*qw``;BMyEhwkgedMd(XPD*^`aLV8-@-wRn%qjH!;{`#Bl{=+wa;=vLx|4Ku@ z*2jP7?tk4ck~2312Zl`qgF**uf^}z9F1<8p50<8^=37T%P0sRYZ{OG!9=L>R)skd8!f|DXBX2lx~iN)*b0AYFgS z|Jz=U(`6Pt=er>*70R7KdeNjLP8lz0P^5pQbTcxd$|>6}hZumZv^3301+-#$uQ3#j zuSJuhEx3k?1Z8|j!Kg5B-J~2enLj@eeoO*>xN(vu6}_j>E;mw~Nc`vb-{mQ|JjL)7 zH=Xj2@22r?@ZU)sC_Cc;7hc~QE+`7PE|-H_q;|`#Zi%S8GpsbE^f*e}fMxj@=dyof zu{vR0M*Ujv)@yXlzk-K)7o~1UwZkVc8V6!nb_4W2YO~*^0>t&cYD)Ur0{<{b8{m^y zj;Z@O;5(kkbtvWJ)l`-_7w~ zLVbjDjn4&RG(aq;5-%wEXl5{2rzQ|4$?KS7Lz2r&D zHX0+T4w^}9)9RC~kYL+B>ALDC$ZG{KgG_&gXSktc zDm-Q+dCED~Otlmhn%2}D2G-2AoNWSo{&Zq)5VRhK5xIt~QO00(sp2>sK@wZCrTnWS zp0kzLF>YikGPPZ@fa~faYu>uNU~}D8S6ND^Xxdpc;+uu4NzBX|$%@6PC)9gkPPJ2^ z>_!ZeE~b{)!0O6a08FneMq&3CtKk&t~owDqmDRU$py zvPEwc3>4@cS325{Y@|0GjA3+CfHPf=Em7MZD#c)`5#MP^a6PSn@S}f0u#Q&>TIuh! zF)L)#(K#YK&>pd#lTgnL$Noc(`Fc3kA3+n9T_>Bz`XgvuYBxSWitZM%Q!^k1>!j!i z5AORS2tlD68r>XyV;pngRQcPXPf?nYru<)GYwi?C2jRUr_MNR{a)%*x6QmUr^A;Sv z21u`<{G_ik>SvU@oBe->p_nas#*~gqpJV#FJ6aH%^!@m{ZTN#m4)XD%{ecu|&%%8= z7k`NTilzcSXqPJf_ELD+Ss)RtupQ$Ky2h_g|%l4&m-&mjz+Dq2T5XN^D&leL7Zd8lEJBH-NP)I$qo~qvj}1%eS;vjx@^41 ztnVKW6G$c*O2>Z>C6I>0EyfcFB$E~nTMrS)yG88OOrjQ^L?8`EYw?W{fdoCg2E#CP zy?R1biDeu@$(V=<0kj*QHGT&tt-8IG>^Kq|2)n=@a}p&p9+dO0Y5Z;5dRV6oTS;EE zpJb}j%0p;6kK3jmRcXUgl+OiDqEH5-@>D4l?e*ZpI&FX1%3(1)M2_wju`^(^SQEY# zIWip92x$DRQ05hfxB&!K9{fq%07B$kb{02iq;GJ8W^{_!F(2b*?UC=74)X_)g42B{ ze*k&g>G0$E0}%4gc8~19yG88OjCUZxN&EpgpmD+cvHao4w>#$uLcyW?&^bm`>Tg1+^#b=~%#iBeZ7lsbg^Mz7NW}~^Z6tRa_ z!uNhY;NNWmo&RwG=Qe9i1H+z=3yg5x*+iVacxVc~eq|5;8<>=Zq?fU}6co37SrjN% zm*VqECx2W!ljOJ!&gWO?4=hc9@2aV(>gk!;s>^)d?CK)h=foTM690XJZ&Ht@THOj9 zXf;hyAou|UKoD9!{cGaW_m}q{FMs(Gax%;+FgX4AV*+}>>0jW~sMTZum=-Yo_&NRd z$~kJf-szH@3qhBmzb)O>+cyE0dVr$~-o6rFaRQB@+)3QAWCYNE?u4}mG0D6 znSXA|TOvatnOlymh`Pc&{X$cx$*VVn*91uf$a6y?mNJaoyysh_2kSkfYxW zf!bS@d3&Cu3sTusgRGDm87Jk*((qj38h>&DuSjuYNlL}E6?2O4kyO`duOR;RefI0~ z$IE|~D+Q6E!0GQlU;G0pfC-|C^wg>8&woyTy!>@ewY3{z+FWa;IwpZuh?0{Qj!A9y zO*=kY5m}s=XW^gkB)rZW>~?%xOs2!Ip){*@xS@k+c(X_0)P6T zD~-drXHEHkc;dKgiPpoc;fD&y+RRzWlrK4OCV!M(E{|pfQ!{5ECMXzoEv?PT77r~!Y>Uki$)RE6 zaI-U!8PkPxuTg|yngWd(RsJ4blghTqM#oj{&_kB?5xb?R+X96Z%^4c4o~6Q z1*!od@)Fz7Yz!btjJBqVI5Gkn_F{KYO)qKh@ZyEEVtTv&M69L}B zUFRshWxvt^wPvw_?$F#==(DxR@x zPYP1Ys^M;Sb$=r?56^mlCLrw&?MY~YVveg~Uh0l|8#8HIjQxpI`n9&3 z%1M=+^|ws*az zd$#blv+P4n3A%sN$#U&|XtUE8Xva}h23VUIA)R8GgcXc8NgdIgzjiC|md6wtdY6f= zsXx%sZK6u`2{!Kff=k6(uOQ4$kPpK#fLX`z>l~O3GF}fz6L$O1r9F`D0}_bH1r&8c zk&qR(34c=jGuVmf;h7H*RWU+42T=_SniLaCZdO~_?`^Z^DzYy-T zDXTqa%TUOHy?@=M&$wYS=DWnF<9-;Q0qzjPt7k`= z&!$`W^KK!D~Xb8 zaevNehQfrr;eIa)dF_>One19mX$5dSs3aM<>;&}i%m;{?7-gJ;s1dBGyim>IQm#qu z4h{|jy3?v3pX>lc72}9=K-9=+6H?R?+RW9hgtU_2dYDwwJG&FE!_ykUr5SSh$YI*u zB=#L2db0d>xV3eBI6tS{@wovaaoFts&3_x{P_*p}*h9R&Rm@{wQ$aW{rAO_V_qDZH zzL(o^795g>puj< z-qiI}*Pl7)_$f7MUBa>Ln^NO(EfAx^dRZ%NwXa@q9ODW7>XYWAUP{3<#a=UUj(^f% zb%qLa&(*Vi=~HrMLEnFOB9Xt=WOk=5*eCe;S6?fVRnRYABiqj>A}amI5@ds#cW>x(2Q_Z*Cg-m%q3a8GqLeaAa#?-8`YmpBJ@pI$EAZ z)rh*wLzwv&Ea{!1LeU7JZL2e5pSclAt!dGxU+ofT4AR!PoiI18d&>|d=b8};{#b2sZRb4sOLP@L-UF53Kb6s6&gH)+=%Cwp@nKps~!oR?% zG-;-Cw!0U{!}Gn3qf@k_J1K$bEJLTCfg+~*kfMoD&3n?u^=gpS+<5R{m$czm>F>+_ zWYb~HZi~W7_WYBaC<%%}gs@MM#3dc&s^*wip=C@r9 zcS@+lm;dv?NP35H9*B>JuR0&_?DtaG7t3gh%(!?)N^E}rAK#CcOP8^_6e*W+P%S5y z_GNDlw-37%-v$Oz8m`)+AhP=uIG9D^cQrq!5lLwk~PxiXCkTnm#)$6ehW=Db_9HOK^$+P!CM z?QRm=b`w2WxJ`CxH?iNg+;CnQ3<*=!0rIh&atdMGOFIei-0Y|2(-@brcG-U&1#AwG z*l}~>2b`m&k(l7(po4tSo+x_IiGz;n15O-t6z@E7(Dj}#o263)Gda@AF@n2}{wWbQ z0D5`+o(%6$x`QerLq3_!dIzmg-F@N!xL{}}2M#1Nl;-a`ZvfO8xP1J11Ml)3;Cr0n z-6S@0=8tWlK4v)pk3&tv(BAk@tk(rXzZY*8y=Y9 z8pQhhf0$ue7?-iS6cx8!!xVWs1Z~e*d$-#C6tDt+DecwcAVX6tYB&RDng_43Ls=$F z32m_oUCBhYiE0B_V7!lyvXJmiU&x5JtYc0{h95-!g zIjcu(Nm%tQYp;BF{RBmZh9b@8jaP^&KzLi&R_|6&ko?y*g?p1QF32mPi5at?vH-JM zZBw>?_qIyOgE-nyOR0uXEcE2c_XR6JL6#gBf(g0od#c4?%K&O};4^7g>zfC;B!A7n z#7mR?sXkz(C0AxY0M-Mey6lOfiBcGlhp+G;d2#?0D^x7%tdSH)RVAD|wW z49CS_LT*~put+~cO{7r2k(m5@6W=&N*{Z$nl>&SV&sktfxuq<3xjfZLKN8<1UssC( z(I4C;XE+h3`o$%U*W&ow6>uzbLQRV1f24{35pln6oMH~;v@zJ?-;e+SNmrt66=#krJp8TxJMj;EspOFiI`E;t>H0(z1_ zmxy<9q3fJ}+tbm%4|Kv<^N=WF93dXV8|iW{PM4;hN=fwdP(L7QU{1fj{dC}oC7?Sr z_m{WBpNBD1N*V@24`1I8{)Ljjq!oiuf?4Z^zy39RJA5f5GHK4N|3&}5f6mae9Y= z{CUPTVE>f+iM%5da~}3$8=AYhzK$k3&D?c&{s}ZWXQa5r0OGt`%aRsMflilAm#KG- z+pyZt(+XBL`s!Qzf3{oGE$cPNICuB)ZD=eLPEVbiNO}@1RI*O0u|-vPI-Rg{w#?Jx zPf=5r9R}ClAJF~0Q9gF#vVyk`?*1;SgxWAEOPuI4hycntxdd;RE^FprY8crpol|gT z(YA#!t&+qP}n=HE$29s7@M+qT`YZKvbp=A3hP)%Uck)_z@kjycBovRhDJ6e5&^ zl?x!UEtV4?Dq?df_}Gpfh8@Kc{qvR^l`g$6gOOUhE*M%}pZg`?<~dLcS`(2s;=iLl zss?Y{dFG29pg>{3Nzv;b+JDF|^(O2Ht;QPx?JtszVv)>{!!;q5Z7}2+3p{E-F9rC@ ztsf=tnYU#xCaH30Y_SCDFLg|+4; zrqzvQ8ogGf=h8Mh4tjHbXLwee+nf~hbBCK@?cG4Nis9A!@=w=pN znYqD<%OoD1$(;8~9c=zht*BuT`x}sgP&`a&WIXd7vFK*t#P4ZPI*MvHywuPCnHaNv+F!LS{N+2j68@t(L9& zhX~IhrE!T3@==f9l5co$q;ZLbVM#*u(vog7?TbrPqWngktp01JW|`(lNNy>E86Y>R zHy=j+SfjA}An8T)RGJhO)5zd>6R?o@h%vRsJhOjW{X`n{+%e#%;ei z1zBHKaD0jY>mZ=f*?aK&seunl-C#o~@W=H&v6v5Qc0Y`w9;U{|r)A zcf_sJUe6&9i4Ss~!=ud>3X8rKvFs<~L!SJ%=Gf?LI!wP!L#ALsOubKXX$6=6+z=E%F z;>{zejkLs8PZX8G9PJ!qExXn5@VT+GRbF;(rPyX;K7if^t^TH01Xr<4pOx!$jF2Ya zFjk>*s3}0bl!%@xu_u=%Jk%7{#czp90I#xVZr7|cGApTs3Xsn2#m}YkckB(S>lnl? zu^8dI;9&1}hLl%0P}ntX&i_MAU>&X7QDGix@@duO%#YnwZK-Wr8FU>CPNr16@*H^bca?Y5Wxsb8V<351f`BH{Dsr| z+`A_IdOXMTev`A^^YQ%1X~cHX(@jf=Mhu+<)?FgmS6Ha742hM4UgVsz=NduYwrG>9 zM^KfE;B936%!3!M4T;vkR<-Ri(K8)(_P~Hf!UrmjT~%N$UUHJH31H;)3(P1Y%RHJ^W-R7O@$bV zk8&~`wnDcP3od?VVUvyM#HV#N)K)<;bOxsy z5qmccyox0~sTz21K_)FPLYnF_A28bTYJ}0Bn0eXgoy@_F1CkSi!fvZo5i=%>EfhwU zAgL_$8_U_7DUpbsPZ;R4uHu1TpiFQ;48LMR+n#HfagoPRGko$7Y)Dj6W5liDu*u`( z3(KHn2oz7F=VEu%i-%+ytHfsBL5(X~5WBAC{n2k$KJS$`?^cViSk0ctT!w!RlGt7? zWVFbc$tq>H`1pd;UOW7s#Q)rmK8XW-lYymZIs1#=2mzqwqScI%jDn-$;oQi6x`Hx; zumXCGy8iMY;}X#rDaz2XUfs+|>LXe4=q_8+Faq9fAt4xDqkHvN$7G zH1^<4*kAa`x4Kh0cav0BPI4&@9aN6pXsn%4Nk{74{#oHn%%2t(d8Ozw4mK>Ru9}xh zzeFF$_X7+PJ!~`_Ir|IR-h@zScHYclFMNK?bRahDGF*BWW`%`a@KBkG-|^8y!-hbt zv>fN^t(*^yTyqazO4eL!|Nj1VsrE{{@O@@)jaMM9I+zamG+ZI~Fj+>=o8QR$>e0-I zpFP>%w~^*h?DZe39TxW*$hh#SL;dcOA40J>F#riE-H8!X=3<{-Tz@;eU6)9o&{HEO zT*XzHDu)uEBb{#6DFO%8y|MZlg58RXyAjVL=xqN;mc49Mel3peW9hB+|}b zD}WUwq4htV07Gbyl3=&9TVn7^)aeC&g<}h3Ty{8TtehlXP+ztpC%(Z1{yL+z5{BD(-wLbEU@apjsnPf zip~HqTSei<3%Dnk^LuvP832|{j4U8tQ$Y<>f|7>DI{wE*FZll^dba+XTmR=n)MJqa z_dHpb7%5=h_P1~{!5UPAd?SO|$%hN`fC;KkvN6P~zx>?c@BQyul4oDE=G4bV`qTR`cym3%t$U(c)V+w%Iz!nWciWb)siO$6Ug`vXHM z@KBAP2x%z}&&RR5>kF~;e>*WssO4S=AJzo{2vdnUB!f#xgWqBUO?V*cmCNiJ^Fs}g z=?t9+0MMwC;2R*BnP-l39T$@y_v#7emr~SsqLp%y2>ttFZf&QPCfyVNV7g)WSh$k& zV*tD~1@8Hx#)i;4RB19Cd)p+?@$>Vp@})ErxSvTq66M0nwJ+B}CXxsG_iRkjP=j64 zYT_jQa`-xUQbc@}hW&E->r#I7D{I?()zD*11Rp{ht{F~2scc^faiK=ZgGM+XCG8A}k#vN;Wv zv2C*f$ss33F2RdjH&vG%KOG*tZkomAHJ?LELYk+l(>E=8zhM`6bY!$<7%G1TCS0KF z00fcerlMu8vQF819sz$Qs~qqciaAX~&@#=KJ=8`#+dCTbKiH^kZ^@Q)OuN|AWsBbk za#}}seX~jTGR?U7wgfRBb&QpqF%+<(Hp)!k1<T_Sw_>K~wG91~WR99U|k)5u790k)9)QPDf^e%B6z+_EQJz6hz!&HB#dyC5a0 z1-~}$JY_}mRi|TAa7}_Lf4ZbA@oP(=7AniFWKui}G1-*SZFJGG+d-_wd2%lD#n`}X z=ey5p>XVtBKc?RuV-1A|h~Bz#im$PPSz4fJ)+;cism;b*l}ecGZNOq&l}o9p05%*T zHC3!eGSmK)*e{ZyFD4Mr3DnGv2ILiY?qa6*$xh8Lo}4*a6wg=dPYq#_QuH7`{G6-~ zHD7875%+&;_vSM?lOm2uAb>4H8kLTN%k2oeqfj| zy|TSZB*5`Tpq2TfRkt0APs9XW<5qS&sTw;tpH~F#iAG91VdpvjvH+yeErX1jTDn|G{nV#W@kD{cCuJ8N!A7D?I6KKk`zd~dQqes zb21@i?XiaWiZn2!7enbLIm>x5X%L+sF9+8#I_BPFB}twp{MV#&2~dPHR`t@s>(?kY zkEs88Qdd4N4%C$I>NxE0A!ezs+OJF1err(zZqQ{fQa0tN^Rc*A`8MD}PkKlu$A*;A z(5BVdJGL5ec?6>8yn1~OSah+XvJCs^*v_Sq>>x zEXa7_PjfiZR3*WRIslpfoAiRgpRdzC^wKjYc#@THe&huPLtffnXGtpD7LQ>nVO}hN zRSbqP#~GvJ;F5;xF6ck}&#~}_Hgy2(UWSvqqb(T2X~QiPAWvL*R<28sO?-pyEVig7 zo>^9VsRn%WfPZUW+Y=w*I)?J#qro;@-#~HX=`#(E@^Z)kaRF`?^6DgG|AuHM{w}60 z?@y=FLQ-)k;<>cCK3Zg0&aq4FGZKCdUHkoB!wp92X2+Hgsvk2WL2z-dS(z1X`C)Ae zn*7k6{#o*Gz>E#0#-{IDZ$y}uzmFAfn!_GuW*&`*09B)NI#vn`YuQ!NHVXp7c~y@xeVoDidYm?UoHe8>@G~-6>0I z?hHjpgfmeZ#V{7qmn*F2>$lN?!-#`8+3V-zr<%hYz&L8>^0%hW>=$9@CX-!nh3M5S zmKQrcOB0n-hj#{%r!=%O(L<x^yL?gYczp#iP6gG zcRy3ki_@czRNE_UpD9fRf%$jn)H)-eE821oj$Uw5Q<>cr+uq*^7Z^2^whqVklmup+ zqm5b9!=rA+YjTz=3xDkOyJr*`63x9e)w2Q=_vZ!WQ*kMWP~8pqH<3yAN429ebJU_e z=NrC$KtI8O0q1_AqqT6|qr*o7zjnYO0N1J~5dA3N0818LQ(sTsMBVi+a~GQogLF~X z({s#sbm_4aI$3#(#(H{KG67IRp}5@vLomXC0G{vl&WBJJrtg&w6R$6xAN)HHm|P#F ze~o^mN?>jEz~>0MFtF)cwv!!)e-HcYPOGy8iL`7$DBE{le#Z-KBb}h!GHji+0}5yU zz5E6c90Yq#jgTo1aSl@R2?KSV+u53uP?E31BtRc{OOF|^bF#fu{;-yONCM7#y1E5F z?iXoG(O9fEZ{Auczl2Db8clxWrJ?vde;(gFo&pW*PUWax5K#eDx zG|Kz1xIh@8s_;d>s7xlMWv4=x0U5K&!KrSiB!$T`o+8RNU#l(uw8r0qw^T}=xtk~N z(2AcJziqjHlBDyg?cHri7kGKPF$)b{avqHAoMq@`0K2+#6j4JhO}F?j8n1UO;x80? zQjyIp&Cv5=DTHiGrEpu3}TN$rMv4-jIL^on6{Csf4k@mcn;RtGRa-YvNWjl|C`JtzDNeF{G_6 z-asNkB&*aP?D5a_`uRU7nlhvs8&pYxO(f(f(vRwc3{T$jfaz`6h0pI)NhA(&uA#`# zOmaPhe?RtX&DNl8M~v|^09yQas{G)uK>rUrhE>s97Hib7cDXRroWxLRHr1;E?dqVZ zN|sx*j1}6tsAbQMs)!+5o@QNF`S5i!HrH8UE}@9(sb~e2pCfy+!Gb zz(}4yaC(c)4s9pO0!lI1?D%u&0<$S|?3QH2AihR;2x-nPhg@-RfKWe^N|DV?MjuO1 z=D8E|Zo^zQIk_l|Ls*fdH)N945Kzx7q=p8_{sm3d0)1%~vKV_oL{vPfVvm_7oV<|* z-HL(zi>1-^-y1rCyiU5bPJwIb!}tyQ|BRbG_}~VY*c|*lhD)3UbB;!(P6h<*RbhSz7f?PY*v0Drzhj#NF_>-1JC%G8wB22)QJ#HR~`$T0m5)YjjQPbh?*R|b3b z*H=0%S5?y)n93hi4vhKjOZZg}3j8hYxAT+|a&Xl4<|*m4C`0t#?LA@(aQW3~X2sF) z)n;78RXCanV<8W%E^S9VDlF$d#LSGjz6=@RTylpjii4J>0AVWsnVEqf*{%`DHVTd~ zA?wg`jrVBPaQK|R>-Zrwz^19Cn?zKB-A`P-0kB6lUP7LwR}JDKY6;xDWym<93z{~; z+WjX%9B!7U_i~%cT1R4WFE4O}pSfW zk=#?U;yX6%do|(E*V=UTw^D1aOAFew@W*s2H0y`0%h+Jq$~ru{l`*lZxJ~s2DzGX! znQu*TmCzi?RaiK@g=5C$mhQD~;KC>t1O?MVRv)ASQaQm;%pu=66Z_lfSC^rvg*X`E zU6aIHIVzfdV1DPX{uOq@9s`f@{#~|5?Rf5gKh~Pg`8~uIp1bx5`Jls}pfbk1ptqnA zDE1bGpZRcPxGIKeKzW&hrYBO&Th;bQy2D9hB5x5fz_!sz4~{t3x^~|uk-lwrBA$69 zNJ%dOyfU*Ih`BZ_!CA>9Fir|v(exn=cZnw3z37pao|#)D*Qr}&%h-5=$>;oaZbF%w z(qYW~!#sbD|M@RPcbJw+`rs<}Cd?oqEmSbC1MM^6Ds9GYz*O`8ijL82nNt*2@$Hs; z)u29hs+DdBo|%+uc>P2nRHe0Itzi5--p2C;AQLPEuOB|z$Y{!S6Gj#+lhJwQ4X$DWQ#^dZ1Qn##Yh@Etod*SUR&*6o996K-pkA6NxPna%Tz>b*?_ZDC5?UDs zESg@g)U|A|7@+=sBd!CBHc8)~oIg!k*~T3`eqK z{;#xwnqE;g!WxCk+1%9oKVq%wjv@^gB0{mv#lREg_wIzp7O?ssje@lKQ=~&h9paU= zCEj(poXHEX?VAy*@ls=vSoc4OO{>uq0n8j3RY0uzGau_QEEPzC?ev*}y$o(l*}H`$ z2R_F%PN)4AqHPUI6*+F;seGgzGQ$hdDgW-F(yqzZ>H1W9_dUBURZW83wbjYXWvEZ8 zP^v<246L}0s%_aj7N?fT?FDJbf{++nsBg=84DxbjImqjuo7GyY&fjaN^+Q z?Vg1hzTr8Xb(_}suriSRIZzd=6MQ~s zYH1FtyuR{jXoe>P+PbyM1yGItoWOV}M}qyJD>OuFcmKGnT|36l z@JZ(m130g_y>MJtB!i8b`9s7$+Xe$!FPPyfe=4qRS`%}g{y^>X&l0(Hu@elG%YTAf z2f;kar0FUn2GZ`KG@E0P9G_rvN8P|%00w&4VmQV(nBQQ1gZ&N8H@M&6eS`lE!8e30 zi{V5$robm*Pzqq$1raN_Y7W&caQ1@8`)AxQ9jmpcnUbEIS7D&~C6O!uw4c4tMTz9O z*F+Lo0*aV_Ae=xQ|9DuCIs?qP)ijJzTu1hByF zLov!ZX)xZR?Ei+=0_OS@*l)4Q&c>6AF$59w2A&X|7@i^Hi#o%OSr5MTCgRxP5V0F} z7)J7eR*{qE9wVCxijm0?qhzhnhbm&>k_m`Z)%bej2)kJ;-?O1C;hfgJey7MHY$g-- z#6;N2;)pP6kHv^OJFXp;sxE8K02XuMO5`r1EQCzY9W)t{R>>fjx{!^uyM*vS9_4yo z1G0_AE_IhUaenhr{$cHnkCM^sq!&bjp#Jo?fQwir-j4juDVv*#{o~xKFc*qwCKDu8 z&l-d(!iq5nSKAX$!KlN$9<`@{dQC62hsX-S*BbNjgX(|=h5Dl#@LGIL3do+b@yrm* z-c#6Hclg6*0n#@`wk8ffMhVR}`y}Db$^omU_w_N@Z+E*%riQ(z&;SG3#fRl0-8WTy zOu(vskR&8OsaB_bXCt~^Iq0;i7Ojw-pV;b9-d^cIrK!%cvx&M$ed9B7@Jk5S0%f~e zak{Z(cpXY)A#%&!pD_V00}#u5_2UT(GETRknK{Y~I>J+a9o&IS!N?h#b>FF9MQKHP zvo?11;@-4ou>=2aOj>3)p}>`HCr-$`4Fx)GwU04z1{T@OPOE8qA$h1h0l&U#8E)~! zg%kG$QM>16o!vyrwsdE$pVxA#$5z7!8t!>9D1oV|Y8f?AmyvF1Fks;21_*#y&>oWjc$lG1Em7i{m#T+2u)31Nbc_}xRFX+s^e^*o$~f-Z~Ww9=dY&j$?^ zk~hhwAdFn6HGVmVzfXNG72PUu#|Sc+1#+B>lhw8fM*{Xr>lO|z!^`or!Z3)tb5g-c z`-^?BYoauX9CmXalVI_O_3oPOs{5}%OSNC91B`(eIC^hkfbV{6s5RtWqE@~(mr4hT zj$vmG<|UD{O7eAAFxr*q^${q-n^nJBU<|~5ldFfpoYKOF7yZG$c$0JFYV0iRT}*cT z8PNegbF6hh6;8SN@JBkyu}Nj%G5H>&?IdoUU~<6O1dHRJ8GHV(HNi78!t2T8*`6`x?XO3vGd!ZTs zjCy=zL04T4TEW#qhWcX?M(2ZyPm*lX5veYfBlfqI=n2>@nvOTqlmrTC(;#9E%f$kZ z7@8YX`?qC`_K%*6(^Q~QVd8i#A(gCZ1LBSga+muTU>kk}b~3JQkeNxfA|o!RZyl1+ zr}q1&x5HQ~P}Abd`DfbY~}hP&>N)WU=0t_zR% zzx~+D#2UnjQKCc|eK2+?OcNNLFkbE;&)MP>QGu%3#oPsgmjnKS0<^7fVv+=xJ%n`4 zHs^pOC4?B~?Qv{lIW1^;!x2*-zaG2)S>G8|$*=uAK zIZBwk)l4K*GmR3(0wne-MWaQF{h9YB5s1SLje4Vv$VZz_mA!T>Al#4^1tCMXR7-5$ z^De^zW5392aY-}7`X@jfdFEDAc~%7X(8&OEF!tBu?pt&wx;~r{A?Hb##r1jThm){M zQGesxVbWY5@AhCIJL>cb^zc+WRW{T06`~F(RbrXE!PeEgS$Hd)CNuB#1;R^(-=f)N zknVYmvlCiKkf_^R#HdsJa&Zy6kFwwXp^%dcts2}F;Se!co%zfl_$bI z8T9TWvi9ae=U!>={8tj;LuGlzQUGc6rLvnC6pn$?If?YeYiQTwKq)3`)PNDF_4E7c z{Z1J`M*$^JwZp|sx@$rpo4Zg^gOi7-axC?vcJ-Kgs?GAbCY*s)kbx@Lu}bTb;Cln3?(wR6^XXfQ*_5~I`pP*;7TwL*YeMT#!+GE#*5N>{ zs%I~t^(?e)$%3&Dx~m{-+SC5?o{Ch~MrZgtOcv2k#jwV=*)pt6r zr<9R+pXrOU3w}87m0UXlYgzysNdnwQ(N1>{k8jewhHM4-<-+ zvT!wUoovT4eG`3_h}TE^`Y?#3gV+Xp`%!FX%>Kely`98Nq|X8@3&s3hc82{DH$n_|f}4MK6t60kpPpkq?4S%9m)61mx$<0F}5T3g(C1RyiH{; zjlf-67c+2I6+DR+h9{$T_pWqS%fm=;L)+mgp(}lqAS$F$)sA?_4$Mx_;GdHKS9dlf zVumFeh^1B@0yjA282gGG@mF_cY(uyGeSO(H-bA7u$vh5`W?x&{IGCBv?>-qh8H%LJ zxHjp>3T~uC=%MSmX*JS%Ix~nKX)N>okD4*7e2}D;=#wi6V+eh>;jK<+{aK}5HE|#( zsC9$8zcq-_c)rAo)tFk;5xS9dttYsx2BuusMVyu4pK* zw5%?MT7BP%?Umi-h`ijum2f;_3y_;Kj>lH8RDc*yVHqCodduiCj+ML~erLd@A;dwA z=M6tT%yK9qU(f2XKKs{TWsCPXlQ-XrHR4z0UGzu{_lty>r=vfFN>+dJvQRnvf+|&G zdY^jIKoYG4K`$dwaknG@3q{6Qg#zrH8u^7a86u;22&dF(su63i#i)9(BJ zuh32~f_6ihdczyuGs$8tVq~>oYNLm-p+v}k`l1e7M>e;cg4;6Xl@0QGH|K@m z`sE`t{t1#-1nsM&Ar!g`BV%DY#T>!x+=Xv5G z&KhN2hSXd369T9Wee^L;;`l5zG|(K++1RZ&wT{yJV_OX>Q8YzIFdso8TOr)yRzPv} zE7KqQA~Q1Dt3>?d1nVgu(Lh7pF)nJHg9kSBhh^H5BEK5UgqjVs(J{?ptRmUc$kIn$ z?8o}DEwTt(YaJRuiAfcdEdSlV_$6dXiCdgY1IWJ4dbg+dP8XmF@g!3uvx82JjZB;S zlj^wPERAM#<#vRDe5)Z#);&qqIX>IIj?K%DB&ZPht?op}Zxhl=0Y)f?BwBFkQu#a{ zv06(i5t3&?puvy3YLS+_#u#TiH1OmQW|3shl0d(Y`(r`?rOTn=cFBkE5msRyZCvI< z?48whsz$?Oc}!n)$4WN>4CJV@EHzwRD*{Y4{UoF$bt^kLf0P14ywK(^aF3v8o6|H7 zRmi6_^C^z>ss@b-ibHzr&@tBB)la=_;U8*w7K|bJ(@77P&KknQfk!b)6qS2F_h=CM z9A8nXJv4QI+YrR8fQVYRV(dHK#p)8R$_2SgwBU)r7zUNHO}q>{Ei^CreM;E?eS$;w z1{M6$={R3zV)`OJCCfab1t>Ua2}$kz*GkvH$GAUHmwjV0&Gh~1e-WpiY*poHtEtm| z;T_}W9?94qH5C}~57$=WnpDWC^CJJ>W|#fpbQ>Keo8 ztWUp8!^&w-X*Mb@KDa9-2XG<82SOa5;y~TTsUb;tNlNa^*nVW}lRwz%rG+go`y`}-qy||EMJ3(;-6Ded*2~c{5p+* zbB&nL5EjXg)~3hqqO+GqO@XEE%yf(AW|!_J=8&tF#+4io8bRw^&!=-123Cevm0R5Z zm8?GESE4fvN~8lLD3|l z1X6R0?!wrss4(wOM(x#eP@~z1L-h!yK}x6fgVEI&`yaU|nH;6EN2ma3m>c9)R((uO zn)i?;snw@zsD}dQ`Uvj{QUA%ZJ6rswV6a);*KI`a_4sl+12Gg-#WrqR}cfTwb#gLsoY3B{o zpLtua3?$ERG41S;=9)x#(=RCWD2i`fwbwLFD^7S&1C=9Ttq&w zf7a7eqDhk1*@d56$t8Mr9QoC{hVal_l;zRb;a1^3KAS;%#6MRkGaW%lD+2~J1Fpl7=;k6M?4uh-+ zGX`*6E|E-^{zT=>EH9nPj-A2EGLsmO_NC{>$KEuHVs+TzMnI3LTtqLsqK>6;7dLsE zBM*&bTqU$x*L+YI>%u|rV$Rjf;ay3j5pZjG74RLkDA5_ou7}Uc*rs2Po8x`bPjKaV z%JqslG8paao?u?Z`@G?Y2dzCrf}Q)jatQc)-~oy~RWs7g!S~E+P4tI$iBFdz$T_;c zNn4#>{?C%#HXmOlSav=)%Udm2HVHe6&p)CB{$g4NcvqLu$x_;E+hw#7*ZaW`M-~%c zm2^xT)W;7HnVPn%bQgI|5D4!!sK2|60pQ00KK;3-?v=R@NV+3k%U*fSqT14FeYQuH5KyMJ|jY)MwlsKm~7-5KdmZewBQT;y%`b!yBluxwFg2N>XHdBH5hF857;J*$ zdGAMT8`W}6Q_5#$1GcC${MiKupFTa0fo~e&iFamBb(p+o`pCh&M-JRUlkEkt35e_o z+CW)lSa>#cm;ih4XEQ}9<6n7~94CQua=%u6aeSaFcV%*kg5R0qb+YmKC3!9kKNBUfOAe=)41AoWThEvfdFbYG}W69$UUT=g zWvC-9@Uum15$%=v#mo2Q;~q$vRssO`3mtpezd!9!{3!g1okx!F^?r*+kPDfYg_DHA zx4BybKm_o8bg57!6*=ujeBVUl8zs2R!N#@&fCD|xyNnxJzMSuj93RRZ@dJQRfD@E% za8_J=?GeOH3-p9A%(Wi{ZvxR}h!{ZdPZlYw43=jGjnr-#CGP4pNJAD|D4^7s*Md_# z-8%6`j;{f~yPFTU>{+He1mMTCfPBE(@RP+f52gxKH}ANk2!a)6bumb-RnuzDwi`FQ zJGtZ6<9E&0{`~{TT~jAnN=EKNt@h9dl@M-gBIfV_kZaEXg*W8aSiYuYa4xVJzkG~} z7OlLWl&1!zJwKvfXO7$z1aS1&NfrbB^}WKQsAn$6hpNl*-XB)RHlXUG96zDw|CLah zh@i&G&+TGeh-tMRIxY2A?oH;BRMWIL%R1PyQV;dX8x1apoX3lMGX@%>HL>QnIcM#a-N5=FwGI7-tuZc4Ftx026;;y3xKG2!3f zQ{QbV{g_87g)@=GB!J|_$Nc^=x<58&8-8}6 zgC^`2Q}T{LvHQv{){lX-j?7iF`Q zeDGNLW!|DvfJtO|t{0y?65pg^6=_LgtBiH{k7S~KoZCOh&SneV29eiX)fa{J0~yqv zQktTEni)Z15Iq^wAS0{wt~=GUsp984cGMwC!PIQ z>{?x87a+6F^pwisLThd5&6AF7W~0sxkImEIN(I4ObAh-n9}g7s_nB_a4(wn0i7Dp| zNoGe|o(S5r=G3g1M8wi{lZ5sF&7WFvJ8eJG3S)Lmsm1j6Jz56NPLglfLjMw1q%EUV z##krfyvEEtkeOxwzIYITA6lT}64Ydqx57&|Y6DO^9-qfzZ(=p(#Lgz0#if%4+rh7! z`jgTwF)*43 zOh+)^wN_o#SYNt&1;N%DzwH6+|5rv6kD6M4jQDHfS8aWj8I^`=Oh=oyxd=QAJ*!rq zgBroIo}RgivO3)u>=VP73xq`UObs;zflSAu0)#7G9{j=FokcuBFyHkteT+2#z-_#! zLY|N{CT)&v{(k7@sIjr`XQ`Z}h&M+6AE!8&{MOcvz3V3goA=F9G`5lshi%A0Y3u!} zY-NnTfb80zzq{P_Mnwr#0-McQaxF2KN^y^f_4Y{b!mOMQ<8BVm7VZ|65L`}Kh>QAdDJ=6tf~8`E57wc!+&k@}+E^ORT1j``EC`~_xdBPR-U zb6zDfRZHABS@%bSkMA1nPG!8Z_1V=GW?X{YZ2bcDve}mB8xq-C~^KfX~RYOMvd7 zR0tjw-#@nW(1g}fTzj^bVpmVP`kk#RkOQCT<|0Nwst64_%yh8fo0XEFW_p3MJrt!f zOfb$m5vHx7CjjUZ`A)j>iYGKLYDPU7_+|H_Dgo{eE7!dgh2Xr?3Wb6`$CVAa_BAgQ zcOg^O{FT)meRk8<3~|N_PMV(2k9yIY^N;_WK6;P$o#1I?v=T;0Q@`vBW<__?ZZuY5 z&ykY%2VcR|aZ)VZUitdr&qRMCg^}D@n}7HaKOE1Zy0R8l6WJ62{icqG{=Hs#!y*^! zguIup7Q|$Pb(9;R{6{vn$$fA0k|>FMk}~2LAfKafX+wO2>gDupq&f0Y4HscJkJM3w zBM)WIdN*6$YEQ9-RCAMu;X)gMRmh#~0Qz-^wH~xKj)H>HjwY^Odeo*DR5e173UE8} zu7V8?c>dJ(<3}I>ojl5`;lLUItYmXiJKMXzdRf_YQ^|8cgIKX`Rjfwb9X=DQp2jN! z+~3A&LjK9fXqJOK2jd4l48E5Rs4PLVGpd?f*))^&_LD$qZ4p5y@lJ-t#U1_oow6m! zjaV*N)4UP^TJJg@@|JzY!j+8|cVQx(2^ShUA8%)-fkbU;euBm6y{?~O>@d> z>Zd&Z6nIUSJu3Q|UA~@Oe#36;_X3JUcQ6@v^>r3mU$r}Cb(IxaIeWO+k&1L!)&qj# zvCXV;daBj*qDf8c9vT-~tGrO+7( zurv-?5>ZLK@-zVfc#DM^qGAbd|U?+*~Wxz^$8z-}D&^4r^fOep0{ zT=6jDi);ESXaVMS(9_NS&U%EPh}p{E<)eXDd~_!*REx#TZZzn&Psv%FkO!0zbZrz) z=~gEd{R38ukn5O@kT20ZwViWyWQ3GO^A^H2l{B|$py_7}J+2=YQMlb#y{IfVzn62C zuM_V_E%e{+%N1;P%+yGXEzkXoTAnlcI4EG)`sbQ5*8IengDQ60<$N}-YklHA9@1we zxg~E3yz)-W7{|PRg9-OcegzPht9pvH8c1{pL^5VxBsdVce{}B8XWgE2;;m10-7>uO zf4KFEgYC;dMEh55UEMo`>adRlNigO+U_3cStUq6s$$Hr$=ksGhB6kQdMx^Vi2 zs64gj;+VI+c(`L!?qBHiP|TTnmZ9hz%;`JXXwH7YIjk7w!J0dmxdJr@bl_V&kZGP_ zfFJZ|lr71)G*8fGTiNFw<=gV1_I}iUj3CR_O~jl4H&gJS**@w#cVFJY$Hf>}9UCN1 z_yY0pl9eo+L5pfCRBPu{ef1<=FZzKC6-Im9nhtEOmz@5jMZ&$3Dzu}D#O?v>?= zpcTYNfKJ%kqqy5173p~Xpw=Y@dy>OyJ|>A}Eo_oIrq&y_e{=XTLYcM-B_Qe=;177c zFU$EAPnOv-P_v!W4<>?ivS`%w!)d^<2hlJmpd1a>oLcXB2p}jg#X}4xZTgHS9q>sK zwhegRjpf7Y!u^a9?Frje@wyBX3^h#cwgd6({UvMKnEhi~h&Ebo1MX)m%1(MoHMUv4 z+Y-a(@7OTJToN8<=mIH6KZ~UBusC@s_WRV_f;l+p&(N|;p+aoKQv&dK54kb5a8SNV z-AcLB$#w}wQaK3`0(2!BBgn>iRdlwfpe4XvpCSlqs2?^U%y%s*UM9sbFaS$)DCqJ@ z$TEWQG*!usUi@WE<$}Demy|qGYsWcb(sRN>{74Km_0!*6!NAHSEfGDqd6bVx%?zI@ zd^F1^jnXjbCVQ;6WbUqNM;7~|RM0_U!a`?6%#mRRhF<1@YNBj`WAny5<#~;2Y!fZK zMhZpwR~VEwBaZMAy7aL3_8}LLg_4FG;1)3SAOX~kMgqn}uUuyD!+IE}V-N=8$ITuA zGTMeLJSHr~ulzJ(7#7s~J48GJn{1^koi$Vpk7iG0&18A#c>DcDI`dR!GgW9Q)JfP5 zrEElp9c8mUy4Dn!eqfc*9RP}ZRXsKj8y z{-@ktgV75eTdW3$|Ce54l4PFEsw()gDK$TntJsZ=RqkEp<9@j%ujBr{B;Im}uYr!I zT+dHFvXBoa`G@)I+}+B3Uzp66R(6U|XYn(MZOC1BSYjj7xS_6}IZPlX#s@)Bx7|p3 zNG1D*$%tm+%4pg_?d_u z#Du&K#q{S~skG00|8Al87RZo8%5rX8KbLD{o}s)+h9jKW*s3r1g>1YdV0S<-QTwg5 zRx&uq)J^{V1Ixx_#d$fb8*h?l+)^}W_f$xbC%Ai-wUvJ|ukPaM8s|vLXZHiFA5WST zZv*Y9nxZb6^&$Q5p|CMR7p9PXDx5)iqlHNarD0g1`Z~_%dm~SDSy{K^^SaTwE={h-ZLrbcc3X!n)yEwU(1#J(jnLa2n&D96# zrR1p0%{V-2rRkSA_DRk7d+@eeJOA&x-@+$$6>&%=_SRx_NBST~m3qv!@|Omug7sKp zDKV7n^<|O$o=H_@aPlG*K)`W(hZdp=w;V_$R2B^q!S=4e@ zSgcC}V03$pdF<+EEefXVai!6$KYcn)ddU%m(B^GC6^>^F8k#&d?7X%N#{#43nt3vY zEbk!tJ$Q8fS|<%jtVR%n;HGE2z{yWEg1FX;@dchQ9@KdYC!omd>r|o=uj!{dH)sd|E(a|q2%Vk9*(p+==k9}__TH)(nIAj$dHVBF zXh_kbDiG)mi%)f$-&Z>&kdh3I&+*S`M8#ggy(*8C*g@6I8dBB)f%r8o zkU$eOFUm^phHth19VJ$p0od3TFy@@g?yjnSX)XFRM2D$EU2+;M3Bbxu~@6-COtK z8JXG``i=3SU6)LU+&pd#Zm$&yWLSK&b40EH0LV-__1oTr{-sI zPWjP>?@kO$9&oniJmA=sew*mJ52N_Vt6#mQ?_U;cjpus~10{1QTAEL)6>tq*Hf<^A+4lQntBlFljU7%5wy)W?z> zM`p9d5LC=q+Z@2e1Wna|Y@2{|CVw3$;K;Z6MuP~D!ygUA( z@0zU?Jyk}hdOuL`Me+xKa?q?3XxNR~v#XL6@q zL(NQj_Fv-$5QR-CYsOjT%6zu8N?|#sqfweNk>|yKPRIp%4MzFeH~kcIC{2nsDr|?R z+2#LQEak=xSEx{Et9!)c1Tz^KV3tCMKSczSJ4`SZMhjjAQ3>gKk(8j-u9fGHopVn} zp4C`&gf2Go`!oB}e*np2bC;pyArzNgE-Dw7tH5X`f9+h!lH|4#z4uq}2L=W*u|`aE zL|0AMMCfL_Zwj4kOBc_{K=(CC=5+XyMsV~pNs4fEyuJSN@zV=W%@=eQ z&H4S~<$o{Z2cSa+Zu-}c7k^)(U}#|itC;~c{r;cn*O$K+30X2{)?d-z?+YTe(aeJJ zGJpPsPyeQeKT%sbJiuXRfIyvxODf6 z*w``+OxxR11!qo;VnY|Rg1Q*jTB)v!QP%>6BwH~@!c!Ncp7NyQRXkPP|3_r(@eMg$ zFE6z3{Sow>`rqfX|66kl@>igHQy2??Rn`OQCt09n5BZz{4G zfAT^H85w2b5w7VSS>EyT6{NfLRO(I!L>azbNk&bnjo|M_X$5`BnbGiM^rd28EeV&5 zs|-Frc`)dF&ftUc03;whTpm#AuM1=Z7bnXNrh*zEqFY7M zX0(-{N(CLdq4(U%4V{BJfRO%rBWb(Ae_bIB9J3q`GL?voJMn2MA2F4?30fguSZ1X> zhZX$A^J?O8`1blmK!}@y_Q<4P=Xl)}FXqqdn}4zDQ`Iin7)_Nl zI7pP$#D;s-aPv-@-bl=D09T0dVVhM45kqHTFcZ^a6%kHI5P@HtpAmFSM$MEve+^-^ ztVkhnr6kah&EdCLRRg%(2>5PbZUe5IX6|-;`~cvbGZ3<9f=)oseEx`FD3uY1sti3R z!G(zEP6DbtxfYZ0Uy_v_rB|$bWWiFq&eb^vnR3<_uE~Ad#`}JLR(Q8Dkbf@k3Yl?+ zggfHD1T2BQON#qW@%I8kHX_q&e~wqu{Qjsp71VvN`O&Z_YT%e z*luK37}FtSKZY=E7^3aeD|cVpL=4IAm+qc@T^>3?0`@&c8ZyLeLCpISf5(j-+*4%} zew4oCYJV8(+sNNuoLA^mF?c_QKcyKOH;Y4fGLh#BXdP*(w?-9DML{6Flg43DMjN!0 zm@=!~rJ*dV;Eb})d5U>7O6}T4&u$!7_>nQjJ|t{WH0+ioelI|YXk9`)cdm9Y$M3qw zI|n=d6`8Tkp+}0$MK-mme@qacoz*3uHzK_okrkvd2F=H40!k)z86$@tEMlMJDRa%w zooP@r*V2^tdFom|xQMN0WcOFDpa(GmKBk`nGR5ID!|*_cVLw4D#Pb*eKbd$%gp=9` zU`p13Y!{&whjHn~t|6_^#Z`S$q55`{(t+}JX^PkN*OWn&(d(pJf6dd9^!V041uho@ z{Q9W2J{wOS3&gu#-BnD2ZsU13AGdjyE(XuXC^#2PS^25p4=DJ4f>wyPJ_vty;si;t z!S^c8G?W3f55Co9HegmU)fDpf?|I-`G-zpbREl9ORwiqfrR516I?jziy(kb@$K|zN zmx}4whOU_1$n9Ac_WA*Py_cUA+EpBB9K*XZ z%t+hjxy#gPil&xEi^CN5)-m<|Pg#LT#^J;<5J}By%Aln z+Sh0mc$ZPO4J$YfE{iK1%~lux^7n3bXCQK+jdFQrL2aCF+fU634Qy z*}5EUEsv5oIL*V6n$t}&|KfCKH-#5vWv6zE*K`#Yni2ZTWZ%vCU+yg!X(6@ z!ZFGVl3DYae`t8fuk9vig?JH%3dayHkU3Ej4Rti%=P~PKT3L})Ozs$2_Qyu-c7Nk- z?9jzn{21&w(2Jjg_eYdwKS686Yo?8PWby9ZBDSqp_F|>6d)6zD3!^uz7)OoF)Dq zl?Xa%=IpEeLUMF4es!2LgEZTcXU3pSgqB&DYj`3e^;0=Y_Q6H^nv9dVj!Fq;GQR2+ z@}iSyX$umeWWwi?LfK*dZjlL+SZ4Kd2%KvZb;dE(62kABi26Jg%6UIJ-9$?|#kiUA zK*3fte+o_q1)I3manWpQ zw4~R{pWlC*hCBcG{?aD-1W6nu3o&e%$fc>%QWJ;LVY=(oo~jqIJ*Tbb(wk;Nl^>eXodZEdwVRe;k!p0%w@2dO`-vxv+XVufpa{vLUS> z^-E>cJ4IryuJ*`fLhhB$nm1av;)?fw;0kaS86D3C&V>cz-r_4$*I<|QWzA^v?)Ek) zb~kwi3In9#@|Zb8Fr?6;AH%h9#L2n4q1fHz6)3c0WY-^2^t(lDvu$21+2m&gXtzAw ze?rATMB-6y4oI98b;;&D_PNW&fe8tNLF!c(7aihII!y6mW6|2hgHZOsJm~&}qJSHp z>i&eY^!4`n?oUwQq#xRHc&~(w?Xr>?JSe#?EL9?0>;1yIDcf(QC@bLV-Xzy&Das<$ zCwj&GU%rBRx&?f#|}tdwIG9&)R9i`Zy0NvsC_7v(+3+b~yRA>?J?U5CfeZ)gldd4x2i4oL~* zZBiosvU!f_=CD~<6EN(X(fi!A;2nl73%p-ApSHbT`(7aDrkoinN-2VysS<73fBd~C zBuXe;0VxK-5nSxDA}Ncp0J40`8I1D0&847N$}q)p_hz$VeK{``f8C%zZ*GybW%p;P zN*@)H!Wp#&{&IwLlLVn9^$Ic8us8og($Wy14WQ75xbo4s)B#h%F6|)OrXDGbTm&y} zcNny;ZX1G8AFr>Lzc)Vi>P5%!e|1;FV?V}H07Kz@)*>a2>h}G6TaJ>3KODBT92GKD zdMJ!rT6r$9{n#U{U`n~pmfaA><*gntvt6F|GN#amK3`A-%6LMhyVH($Qrip_DgS;2 z>wdt}Z&ff`i-RC38Trgsf;>0778eak-5puB{lmB$G4}Fvzkg#pBt-6eLfH-S*r*VN z|7Q}qM~Qc6a1Sh}&}-ra^zIIcBa>m4Oa}Vp@J4mwb4IL9)uyVhSss*Bo5N1b&0*$v zCL{SL+9pny0Rbr#m)bZg7MF1R2Pc=Gu0aKVHV)nUEA#{AkOaX;mCIG`w)<9PH#2va z$|^I-X6|CL$?pezlakz0vs;yo7qZk61(D|vAV7lV)9(|XzCE43KmFqZYBJ2CFmn3- z+a%}#r@w;JO^uTgf@u)b_aD>GFPuwF$B7QbIRG7ot}UJM^%;bv5`vxz@%n6(NaaC) z(jn;j?0@HS;cbjho4Dbdg7`2g3h8je|&%X|I@qy zU?l@;z^^}^`~wAo(XB~3!?ab?AOD?xd-`V)kwtT6{T2QFwjxs-&8#$D=Fh+I=|A-F zCn^liPJf1?KgxIb^uOuf^noqGmhm8e7zk~5O)#G%bJiuXRRn@#T)Ept?5vrVgx7Vc zf-{G6v7wJyL4AyCjo9@u>RS?lWFvDVJoPc^Di1nd#Y4sYJtAY5Z^-God7*ujpAFhk zFeAl-c{fNmsm@4e?lSM7lf59#*W81GF6llYAuyfa{8Jeq%UAwQB%`4&bdZ&QK@*Q~ zP4B4kj+c)z-KD2WcQRy@;lHcMsv+(Ke;B0=^c81D%Lk*ckV$JvxMCbL`26I-pz}F{ zFVO>#fbej6K$X8PkP%#*Ot&-@)BqvfQzQ>%sJTM4RE(4iZ8 z&#m0hIj92&<*#>=HVp0tY0@!&%i$nX3Bb4$U#9XNQ#nk~2Jyl&tJFcnOUVStOuV;t zK_$GpVX}N)O*{_oug^jT$0=x!O8Rw<*In^q{=B~V7n45eR=ZSVG%;y#kf^GO4fm?y z=AAUVlbB%uH;D0Wo5h2Op|dcMiD|Kl2qz?nKo87&3ruD)fXEY|mjdE{dt>@!0kd3r zgB(n3c`Mv?)od$UzSMMtQl(@%cak#<;&pP+Y38o`(gWlmFyjnWnlmX>(VEh7k zNT~8Ou$zqknyk{_FSp5ml56!kSJy-(?dn_dsob}nybtrU!Mlm>^dXvr#xm)2F>@+; z$`D;W|9b@?8D%R&wD4@?;^;70?>y;#;GNr=lP-y_16AD5Lcli$kB)?$S_}Rd7LB zH+G6;C_wevN6#>Sj2rYo^rMgQT0k+SOW0hH64AT_f9_ljVUC`34|sNV{3|Mhn_Z6- z7l~|ZQ<)$>4_23a-U;!y7a;w)4BxE-uuSOB4BoL zJPfNQA35-UEgIAnTg1n;m~En{^HN$~K5G`$&QbWvcVROwuit%3#dN&xitU^O9_L_# zTOAzq$5JcF02vZ(nIRLNnYAsuT~zxPC!ac8P8DTrinS=m;HjW&Qn6D!=F%E=&62jl zF5Jv+JE=2o#m?Yin1u~;F}nB1SZp-RsITmVyDav9FhLu{s~Bt?L%h>~zIx4ji`A4_FGh=e4j<{wCgT#HD4|B7@xs0*IgVRP_sH~ETStIvOr7V|B z7GqX_Ql$0u=57tO%omg%qBmu&%xkubpN*`!$Kq~aav1RqCPj=Ej?rEL%!#kLhPwu~ zVS=s`4=zRv#}LmYy;xVpOF-XGW!Ckyk`l(RxtIO155MttZs2F5Pksn~-~@B-D~7*E zamESSA|9C$cV$rDEMi~MxEG7p#eSAFzRXU4cRGBDPV-+YA69~?I5@Q#@Io^OIw!!- zMD9@rYA6{IP!t|DODla+QtS(gUMYY6_TwP4hWx|9TopsD>+-Kp2TX-Eg=`*k% zp55g_F0^zMku*CoirZc%i+Fc?7ZSrY-T=Z_1`pqxkk(_Q6-?K?3A1MBg^!z&7_Rab z6vzPJ9zDNV#6HvJ#fs}ee-Py^ zlbhl`OZEB;%Dyxc`=^@A7@q_~bE>ItWjAJ|bZeKn;Eriq%o&)JRh~P9MC+Tzlt&22 zw1lB_akmR3ky$PllG{}1v{Vs)mJImovyv)LKHF$A^@6T|mxUM?xp zE7nQkXSZfdL_Ejm#)0l3W4zybLvL@H#pjt`M0A&1vTvwhqovGgOt@9h$K1T$z z-?EZv9#($}VoAk>dx%eHV98s7Z|oQNcLRLKMgGsrJdP~l-4&HHuTS4!1e`Q6l4*YW`rC=&4T}FViWikUX~u{W?DX}I z(@!sya)qCF`~amw;78+cgWvM?Sulew7=PYn?Dbg#i|qx+55wPQ_jhXNpO)b+fAbQA zeTkAOeq2kw&5h&V?Tu6jFBwE4%j+7`h zQBn*f=GKZ4OZB4l1lk&}Fm>civ>}$uBlTxA0kK3|&P%kCSP%n=sWo~9!t4=fb83jD zN21M{CY;FwvEf`2&EY`(aRG!2zJC{OVbC!if;K2(?V)H(NhCee61f6`*d8fSbBrK- zpuf^u5v>!rLp1d#snd6=eVj#>}px zCfCM%d3{#YQ58Uvq2az6Ah4j#Q8Q?zjb|WWF8Eudc*gYo-4l+ItM4R!%rCGM4myc? zBX|G-$rcFSzEn8ljs_kFO^zMMLBkmVW%ojpB2C-c*?nb5j+;BCukTw9*q3CsSq?m! z|3@@n>_zIZH2hN8SQ1Fwg?}}@#2rh5M%gS~ z2sR8#wjpIRfk;HY6>`AnlBe$kJ3wwWxXsZgf7Nty7cY<6ZUuhaPxM=X`Z~{V8dt{i zalcv;T_34s6Y}J;+cCaZMl<1CTVbDfIP2(suNlOGp0~Z9r(N|?Mt_q%^);ip$t|W; zP6a_zs@1(c99Em_W3n05%Ul zaH3%`uX{+kWW+7HPT*ye`Q|*KeIn4T8aNhL?+kF(5DXU!^?k06NKi$j)SDyvXht-r zN)$$FlKkE@gtI<3EC6ax3runWWUF*?@sF8 zY+$jzC(Sgj#(os*W*S#o*Z5E?u-~_28!E{ zZo0y-v)jl?yVf)QGu8omrO|~an4y9FY&PnkDX4TH&Q~0yv_va)vEQh&EBELM~HIVYX0ZH<0^QT$}_8WQH(F}R2Z=n2undE7$&^6Pg_&i5A_ z(CQO_F_<@xyr3F`ez2eQr*Ou$jmITMmNf(W^55^Snt{`fR_!DFyJx}8m%m)q zt8isSzR+vX0lb8{J8hw(Sj^AQi2G%4vbI~@LqN{EAD;1m2AM3QmUCSXIo@p91o|N& zr0M5XxqqiEM9>8w85LI$fjm3B#$Jju^)v8e&Mi!6AtBm)#KS+~-0`{H_)4oxD`I)W zImeEChzXMzZ}C)g2CQfuFm=V#M1ve_I+NY&m&ciu&bk_awrN&z|!(`=@0dg0e+bVB{?bh^qv!n6Lc zl5khu@g?~dpH5P9dpC10K?UCs+s9dlHh$AZg~LzbN^K?KiLBMqMz?zRHs&=~;}rW- zQGY_zMe-!U8uD19op`Th)^M?vmn$fRndEuNV0$YvZEFD?&SkWsc*eYSltxTlD;+UU zsK9$39Wo z2?E^oNB3OG&C0t^?t!4b43I#LFnS1fscu(dS{CPplUIy3#JEOA z%{NMn9iu;u(g1zwo>2#*4{j^Opl~3(-63)j7(H&<@s*KJ=NfQf>=84U;=F|#d(IOa zhLJ^heqieTB#{pAB({}VMc}M4^qHceqKk@+`YffE>#akC42YxRSi zB?#0Wd~=rfILm1T4HVB&zAz6`yx>HXs&`0r*3uk*ishMc|0>L=A|$i_bL-7L7}pcj zwGDn#Eg*Yu+DMe;G|W&z(?AXs#PD0&2Pudn=TmyE{**FikA~tN?vEOrq|Ho^Ar#6Y zkQL>2$y)?8|7z36eAO2B?SB%y*i&T?c}P*^JC!pH;y^jbt{FdAH_~m=>#(&zOGWdN zCeE%@%*KE@cCr(+*~wkUjN3q+9|9V;mH^l~%PpXJi&ZIT?*K~F&LkAI+BEQXOPrtm z096xs=|kKEQZLeino0*PW98U1JM$o1F^( zeB$AvKU5#BV$j!4ZB3&((3T2B_%Yg2ib&1ty1z&2y|QuL<|Uo>#PU;Vk(I2cg!?sj znB-N@%2ILmT6*7Y0e^O<#-@=SXiNqM`xuQ$NmNx)PxWL~JX_u$TG>B`l=;Wa^(nTx~zzEHYQsPqVI2~0;hoS;&@P_w{|AF~uVCt8$O zcv<{>geo2Puc9^1!St-Gf5yF{SDvZPBa9K8p6LKV>Ur>EY!$zC^={+0BH8UlvT6NX zS39$T2Oq3=_kYg6_J?v!dEc|8X*p(GmQ|OAT(xDf%d*OHy)`aIe~RfXvFm)Px?5gs zZSQglt1Q3VDxmRzslvn+r)IQ{8t#0H`TDIt95LMOet!q{sss9hc zQnUB%W~ozkh=Sj$W_nV=(~1}_L#u||Az+4s2YX$1`w4UMxkM=o?ti>CDPAkm#5QYHO3@S7th*_ai7kobu-X856Q&Ahi@#A zAbj9sRPC*%>rnNIrI^ZMXp2O$2O4xVW9;NE*>CV<^`^BmL?)!fm4=J1qWo~41baG{3 zZI^qN773REP%0Of@t;>Gw?I%T*ad%HNHZ9kxsBZJ=3s?eo-*{uaw~x$ZYbO_Cu_wW z;c^R(>Ac8koRylBcV2+FXr?C3YKhTtY$hD5rEaZo>~k|e9mO_|cXM%{W93tp{}jiq zeAqw(Uyl0|j(a~rE5y50bUcT6XPD>RhQPWBAm>%Hx^dWzv9-M3Ka>@SY$|^%o&%B9 z%tKq=9e2x3*93IgcVWjVBRTq+^KuTqC9aZp^UIFVqPjxUlNdXCt}YekZ{1qYz~rQl zYQD~(H!iU4=Vpa-6Do=a@4xX(12S%adFQrHs4Uk`ma!uz|I;=5ZV|fAm@X}<-H|n! z-W*okA zz7JxJ(t9@FkGuRgJo6(l+xEWNxb#P*%K}q)&c~>dtDUo@hi7#R)aif4qZF_6O?n}+ zV$wJ4d(PM9>+0T$vQ})%9lHC*G`e0}j=FF}-`QQ3+E)oFLT9U8AfmXzf>Vu%Y};Qb z=KBj_|NcVR?JpGl{=!?Vg5~IO7Od92$V&|GAPdW#ciq!4MT4*y;cc>VBidnB#M;Hx zpF-RI#b`^X8K7AXV+emw#2Fc%d#iZ%8sGMWA7$BL6nYM+AE(TKGo@b1yCHO0z_s=4 z%mxW&`Vv}38*!!fsn=4riL{9wIs4l6TG)(N?a^c@Io%g@$(85YV+G@`TNID7Xm8^) zglVxO{Ib24mGfm6{i!X8q%&J|D$AgDlCGr~r6Y!{-L|75_nCjU5tAMSW_<1YX3eb6 zwf%6_?%66Ji=2X#y|#a61L@`t7@qSXcW7hWI})Ptw49$yAar(@A?OsZr4eHDQWp+vmYi$#kXD1w~1vY znR114J&+}bxZgThHV;_JOO6&%q9$7pqwlqXMo!Z-sBd3!rP0WWF>2Ia(`R<_(MzBA z6i#FOv4X~v8**>usM5+Y`de`;`X{uY_KL)FTjPKER{YC+G0oLH11Y(gv3^OEnSIZ!UxjQFTd^Kbim+P!s*l0f5<*pb6zzt1ZgFs4*UVbcU7S+8oV3kw24R_%ZjSRpg(XIA zE*Cl+=RJ5atg>Cb%uf|K4E0m_*J6f@Z?S&@BVMQ1$a>D@TKi0%|F3moxu)h`C)%GR zg^#s=k_)xv{9ggem8UkYR0nj|mD#)L44&BTcE)~^_(J>3?^W7u+?SFs%(>?nouOOR z7;2KS_J{f(J2z*uv|vWqQMUBG0qU~qaerP(pk-UWkhXCyz)5DCW*3BV<=pK?w=_JA z)YZ?o{QXq3fGt7608Dah4Vnw^>{&H5q@=f%u#T#VlZ!teC~Bu?u08s2G=+ z7OW2!w^HGvmamG1i*k0Zt*)24S{xY!8RK^>f6qKBklDU~#+A9m(6dSXDI2TdVY?6sC_>7LM@I;t-%B+iE9-0hViHXlXMr8Jv{x zxltpT-U+&Y0O2l6m$8*d6Srx0Do!tdlxOBTyBa=@5nCSHF<^1vT(^bHviIGh6 z>Eq9d;RT9+8O0x!oHS!Z2{wIvpMLv7DOY%$@c>GNz(eC_gJ=2nDwx3*46icw_Nsx! z_JZTV@bkrePwo8OGF;^+FG1KZQ8LBDwbYCXCljSGY{M>ZzkmGvLSy$Co>_H&e*bv+ z*URz+zyJ|or$4^GxCNS3MpWpHDZQmRPUd;Oz$%UA%M_%G!s0WiR17i7qyn_UG1Kl7H zfUuy(0|*37KD6~Ijabd_n3&TmyxfE$cL;H?^_tYR(B4e2^+|NhGt``mlK5prq06)5~mf zuq*3QwRcv&wD(rx=tR=}mJRgWn9^d>9);Bn&q8j%Ni@8+k$J4GQ3 z9?d&y3q`G=g5dDZ6V%K{%Le0Gn*l%bTxOn?YpwDx#kiv+X}mvwu-lp$s$BC^oWex@ zsk-VN40rq2`BhFKPMO|^NVdt8OQrW|?xdkX_|<8$!0@H-WlWyOYCg})hQ6`Mhjyp&eatD57bhh7stchTETLxWx!{QEI;wzNd6 zr&D&Y*s`j3wbII&|KC*BD)c9Fv&u=Fh+SX_O#DXvznKqgnUBuWayHQ<3WEr}W-){EAb%(I=;5E6xFk z2361NpY=7YpxE!LYo*hFSjej`{I!^suB7OyN~Y%{Dz*~wSyj;({je}uSmhN5Pu~{b zwpU~@bU{Ogf3_k+p*xcoWGti}nch)#B}{<6oGWlvQD2HJfbYQ?uW!M@Q)N69Ou7q6gn9=w0cMZ5ge9p%C+<nEr|JaVKTUXwxXqY68X0WdW=0@D;F=irGA-VG_oZfBx>vIWZJTrv8>Dz zrZ7~vh`vDL_fpGE$ta)bI?7r%y8EngwESjNF@#(6j-JJTkh>C2>VS8LX56^_x~%};}O z2#)%Yb*mgK5n{Fk{~Eozn4sDK$gDO;tk%CB-rxYU0RWZ1BbEvIl4;m`)bvJ=J2+;sM4qFyLg z6%Ox!P}TlIc*qWjddH&Z-vQCjO@nh9f{Y=5TOb%!#3;CN3q-vOWy!(m#w`$+N|tQO zI<^I3%lMsdV6q$WeI{*)8ipvZmBdo{v}gp~ePB8Rs z;KU4bVT3?P{667*$vwM@Lv5MPi12glcG2PMK!@)io?ah5T)7xDF%mQzUVk3|Z%}*( ziWij}GyqW?hSzVyr|&3b3SUq75|na|FOA;~e#+A$2ZJL3?*g12wSYLDGkgJme!sZi zX`FvrhP&+SDRBE;q)hSUMrxqk(L^qQ7eStWef{BqM)4`J%6)Yo{jZnThrb^B$wb~GEu3AW9|N@4{cQ811IzT78`zwwJet&lp(|Fk?msZI`pIL#4s z(h!a-n-p3!u*vj`xnC**B^)B@%>&h3L7*}h1;kQ4;zAox@@S3EgX%|r&rfc*Jg8a( z>_{GfNqHC*L`ay&h}~E^p@_9=t8@|wlOwR?y@a!zXe+h~XAMDX9!aOBl~8CRxK5+^ z(|$$c3Vj#!l;#vo2!ejEXZsS_BC65sWn|l2`8Xzo+=VvT|0rjw*@&`Fi#8l>7oO89 zxw~$Zu#3_%NhH|X$+@6^p~Z2lY$?KuRW_qJxG?q-)Jo9(GFS|x#*Ak5JY$K`Zrjn` z5-+DmFjQ5L2#2;fV1A5XnBE9WGQXRm!ZgFs%eJCofFR3$w08lQq<-?bgblBTDgfoe zN^unaR~I3o+JPWa^;&ljVo-{JVja<0#S=tnXa~Pt?_!{Br}eyl8~~cZ5#QZw3(TcZ z9pm#fV+KU1G5GtLqH1U+mI2>K&=QNTt|KUp6XXVyP`ynha)i94N-$*zzBa0aRz&Mw zT%n>PVm?8CgN1O4$+y(o)FhcGH-H7>KutoHK(~jJYLDnL#_c31zzj zu(XUQwCXnmU^$(C$fOiS8W*obUht%5N~27`2gpT3bLHa%C5)$<S{n@q9_IE|#>0+u+7tis!OtKs>EJ3hP?PcpyMnue} zS_=mS4C^Zkg;z4&jstfXULpdiY)Y73N+q*WlqFl7z?MIM9f|>*aU!)GA#xq1s=KJV zd@*lnu_@y%=i=KDEVmJ&eL5SFmqe!?;fpN%oeHpA zh(n_7pKvsPo{}skl>tsepF2)Y0-KAr4_A-_24RKf)!2g8=%G|U=fpV{RUfVxyr!PE zF3UH~)9-#k>v_M((+a{Y>v=lg;u=}XF7o8mI7d0h67$5VhcJ!88MROS_tkt| zg?ltozgBIcOQ8fYui4uy6j+*QTcHvELR5}j zL=(D}9>*wWvIMh+p4xiA^ajsjV5~-YfLU;x*)8r!3*zi>9SOSJTcrgOoq^;%)%98W zJbJ@_OyT8lecj2_)ee2C-;aLD39Kz{vNS_Nc*^P7@$i(g+K&H@o^DDXItsp<@4Ea4 z(g$>8oQ)BjPF+*7(Q8(f6Y-Jf3I)k4BQak1Z9Mmn%~2~D+{3UGg=1~3p(Dl@*)RrQD9pwBKEi3ga5O*tN{7#Xc=HDw?0omXe(1N%hYo)XKRaVuA&k;^!W=bG zE)k{!x+Y^I*+N2c>)TPgNo?>E)6Md_XRN)`ssh&3M$N3ME>)d>44eDg zR_?IGD@b4!Ma8Xwa19}hD-`oOmfaW-)sx*>8^RvdSD_swI%?scH2}&=oag)mf)Y$f8}-m|eGldmM!obhW|c zf!zsR14KYw!ev#A9Yhg(Kh>UpL)w3#d7q)mRO6LNPhDlGYhWIp^a_|tW2VdR1g1Mt zAWJt*&L?J6Zp7iRyel}!5Mpl~nQl!t%PS;SV)8zbi3#Jop`*yeRF^(q;%7dl);O8j zoHx<)neC#xcRPF_szi59KMv!vf;SJr`aX8THIZ7>TcoMcnQ8%XU31@mTtVxvy-sla_;W{M~%8?w6eyw>3r2Gsut?_n5L z;DwMo+y`EeSeEB}majMY>ISbUzQWx>R85=G(Rdyj;+bgo-8lyn&R+X6{UzSx8(}^S z#|q5UClU8SnF^w+mdUh#5^utu&0yarg0s-u@cj_g>YQc7v$?I-t{emx+@OIsdOuD6sm(3~M`)Q_||$`XKK5u*5-^jo6w} zpzZT9KWmk#vV6FIer^j(_#S<;Br7{uf`Q+x=vJ}RLCgHyKAROS!@rgp3QoYWCI6mk}{8 zDu2@I!`ds>+Lb7fd_VvXKw5VH?qv7Zm)qCNUp|%YtZ)PtyRY9m;0Kcbg5;ZqItw6- zg6``__w$>SX!vvEkCsv?{#gF*_)3>o1&&()KLxnFS`E3qLjC}MzlYzYU3{C;Q@lnA z%D-jFl0TuP1*w8e?gjWJTraK)EkNK^ExshytHlWfIcgD5piXNwyq*>3hMQZT_e_B zfYz1^#-6oj}{J=O?o z?HTHE9DWp>Xk+NSAiWh!?}XG7!=U{prlb)>6G-I8Y`=8;a+fa#L6U>lp2-mvYsHWCiv!}l1i{1hpQ?oKXmlo zD>e)+;vSX#n2C%fZdg(>PwrOk#${#eyxK97M`5(8ZX^Jv24j@@n#Uih+tMf&dT@ag z=&G`!BGcQ`9zK$JVj~q=-n>J53I(8PC1OFL8S8@WH*ZJG_$`h3ZGTJ{RRg!_S=1E_ zewXJuzn>OmTtc6N^|}LoE1AVmA14NbaRWscODO|(xfj`63*Fn^)8NJfm`@{tuQ0gI z=Bb>@2}>}^Qyqs|PbE(+B6?-J*q`I?Gr4a_wkYPlKmQ`TfAYhhxN)$q|HY<1YCp33 zPxp_I2(Jj{(FDPY^M4xqNUrRdw>qDt_7X_>NFDY{*f=g^Isx!lEH4gEt=xxcd|-~e z%+U+${eT-~7o%ntIZ<&-FlrZzBZaT@QyDFZiqYZOte_NXAB3mLt>ZmeM4e-BCEXY9 zV{0-=Cbn&RV%xTDo!HJKC$?>y6Wew&v7Ow!_kXMIhhJ6i53B2(-d($QuU_kU?C@$9 z5-9n^EBe%MX)PAbkPRBtSIXN4Nc^IMA8~&s^MBVdENALj+Xsu|-U8X!=&=B?^45^_ zBcR!upUyi@gLZndMm&hA;P>Mt$gGgU>G}qc9ezZ6xtCt@yc8-jH_jyOVTu|;%Yn59 z*}>I^D)Rq`7OSIX4<-(y56e&+_t~p|c`7qu0v| z&s*U8=+hLNnvq+QAcc)|1O@@*6d%ubT$(qy^$vsQrz2#wpuOx$>R@Gm=UlyLWyaue zrHM{yABdX0&1_5m+<5Unsiuo7sIAP6q0$l4syCu2K{I|>Pil%dlSoP z9^WGej%pjBZMe7BM0t;#ZxOY=#!wQ38bg{%sO)et7ND(M(XVyW*2My<-3&fCU62cE z1FK~wcDYWZrn?LJE0&@dA)WO9#H07iW2$nPxzI1*B+`J4@igwf@kJmv6?)i{DDoo> z8HXp!-|tePG@u3GtE*j;?>K@!r+}+%sBYPEyhx2W2*ggqUDE%EX()JFbvpB?LY+%H z4z@RqQBa#MOj*YD4|@E;pQ2nYBvz+d6L#DXm?SB409?kA@ZHE$6P8z#r9(OA^$$&< z<4M*R3-LWl8RO*#H1FDAIT@(18qB}BC$GTMu=lGaW&*bFM!gke&#;i3?>m)9JPqX= z&r#W{-eUHzE=LHV9ZOUz*e9*QKI$$oN$IW~m3(Y?$TMvdwtOfo&N1p7O}Ni_){d`f z5Zu=6uR>6+e0h}?E@9S%$O%^Z#ielft%kZ~Ng>#mxY?J%-sT zJ@(xn^_J`Tx=t23Wo6r-o4ZuiLgHZPKI0kZ=ykIJp?CUmLv}^EasAJY`wqn_MJ_L} zOqr813O$fzle?H(5?T?vwrAiQM7SQ#Gg3-9cYqHoI*onVeU{SS{Dd14dih8x+tBmP zv6cr^3q;t7e97FkIVceFxk$NH3eR-^YPAQ46GECyvqkVYNl-$?7C=n^nc^KvCMWJK zEJfG*PI^@PnUYko(>{=jr0lp)nW-=*oZ8Fj^6Q-HfSPj~rdZk+Q5G7|~ok-Kxhztg1FLdtp z%Kc){*a+LbmWvf5kQA}Beh%k%UU?c_u#3OA%J%Qw?Yit?O%2IDYTXKw2*xhPLx20! zG}DdPz5QN)ku0M>t(Q$J+<5!F?TWlA>t$B$UJjsbqGl^4J$y2)^d9wbVo|G~>qx?4 zcWvS(z95L+X~-PyEd00N>LSA?9pT*Hy;wM`#%}t`G3NNBlx*!VmR$Eab$l&2R#|P} zL(ay4I8cG>`&9#)^o2pC&c6Ny{(6&C1vIp0Knt_srf;#~W?-iU#$;Ol*GeE8x8M4$ zJyN4!r%5Z^TDHF{LRxiS@ z#@9`3dbcY8PVo79eSdqs-!Rz6SkW84d$>`S}K=AszD73a6#X>A0;fjRhof6`4|FB9SYl`*F-wk5^fsTPn;e~WADtZ z7j}TW?w#79=xt(ApBrP8Dk0KZVMTwjhJw8di#7y3U zIj_qJr#eI|ar{YK_489(XZ#KI9N9Z=4RJtKCmxtqn@6m`&{|%lQN|3U5bkf< z`dTTK72MxSj3{1~iY90nwz@-6hFYVh7yej_!U<5cl~ zA{RNzj?kY+>(E;r{cG67XrXws#{1k&JQ~e%hi!PaCZEAGok@OwGN~kZ0xc=X1Q=G59?H(tVGB^RE7|r+jtoL?rOT z`P?n}i#L!0AQxn|v8*Qf+GL!7?#px?JvR}S9Qk_~n^9_$Mg%qIwocntrYzl&q0Adk z9KT?uBr}hOJeLI0_okap2;Ouo3cYJ`OJYbH`C_K0E$R~rAG`z{GB`&MNO_>&A z+fc)G!i-7{QIpSw*f(JoQZkXD*(tYn4spZ;=?!-a=#5W9@xi)o@}c6LZdx^wNB_r= zHHyKv%pYU!N{l7*oN-PphYM3*SGbkmAQoMEMZXx6EY?;os~ zAd20fRvut*+*2G9agkjyN=#^z+gZJXq2+xnG>j3EZiRrdY_8R5o@LZRuILazEGQZk z>Z1z)_^ybUjw6hUQ(Vdpu$nsm9%kEbMp@>XonxvE>=`8<8bdO2+EYl<>oWnC=scpn zY;99OFkm$18u{T2{>kv!)JCOmg2!-2?F0Un@QD}-d`I~??;oWcb>yln!E?#8UlyQA z#S>FftSQ(_2Oi1I;-oh9Q$3}zfvME)67EG0*k#4QgJa*5M#lZ8he~KubQD4sUQ=;n zvP8~!-^^(r1NhULfdt?=)lc60vd@wz&1@cBKOVsTr{&M}=L>^CA+<+WWHI#}HsIAT zJLhUhq~pqNB)Aq$y#1$pB1NRI6<-d2z|Qk?dmwe@Hn0_q*anqQHB=kwB)ovsdm;X+!)nYDu4^{8=z^qW{|9E13qhQq$=KhElT+R>jwgF)j?t&5&UAodQle$=g~V(2@)DBu=^|;D zG|B7%d6J5k!kxsG2a1U5`bbbPWedl)#GUI+nx*MKr<#YARNvn|jdZDK%2NVIUn9Tz z9(~I^C)|A^#GAH9fbRn#LoBkoA@a`R&7i34|604bejQIp%p2?eE6<5daP;~14_KV3 zW|g+)T)qW}8RD@Fu^14*%eByQCR;3-`Zi!g&v)Yx+wqlix^ZkFAxB%aAp;2m0&c5- z@oR65LCN97B@D?DCR3NBy}s;kPV`*#Ra@PwEi`~;JERB8k*jVVUtz-U9TrT@8%)jj z9M^x(G1>T|;3hc;{*VDdJ;W)4-#Gff%p2@ zRsdKNq>TK5Z`tlpXDyKH&<-O^Drh^txW6^Yqf28;y6=3w)!hjPOE+Hy!$T!Yk*mK- zCi`)@<|o|m%nZ#^ZX~CdCi@?SwjIf_TpbC_6VoL_w(WK=-(K;za2!<*>>7Jk-k7@(;s3tK9 zjMoyQDwc+-pSz}x-5+@cn~JUQukpn9m|{-$C3KiskF@DC8=vfPIB@2|=}SWhRBH*Q zH5UP4jzd36-ocej@!e{Gi1rLbpkF`+dj>iPfIMb1&@uO0EY;bb0Tbw;Lro4?)RK%l zZ~oCe{k=(GiqF#=+Ji#CJ~@3d1KBp3p1dB7bspsz1ipWuxkpsl(G|GG2NkoSsnRap zE((wC<^(1ycLS7JHFjAwaQXcR{0SsJ;S-@_@M--S;X>o=2c{X6@^{aY84{JK zx@ot0J{L>OA!E(I(=42P+JOLGeIotdC*U<8?br6wDOENJ8N_DrBJzGk~%0p zwEOGfe%OCsc6bq*ZjYq_8901|lA^!h)P{e+9 z%YW;!rWG=U0&EGtpHoiHF$ABzNy+X5fV~BK!*(>iw_W`Kd4P<5Eaas>Bz?@R7qP>P zu=My~*LMmAwbhS@FDU8gsOsIxiybvcL~|+KHBYr$qduLiQqya2-(+AS7yaTzKuZ2J z@setzrzma4VyrSxdd6x_qfpecnO%~E#8b90H~ClMJB3JdE?gDlwtxis8WUNAIJyub z%3y;UnaS<^Eg)s`UtVE8r`=WguzC97MWt z=7&(Fhvi0@U}>9JFn)+;38ijPI`uY6H0+>jP5zxIoh5Fc@Z7%LeOF7pwMVb=@Oj%O z{u-rQnt;`4%{akao&^q2`5iX6hc^x*j$O1~t7V)V$aI*O8o(QUkMLa$rl0BSuzoj= zIqA4xJ77EK@{Ov*(qb_v9!bKY0s5qI;*opzhU#>-Wc!XV(UJTk?g18 zyhk)+5h`sYpFs=T;=rUQBrY6_HY2(49Hv>dazd4ZLwVU{ii%0g<<xT?xU6Md ze|&mf*;m{@gC2*JV7p*uGf>+Q_mFd3YaB^hM}S(n63LDqp9;0=>W@q7MRd{5B`FF0 zsAq-7d25Bm(=|~^@O?ZmJ(?mTB2;Fu?=3U{DNnhRDNdh+7F+c z_4)F`z=0Z9(qiW@*e-0U01#63_nv(J&$o%^D^Lr zGXp88BoNz$frveC>CAydWE`flmmGp0!BDkUdcDTCXk8l-p`p1Z(Z!}lwul2Zd9yC? zwe3N**oJh5zlH;c80hH2K+j8F(<)L^oS&#s(yD$g?#)f_mw=`Di%x)n5TY{Npdvv)e zlJS=fta!L2 zIAhxcaI@%&kVX3Ry!y=Gi>4qG{dX5Vz4zNIzbtdeU1Zs%&%`IE@n_1tU%^2{jjbOY z;r5X{Sv`aV(uI6u;ppGED^(bqSVMWd46eV;mvU(~kj!rG4fg8`Zf@ZLwtNEV^WoNR zOKgPf4Z{KBURvYW$Eta%%Xe-rpQEhw^Q|fffVj%qYEU$@UV2r%(_EiXm6O=K&2PKs z-5EJ-kLu>L=Ez_1T?w0=1#1!NaK)YPAiGxgHmmr^^;RN88j~d0j1_L3ebIw$H3=fB8$aiF=`*XVD%gvM|5k@W zG(yVMLfB9DkykAvn*3mhzQugqX@lHTDx4_sVL2%fFv>b%h7*QIS!Fw&z#%sV0zfF7 zu0uQjRI5zn6Vq!uTEFu5+6p6X>rd4lUG_&!z;`p}nX+>GINA`D6QZRC#oe6WrZUh$ z#eBk_OfQNwI$#T*Uxu@z-%s_=-Hu(v0Mz;6jiW@2&WfdrII-)=s52!ue%Wu~gXq`j zV|((t#0HcrQa-3MrryY!Z7F}LWB|&^d)f^d0Q>w_wBU=uy*in*8(m?4zC|!t-RvlS?)dKrC2ae=4z&tQbV06OUfAN2mdFNlXdgZLDs%wRub=$}QHbRaCUE;j_c=bst@$G( zV6odeSCX`E`Y96t(01)6%>NPy=wZ$t4Bs$*!}JaFH{V)H9<1N6eZ&3@$2XkcaDBu5 z4bL~c-|&6I|Bb*mg5L;zBmB+p7H1C;EDRu&sP=aiqIBFoJ8Jh+&CC}2x29o&st-sI zluaC;pxx>{-Cs-hr12?3=h1EX8_R!&Q7Kip3-zSs5`L8<>Y`1!egp^C4;Rljj{~Cn z1|cN1R?pA2Abx}|3=-Xz7PTP#7MT3qh&?_jN?81{KDmFi?hIdA_F1|BbKkyK*UJ7+ z@)$&bmgPv~o$V3_-L;_>Dn8XPN};!D&H4k9#zsQd_|YzZ*yAUC0Y9H4&*xrqi>c$d zZ|7B63V-}y^?{zAu8_A7u5Oee-{Vf5kvcSme#Ge(=de7%C6Om$Q z*-(ptiXEjEvwOQl&D=!z2Ub;UMQ;iobH zLs{=-+dF@Ce+50xGJVA0xF9yIhLSQQ*4EC_5%NjCf6a8kC9wB-@mzt zOEWaJ8APGsS-F#X*T6+|-Brp0$<$pUz(xh!Da#|Mv1V=5GrlyBszOfNzi@Yg^bGTF zOVr!Yf}TxSSt>{zb62OvXz;b`O60JMeciskBFwjcEB97yuAM2tfBbS*M3!I=CwV!` zY`|v+Os)cB7~0l`EV4Ee8Q^XYm^Axr!x+FTOiynY$_O$XHT%{F9lD~@;_HOZ6vwUt z=VNj+>!p$9j_Z%Qn*!>-)c8&Dne-XCI&yb<=6z{DbxpsJ`j*}EJJDm%9~n|-WKS?F zt^MFzEgJoqBDSiEyqsD07G|%R`tl7-!oE{WGzxe;`7HBph7exw005DN`yU1 z-?;R^I?z9G^VH1zal6_P}N^a{leD%-axl)7~ zR7|JI3g{LGPAtS%Pr`2v*0M(30m!y?xKF|vQmAWEVn?2hV|?o`V&ce?WqBs-T*DE3 zwpEF*?iKuTPv2je##yZ+79Qf5RG+u^-`2uD_S6seBIlW9uj^>psJSq>$OAn`Hcgw+fcF|l0yvs7&P0~Rn`Gx1#3M#<2b zW$e{%WqEmcgvm0UX;o|uvuUREGkSc#(!qpwUc4h_!C$wk%#MWZyPK!foOrhYm3ze0 z|0m{3*qpziwxBy%PuXYe3!nhprDzcF(M)R#Vj)nim?DeDeJme5X6LxtBv5Q#{>Q-- zjK~9@JdKs#J-5PJgNe;=MVj)b_dH z$IOwgVrh|au$OuT98D(OUm?ZbU3)qadUz7h;ly>gZc5ou(Wcvh3HNCBM zJ;wliIFS6TL%TLX09QEd8geI=<^x9(B5HKlZddvE*j4$%y*EVrDL6KRY_HN6;n+B< zRy*@u;rkB)?2+94p4+p>V8;{v$!JjbX7D{+4c-`j)8p%Ivp7$NQtQiF?kpd2XLj2j z3+*l1yOFL1Gp}Xs!vn)>Xn+%rnf2O@$gE~p;6ttMF$Xy#~q_t$6w7o?A zHjb_tzuQs&s_I(QRf8P;C7U)AX>O93A5p{jhZA7mbBWJwHE({;dus2#d1cq_-y69I zd3Vu91I1uN#`Uw)bn<8#`EJ1%A05iHzAXCMyN4o;7JU?DW`y|VIeEezlVFFIE3Ieo zp{+G(^0}Ac4)T>1G8?m(3SyCOC({-oRpYN(WEr&HwTHnihXu$*fKb2yc=6G#T?ed+ z!ZLuO_s$)&WD6|SRo*T#3CF!8-bSS;rU)2T1~~Sf`-$Z3qFPUuv+ZvLT30^w9E4&W zsDx?E&2E6c74D4g@dWoQ=AG7&J^Eq855K{83-)?d#547joUPb>gAZ7N!Z6KoG4=f}_kSw8En@6Q}Pin>-ToVM5d}`cL*W4M~1X<=n zC88(|5!x`}X~ZOKAi=DkAx>On`j*V)t^`Q1RGLCLEpLFtE{!R-lXj54Ga$T(BMXpN zV$BAQo8nC3QLoXVlvyquY%XuprC{=F8XZn3;2X!sQ9V&J{_|L@S~Mx;oHyo?EtjtlY~m(Le|A#J8sn_0 z5Ie51j`+2T`5?>VSw1+n5>kl|)P>QFG5Zj3M^6Cm`ZN4&DJT*7Nd^RE03&bNm=NIt z1rSb)iv2MIu|UBT<3KDFzhPMkb_*JYFf0g)$GikNfSMVGd3`6$jiHcghHUS(bOFn( zV>|})@cHLNMu zN?_}c(E-$LK_zQYQ2gM+X0WUpZdlKo4uIRPF+1$AdEv%*k`PSRoNe%FEoX~CqOfF> zoO;9#{3_X!TVm^wrW>?~T6Gc~y|7!bH%DEce7b?Cf~##UV8A(j^5ECL%)hBjlJ##d zUMJ)O)mx&N3T_3lU}1(wBvYTc_#4@}nySy#<-}<}kb-}t-%?qBcV;h?pKND4umRFP zt7Wfr0|u9xpO<6*r9cYJn>#Qfg@j_8$>e<(qtQ1(2tP(U)#nl?+RsYT|Lvw2Cd>yD zdZMJHqf}VKF*Qk~BngJTck#8vz6kyen4a5^H6k%bD{FIiS0el~JIGAut^R9I<)dYF zY~Xw|Q45}7xB6v8+Nb~yRkK6x5f30s21Nz4$NZa#5=5_JvGIa6`xEP4^H{H@>PC8Z zG%6CRmw>|$rV%Od3fPt0&(&o2z5=V5u?x6Atq};VJ_P13*-Z-OyArFsNuVs%8W`ai zE3mC{>*_LKQri84)raQB((!X-ZASlR<1iiL+C_J*YKgup8=gh+XmbQ7zAjM?)ayVZ~7V!9Y>*a<1SqOEFnRhg|zwrO}ZI)m-H=$Jh&;PfJ-$r;C~=b_RMQ<6V@TX=Q(TZ@Z>S_N&DTRjP2+F@iM0|r>ykbG1+KiW?z zkwtqoUG5ooPv9-}j{T$aq>c9_UJ&|%@5b=8m@UT@NaME*%@ih3-#_-PXHJ*zBzWb} z5L2%tyx+%{UmU;M^@XJ9O@XkH+`0PSEpSjAGaI)`Z1pR6WHv=-j-81dU5Z^J);i

Ou@p{}<8+-MF-#-6M`mi}%q?gy za#Bmmfx=8_Ggit6LbUb-QKXJiPXm*d1%sDz03}=+;`%5A10WiL!B9tWqJi0!3r3Q5 z0w;oV$7_Wq5=mgd0>TQL1;ztLRNXWZabT!WrkDPUG7VJ;T)1`;;}!-M9a zcfrvtJX-?gJ;Z&G#_D2Y;ixn`5crkg75oC@ywUha$l3zp<)@yBV9IhKRv3l;%A;`C z5FWS@yL_J(0Mm95O%N1cQtHOb9R(Beed7E3?}!kT$lROktiN`s>&<#HOI0K69aCa| z{k`ERvKFPyNiqvfdB@m&s{HeDp$hxd0HK6;D!|t!ucrb4pSShpZJ`$GAoLobD{H(hr zCZy~JQ89lE5@1a2Ned{tF+~F$R($BS&y@lYOY8?uokdwJUJE*0=ja1q!TKD@Js}#| zApuLa$MD#Fl2C?iO+OmhsSUegJn(#N{&d%y%KtOH32 zW@o%|U1g$$qT`7M(sS_y03Qh>vJH$OQ$H!`W>$73K_h|_)HI!?j}zLwPjzEM_4FG( z?W8htNy|<@vDH<2YS+=1evo1CBO^vhE&)muSEe&S!E$5TS3wkV9Bb zE*xE=G+y^jSZO)=!cwQn`56^S%?G|y9mPkD){}*4=FqC{$U4zWFB-YtdlV;V%T!wo z@*?Rs!1~zMm%Q|P;3`g|j_*3sm$I@i*IH$v^$!l1=#%l9UkdMXmJhMv z3EznKCUhM#_jqYt*jF_bTZ>YOZV|lS{Epz`Yo;DlcKr)B`=OKAat$}wMyyVT6kP6&i8LrWdM9CZXw&wMQu@{2{+2dL@<*e;EH!D>;)*+-YnM&$O z^|{YnknNIJr-_|*`-GPU@&kE&{p>Zli*GQB-2L`g7&uaXFc1~gh5k#v8`sEG zmT!p+Tz@T2m_LBsle51Rzy(k_ofxtmyO!*uix)L08V2*N@tp^conpb6zpYiWy5hCQ zU<|-mX%4L5nnoKfFU@=$<;B%=H|5VP=BDFv3*-B0LZUnaiJ;8TmVQ92kzxLNRs4Zx z>E&`D^DvAd@PPFrqV;2H2zgn2yE2H5kD_6x_(VQMqNw8s5B+*B2mnCgre#=}bRl-* z)MqieLfLABhKg}WxMD_tr=6s0_wJF1p}j%w)Gk)DZ54NP-S#d*B)~LJ{ANZUbtvmI zaa2sag`JG6Ur6k$xi@3#3Pm%KileKadiF0yigL|Qj>^h%c`;*JV6WMzU%b(x_om2h zllYPCI6+)Jn-(nk5*yHaDp{s1z8q?%5yZ!{ws*T8Wi-}y6{y*WM{Fx;?W$*&?kXb zLA+#EJ6DWn79DPj962TF`Hg4`Yy+W_K>~{b9QZne!>RHx`enDEBI!fbHQ7uFMSrnC zQ^-H_=kcp^vbwLOVCAVa{a7h z35rkv^=(Ay!IGtbaWWQ;T-AOxJ?oMh2^DFQw{1&l6KO@P2a zP&szZ94kFt8yIKb0Dt}uB02AGzab!-ohTDvTVJ5~a_q^(jSjp)x=F2^sUtd&E+y$G znzDAn!tHn%SBaR9?foaYWwlR@47sz21(QPII8+Ka#13rxtYJ%HqBqkBUfvZfU_&wu zr6)*$@o=ryZ**M(MEiclEs*3WZO^>fM@i>buW&doo zS8@bpkL@*|tuDV)sA=X%ihG{Ty4;|h{^M;byvTMzN$O#=tN1znbZRRqOOOD{1l$50 zJZc%F3azer7=Sg4Fd~1g8umn+;7k)@ylU3Q`Lh!Q%y-rPB96fiTm|cQ#Iip%nd9P% zpsK5+3fF?N)lQgVkvpNM#}JN0BqmcQlq6Aj1@==VebYvH9rdUV{GuKme`h9QYAey& zKk;;7_oS6&@H>;k3xBIB5Bt7@s0peTAZOQ7F=rtS-zhn4^nSO+eO)}rAq%A=Yjyg&{_K9zw3 z%s4u0q|;*P_Zs-0K0bnVbEReME58f+pA&VH3T%tkKcf`cm9fq9TQt%s4(+L55v$Af z$UD8hx_EiNUgkSG_2V2Gc)i&w-3!m@lbz)Asec@!Qv3f7 zi8M5(7!#je0a-n$++(7|p=pF~nlL_p%!|@n^~_bpY75RcMJsr_)4h(lT96Y#X7B}9 znn)WlCKM&9HD&t|TiUYi%vzhZ8kXh^GkHUSHG`w1EFceKoFzj^lf>sgcM*AT`0KNa z!wFZ+2pnLT)etvASgDw+`t&>6EZe!@jfRjPVF+q4UO90@5J3wQ)|l$2t8+@+^set= zi&xd3S%eBbJr<1zISph60Js_!<%R%tDHRITLukil(X_*mDQzSHeV*If#=u!m3{7Yz zzpo4Z%d87c5C0LtB~u&eqE>&u*7QO0cR2%N^%DTDUCGm2{P5X}-NA_~$RoTf7ruWj z-I<{yWYO&P-{>^6<$7iK?cwy8G|#=p3RBx9x9JywK%x37(}fIp9C$rwqpatUu|u;S z=c!jFe0m+btewEW^)jmi&+3qI@<}fmvl@4S&J{!i*(qFn@O;O9!zzv3UL&nTW_x=A zC`G{K6#~Bg4OC+4&)^Zl2(`w1QnA`4g|NbBJID`CxFF!Tr`|RS9qI0U@p1RkV#)ge*E>E<`M|I?VOXD;w8J? ze=;p*&6xBCrv6)fa#-$moYs9JcOo=C-;Dqo&x&G!+5>%OMF~MIf!VX7La(G&>o=woT%Bi&dc$fXawjw&~aXr3*F=Psm4}!2~PAH zfu-TQQ5q=D^O_CpnHNRJaJRdbG>N3)8F7u8=GKBEst!ItpZab~n-`S<^A-kjE{OgG z?FND_ic+9c977^&$i-pPOW=&OQPN%g>waqU0rD-1+5v128qCH+*PQlqMzY(~m>cZU z6oc@ODZ22@Yk%o7LUs7fo-zTLPM837zvDDJkNXpFD>`H%s*=vTmH>|PMNXPC*dZ=X|>)t2DjM*;p zg%xOqlK|#5s7NeGzRT0v9LQCBd4SB_dRu(0ZyPnSqN-~md|q;u2=Z)$Q)p$PA@SEfKolF zw``i8mrFcZ6sgENLLgwR@t>bd`CH?9&!yj+#0J+jRMw?lk2@u#l%C?KtTlHSOiHcy z$EvTdf|NGbqf@Pth!bbqqZ4}^0Zi9IZxHVDa~~6bq1S5xuDp`?h?kS^-;2T6R0WeF z+ghR}@wPZ3EzkGISI-hBam6W409Q}v<>w|{hg3>0&H3khTNI=W%z>-8g%F8*&*x?L zl^=mDLNWTY2U$&y89N_kon=*WLlk?DpYo=@(z7PD^7SUbcQL1~JiNVbMT=M$5tjbcMK+NELe?G$NFteHd$Bs*w&kfrEuP2IEs|IaipR4 zreh!pfm!=Qy1sYHKGw8p8Zt#Ih6xf)#13;_gMD7aXQG<)?Vd>d zJx436;bfpt+JXUm;Qyu3UZ}ZNdk-UjN^wyh21?2oy^vcR@=hpW$<(SCeq+|!M*~;24egC`D@1TLXAGK`mc*iv6xn4c+yj9@$ zka!hD&wb}<)w6kyo$rO{23>-71Up*2ycaG7hd`*TZ6Hb_kw&!2cl|_a;qMsJ|mz}xBCX5L( z-$P-O34j&i%GCDGJZF>Tvi575lIfj=WC&Rvo`=~jHq07A2Uh$q<9*dZfM|O>JJ`nx z*~;^@<=&Y3^hc;nEFjhMA9t={@H;#4F)vQNHy!g<{)4j;pDv|S)eaTHL$KOq4&Tt_ zbPcR#BQ<^Yb#g;X&2!BQ95UKT7@?S?y;RKwriO{68B*{UzqwAPfxjEXpU>`-jHoi8 zbwZ(v%uB4BXj$Lk%Pa^0gei6{Lc{p5RK=ONGP2@iUpbOL%Heo(e@TlJaip_Nb&JPp);;0JK-a{bHF8$&>v_6#O<=lh;7p~PC=4HTN3{0I@Xls(7?L_h}`^+T3Bq!X~s(K z#^RN6H|N7d-N;jau^@l~Y}}9fzT&L!8VvEtyxLFkHI+DFQa)9cG0b<>-lbXSDGok9 z`_OkyZDq-prv%(bSS3-dhmNy^f|1en4*qI;eJIf0cwsg{aJN)TXd;@qp`buYGF?&u z6X)f8qZ!U<3kN3zf#c+XZgsCGf*1hZZ!Ul&2*<9)xc<=Y8RAKqAMagLP=*_zy^ z-N}y=Ac`{&NF&?09gml6Mj$&^XwiK}CtBk`vzu*u+G=^&oIiXxFbh~UG)8-L6J(p% zV$(NB{26%=;|kx3&JEyYzP=eD!pAr>Gi_v)xYWhOQd1cL2!@~4KbLUeQn-X&abxWMmI9~Z zexXGw38DvBNG%zRh-(-BofINS0oPAejfv?l1UBDoMp=ClK8OJcB){%m^sKZkGKe-FJ+KbBpce%cwG&Pp38uU~Q^A0WIj zHmlc*Hb>M*1#@#ERhp5V=gKr#f99Ywj2Wnk7cM)B^+gy>CMZM;+C;8ycB0iLY*F0) zWt}UueAeNMf+raFp_uMv4@=cX&Q-_MHDAu~X94|i>Ef~v_SLpWG}KrmLjKj*lKw8n z1`7Dte00ODFXShvBk=`_RaT_&n+sW^JQve_Dust=#`Kr(R*zaC&6n(p&hGY}53Zob z4P$AI#TR5&hqFFBc_EjA8(Zhqx*y-=mq&pAgTovPz>wZ34NUBFKeCR5m2f`G+*tA= z<}r1iag>BA_`2{^%PqWVk{Ul_&`JDFAPd;gJd=$!%xpXUkuC1+GrpH0%-KRTX*s`) zPl47>RA4?+wbQHp*Tetp*0T!Yd#4NFpKeF=NYuu78$y9+llJj^N{tC-;ydU@+g_MY zT3DDD%7UTHDqQd@Wv=R}_>jF|Kv-R#KE+jEdfu_G-z!3a$5S^X3;q%?NpcqpE(Sy? zNMA@?9{r{bnM>>v@Lu7OD-Ezfb)e^GMIED+6%*zm*uhJ+_z2K*R>VVo(8Z`;rWAqe$`e zD9nSKA4dM>PxH$`J4Se;^;c|Wx=y>mi3L=Cj+OgC0hrd(4vg}t^qh-Vn+}Qi50Xd! zKC`2;Sk#zhbiPAxZMnlcib!Rg>HG5PTbz&jNSd&lFR^dLzmfPxvgPJW>Wv;))N4oH zg32Jh01a?_6n*$wDc530qK{%hG~8s}PR{zGx3P^f^Cca5= z`pfffI=^lp{e;_&TTHBQ<|$(XDQ*eQ~Pqg;&Dt{`4ZFy?F1j!PZqePO0U-qSl%OARoe0ihbRO2Xd-elep0Sl zZT*ftM&2;w6n>h;fBiF42G+tT%$uu6Gq5RTlJ`lXvX`2A zS~2tagiteG@6Pc<9%5P1B;5f4Q#B6hDG^Yqe)>K;4Lz~cwgYc_(CiH=$66c0zHi*w zYkdQd4k!L>=zPLp>9yc5<0uV?^3(a42x(3Ob(DVrRhtMkaSKB6Gn-y>n+^EUTUao6 z2g*M9!oR%NT`gKTr4xfB{tJukxHpK21(&>9CBQSSN=-5?VjeyBqp>*!=EX*9Iz$P- zu*oNU>5gdCHg4&z8F{9C?#@w5UF+P##t;Tmw}RP?Aic)pnzG4}iSDADdwl^(e2+$< zONz}lrf(+QdOe0VrymLaDRyI7UB~u=AgB^B^IszPCs2}08Ux5gj84%K$|W5H4Vc4f zckx1gm7BZ=p99hIl=t~R0GB{$zY)&B8JV5zy|CEajWOhMdusWC%vQE~J11Qo!Z-$K z@4#DlDrQkWvmbd{#IY?{FIMAAP8=NgkWO;Ja6VD%7sPY=JAVEYzGreXD<($l=v)c& zDV6+?;Uqx$beg?7q+nJ4QYxJVnC9yk7l$!_C7UCn{o@mx`{P17CY`PK$2Dh$uz2&vw8|s-* zgUClF7Ej6!CnU6GfOGJxw#hQ9bZ114(Wq)^%abL=xaP3hkMPTRxP4G)ZQWjqDf3i+ zJtGmB1GSR)xmzNQnF(iB61NeQ9H^A2O9MZDyhcbrA8N&ljT1H}gi2&at`wXi(|Ry8 zd7W9Q=NX!!Vc^t)rtLJ;CRI^Q=D3pBrm9NErtZ_z(`q5#Ww@@}7275vDREgCbO##@ zlLA-6y**EbO5*43fhb^7$-49e;uCa#0L@TANrxP0i#f%f!ke@)k7kDwhMcylrM4*n z@k}_+yP*>LHB_~}gJ(j2SsL%>+fABTN)nTy*!5jLte30K!t8`rs!~WXO5PK}hCAc% z0Qjd*-DzM-t`6OSWD;cGnLEMBoR|wf<`>?5*rz_`KP}=|&-@1)7wtbd$x!?`KYYsH zi_v4`{r3@9?Lk;tO5mU0@xS&v{%(b}{-Y13#6?rkkoW!b8~)dR!{4i}l`E?5{{=@7 zMVF!aR1>#PLrYKxe{V+|E(T}1>?P~jJJt_K1859U!7)H9U?N8xpsF1Xas4!}(PoQO zXN?#8CbsG_i>*le0PUW53sA)@${(r9-z{R_Mg%Wb-;Tic?z`FXpFALdsj_H>nC_k2 z%UDVsh-%?@5HUHPR4fox(STwIG{#GO4VG*ApB|Ycl{9s_eJ*D zq7kos8Ln2kKgv%gtc1KkVOVJAGmz76sxke_UNT`h*}WAiKx-VIC|ZnGZWZJF`E{3u zKvTp>W^^G{i22T}cqU`_KYCsmmk|Of6Swb6OEVppVM`V$f6bEQC=R~YQ}_j%MS%E; zsK|)Q?5>WO+s@W)VotL=bJ;%ZT;}yhV1WVKnYPol2d68YSQ4K;gbSb|WBBD&N@eM~(q*L7nl49wd%EN0iv~|E zfPMk`1>o|AJBTb8+^SWzaLN=mNSd$@1t;l;&BQyZrj`(~D%of$mV< zzkR&?@1-~0DlLq1!*4%c;txiH&|VE_1$saH`JdtUmwy%sS+W#9{zaePmqa=%{3!C5 zU*+&``tc`ftb-r^N=<(hHFEgx@GnyENU#?&3DyL2f4C=D4oU1T8r3_i%6wVlWY`$glBRQ5eyLli5y5yH$)ta&*;0kUcOiv z>4ZcR6XG`&-+7~NL=ptPkp6nv6n5QUWC8OP{1ekVG{)eZpcp*;la;r>6s)kxv2`XpS95fU@3 zEkp&z3^M&<-uWWH4Kuw0@;Lwxck}^(DhMz2CjqFnkfBURI*)S47?trGshNJU;c=Ao|wQj|v zH>VDv>GiF6uYMvYzL}Y&qrY&`UpNn6krgu*V4$I5G7Dy*4LE28n+7o5zIWdi^J4`{ z_+a|{SZgC3jXh3~JFz8LNP0(L{Gh-7fBa+Up8TA{xmynB6lc&-(6S=9!tcaiUoj<* z=n=|H+BqyKRjPmGTqqeYz+qF!L^p)4~^(kjuQX+5coX2>rf~Ck`6d#a6 zuvDc-Iqo>d47X#1PFR{uTYCKRpS2}u;b?SjvnBX6`L~VZa7wta zS5v@N^8j*>!Mp9&&Iqe|Smf75yS3K>bnnjtXld^#7lCbPQA1&k?L8ORbI6HBGxe_^ zcf#n-p%7@vWlLsTMw{C})#yOa~`?wqv(Xbse9UF%$=wu4z~SLK>?SD^}!Ilr;{ z0{}RoDC6$5twjI@!q{-cw&)G`#`Y=9v_-bBc~WD?(~_YaRjHDzOIsGBfAe6H!(phi zrIM#DVxF~Fvc$Ue`Fy|cQK#igC%N;z6a*@dX6j^;*gUy6v@M7r-AqH6vh(a42(udJ z>QIl-%g^kNWi1jGgZW`kQtqUspL_Ci3Uj55Vd~P{Si(rfw!3_wOh8X7qx);WF-CCy zzndq{i$KtI8qeejOS$u z_X&)M={}-aP8HT`-k-$?rvwIUa^*X9_cIyMYW@sHbQ(@#L@V_Se@582y=)g4v9YpW z`#o0nANd>!OXuo^NvmbC+_Qf!7#9kiwo~T_)9~zEpkkS?6WY1CU$JQ&go7y^ zIB!X;l^4!7#liVPVKq(89&d$I>&dtYyu7A-z6Y5At@7KfM7M=it3Axoq)}3~vixpE zg$7az2(B0W^$CGSe;9-{OU-e?oV=W8DKDctfwtWqEP@XNJhIqJSO|EYr=NPoK23eq z-oe;@&mI)Nu^2d~Np(d}E+S(8rrDgjk59`tpZ8T*>aFRMn@gMa09NZC1z%}}H&anB z+xE7--hZH0lh@>(_LVwP8DE{P=k8JLt~YrUboExP)th_}e=$V2jq{$!mJ>Ns)j3Tt zn*wu{Yi#eBiE!h*V`gzsm$%|v2s4+aiSTwf-%*sGd9PP8VBWgTn~tkP^6qvx^+-P6 z3}@Mz{h``gH;es(y-ee~H`=99JsYGsj&r9uf68%8muLX0N9^ptV)X!fsK1quM=*t@{#x_Lb9= zWlrlZJslxPy^BNa+P=v?v6}KOdu(rDp1-nCRDzl`5o~)bs?Tg4;~VGPof&IUm-C&j zbu?6e+pn6Jb-ix0vcnKWaDJv+o&^LV1x>RR38YmAe}=P=;Jw^l_wt^EipyZ7){#(8 zBEh@4+mO&w2`zQs8sAQ`M#o{Rw;H3Vl{ZVq^s#2C-f{|&bgY4Fv^VDly}g_20x`nP z!%B{F1_%lN3Cm)o$!7iJMzMk*z(Es)adJ}X+_gHdhV?135}>7UdPvr!kJO#!$--W1 zr&)3;e~`;<$r4*953sOkASjqf7kwU`^{n<8s zmFR9qSV!N&0>X6^=yMR`I5AkpQO67i?M&vaLTl-O*rxx`082{_r~4CVN(%>Y>_0Ss zRxyq&IsHF0z$;;;f97cJZV?+TbMZJ!_?!dRZn2UTw5y}d(UCgUd$^+F_ol5FAA6Hh!!T7 zk9Gk93 zAMao$FM?HGPal6y3Li-Pt0aEu?Btaa4%GDVWBTQbl-l9-ikFcR056Z91K#b+GpK+o z6h2Y-M5&i&Z`7A+EnfN^uQ!5YUcCE4Fz`FjmmqyhEPp*PpacXx8Rvwydiv{+>CdNs zaj*rM^Z1>DNeL;ZztV!{o9`sapiq+1Icpn9Y9s-L>s%C&9+4!GD;uRWC>?9@{`B zh=2+Y zwPA=yz6eHW&>M2%F)>Gde+j~&NoBC-^M{REI0JS5D4eUz{Tf!Y-m*lx9AXfo;!t<0 zoM$K1Agn(y4r${=#GJ8zKBM?y%;Q$9# z9-RiS}NIGGy?@Vnw5P`Bu9(?tQ!W1+J>pLN$6^#nhoMkxff5#T4IWTiwY{x}N zj;cGFvU4Ukoax~O>Uk3{0SBuT7tBc)q=dqOIEvYqrH?hb60d3dvU^yF32W%E_g*^m zKxu@ribELEdLW*YV9*M@wvT8BLaOi$hsfIjO2*bk?9<(mejvYTf(X*z(h%e~04>Rc zQ_4Ty{4#8#3{E`)f2Zx{?&LUqIT^JWSukH$2Z2{d--&K0rz(bb&<#<$%vOIw0al{! zP5Oi6KE`k9?}To0eSVv6s6M}6HIRy3tjRgcgW5d1lXfD6_!%afU8=>X?7*dTn&)xy z&iC&e?SB8xR)1pu&M@!y?;F}XqnQ{4rs5kl15yi+@Br21fB67s`HID2F&E)c?W7MP zVt#9Zj@ropLixxk_ypUa;bx0?WExh9j-#z^l4=GlN}^Y+nPiJhOzEa{oHHv>6%sjZ zQ;~tjFz))^&Q>=D#V@UCnpHzGb!)g9Hm8fG8I+l9x7H0ax$n6)BGPqR56}PS=R^Uv zfvJM=<(E^%?m$Tb+pCVI3kSwr~^c_U~Z5 zrEiqyGwbbY#`+^#PouF2wrjo$ZPK{bdS)nCPP7eke>|Ra48}UJEv&)#K&A1qF>I}0 ztFm<0v8vQ0@#c=xMICN~Ym^HkrWXUp=}MNRzHJ(`#G2ixt8MX-?7nPjF~}oP=L~U; zj!`NFlu6p3uC0U8i-k%uD%^Tg(LnqTw)e_B?Yf z#%s(mfBME@Z;Lq(SoYf^%-vad7P4E+BPN$_h%Fu@)GhuTw(Zh2+o(Y0>N{O#?fxFg zUyJz)e?6Ix+`Ol40ET7M2`*(cC+SY9(D;ovJICj1tkVy$n#y4yX4{a}U5F zf4u|Z;yVLU&u{Y%S#Q4iz7Y%>f5g(RbC%g`VV!AV2+xf=i-V{Ee4^*~cTbiu zWbgU4oxpmgs%g;-3z}ul%_QGtn#x~qmu{XYbLkd_T_0alAeuwiVBAf+ISgbyo7g&j ztnjX?`{w!P*%*xG=bJSMuT(zXoFS}^7G`t-KW~5xPGELVAbxRJ7Cek$yPMZ<`e z!`(aoty1|92;7RW*4_6w=^Bdh^67LuUa3uetxn8ay1&xreD}0AJ-gKBrnb$QEOQlG zV}C^w=MqHNq++S67R<#K-t$qjLcOc^5DN!ymvDtk zGBW>`R`{`{Mp=!kj{cS^EDx3I@g{0M)xxajXqp<+xNe_;M> z#$yF$)4Lwe!PzLLRQ6egE&_J6-i|{t5$nPTr+c#bomc;Vutp#^YrKM_b}U5tcLd!Y z7SR@G3`rM$*+*;5dR+?A&os!@A-*Jih7au)RUzd^OL=(6D z(NB>imjT29C%3isPge+k)dH5PPH^qy$-Rr?BkUlj43V-k$-s#!m0Y124e3Eu7+x5_^WPwW4-4`xVG2>S)*?-675MoJyBRX4D-}?8t8{;o3KmyTB2q`Us3X7BKq__)eLsgD{K1cJ#ejMFeJ6^2-Tdd(L>&+I}hZQnjHSy&M{wtGo|F8-;$7skm z9bTy*w-(@cI(i%48(5pgd2 z-Le+_$i2>FjYYb0V)3pJ{mTr8iL|hFmWBNS<_@8ZrrZhR>vi z4~sb2GY}XMLc+2!N z3Xc=7@N#&7&WkgUCepkH@(8A1%VK)T(o4K@!Ybc?I9s+|B`Qi`n@V5RvCG^^YNl?DR3v7brD5i$5u~QF@nc8b0yXD^ncnrG7sgM%(&Mf ztcScyPF|obno$KXuN$yHuT6&8{944{P2uuXb&CPq% zcS@2QFid)<*NV}`+EmdkI?^Nt+7vim;X(_$)7umco)`jUsCTLSZ8Qc}Su2#fB!4r| zEJz#+LrRbZ{}WNk@iU3kns4RXBe&^Ry!w<({zuu5p!5i)3Z9 zri#Y(yymvMU#rfVLMs;*I%h34M!oPh$dN))JhG{lz+tLu`COcle+%mvzz7?42PU_x z$89LvbaRYc2Fm@;F>0~fyOgTkz5&waYUDC-0?+e~RbgT`mY=ejYS;4l2THK#abj^pU%vUutMj9kgb_9JvLEW4<^9brc+ zvKYG;Y)3jdfjI^v}iVHC%_}PuL3n2z97R{k@&WVtDbgc$$SL+$C7Y+AU zE9ppoEKx?pvRMPu*Vpg(wQ0XI_Jfd1f(a2|g)MX+k*hf@L;i^edoy>0h2AtaU6 zkruqMpJh=ag@XRk+S!R(7Ejl*!b*Tdun=;^T=fu4_-M_|M`|@Y_uau;UoRV7tzhU_WTjHG5Axh{;p4 z_ep=CTqLArCMTx&vm;YPhX;$yEe|(b;UP(YTH`%gj%|4_EpLSl8-=&a#rS=0{($s0 z!wq}$g*Z1dRx}r>7rkG4H^@7bPD5*@Qh&I@%rlA@DA8W4rW9>`U$~~~Et#Et;!Run z^+OR76rrwx37lK1>$SL)NLH3+4pbA9Za#m{q0GYNz3XSB3dzR)nIM|V>N7jlbZ_N& z6mfLo>Ib4*L4=|$W|n>D#X1+@kOJ~@H5`<+_QD2OR9P+~=uP-sC@UwNQf-;b#GNoX zmjee1w*Usl00YG>L0c~zx~Oq}H%qh@8QpPSf)@rcz(Ac;ZUN{Hn4?5nihi-eQoVoH z1LfnP9IS9o?+xYkP;3##YbLB`Ka_9Zs98-GfxT>h7tXtu>IC?HPO|wDdi{JB#bF(q zdQx}J)xiVHA5{+NS{n5hkXs4eHy98LTpHo!3S2H|Vv%<4N!3O~I?QrKY6cO63t^;m z4Sr>Bh^d6|#x9bQh3(xIz}RAj*=~Q0U^y(VEFnQgGatg)FmLKsHQrKLbV2OpddUWr zO5iP9Zoa~HBP1xAFwC+d(RmLHA|@C|+~DaIc%i_K6gQ7#av5Zte@okLki3U^&sk&$37I{fPB?MMf33>44@3YuzrM zi`Mm>SGDdP6pCxi3b#K-by1p& zm@`iZxED5DcNp;hcme)uVP1dOBaeAixar9JFo~T8gJcn5yxRfk+sBm@1eKi8*Gs+z z*Z9!w>$2#!07eS(;le07RUQX5CyA`k^Vwxmu$C1)CSsd3lMoP`yUi;8^C^anyS=&hOmduXh z{wS5T%vYET_LFIemFLzCZo&hI+EX z5m+_7f1QADNPY#$7Y$7oKp2GS{oC~Gvy{s4apXfwiO7fL_m0o>@(IE56To+X?*P1f zvKpSNXZcWXe4Mfz{bJ2?mciG5Q1JnL7?$P8=^%||13wG?<+t}ApJX05@ENM}>-*C` zPurnuv;vfwe*g9qZfFF7PEATH;hdlT{d4;I^ivTriLd;38(c=xRerrs^GG-`ST%@xd$+_`ozxx7|aOivVzU*7DZH55DNiFreLMs zI_VBmXwVJ8#?el6**d{up(`t8G>Mr$glk11eP$mR%b8u|dz_ztQ#185mmPWc(Hx%j zZJOkb@V7(uchHnluyGbA7fkzg2}_aWF|i4xBcH6#fzuUN2w6D^D;1Y{ao&QQKBVJQ zZy zs8BgnggV7`QXZwzfJ`Z?*oQJ1f!3F@FSF~Ts~wn+qdSbDfmf$2WFNemgkCb7VERFa zKj+9`Di`2aj>0cNAg%}BVW@7M9EO@1Le0zvi-8b?56Lrs1o84USLnS_WSB&QFs4jo zAHt}GHgG>;P3!zy+mApzjG}>9rSxPU#0mvTwJmFcZmx3kHQqzMiWa(Q7D5kK=V3m#xoe+Ntw-mbkCt1;>q4$#_sKiC zE)zyw>aQGsvImRB$o0NLRaSR)U&iOt;AB&_v5P%v>xD5TKR@p*7MrRoEw{?L&0=Mo zTYqAEStmHLMGe`I4*4_xA)L}5@~vb*ok`6&kOpWI^NxKu8z-!^HRqXTsAFST2>Ny` z8hKi4;dw*na@!_(s7{ch6K-&%lwIrtlB}@0R5)sXMng-bvu=kEgX|2WLz-HpI3&Zymdl zn$KF_`Jw#2k~{7x)tCy3nl*xKD9I!A_9kl(3|iEPNu71N3( z0OpbaayDbC5<%zpr+g2qtS20<&ts0ysl`fvi&n^LEaIIKI@LDxB>+CiU!nv-N?-Sv zb63CWTILHGDRv*UMw# zT-37y_KxXuSWC`XgRaSHd@>A#!i&t~TV3Jtu~yqlTCKc`PHi)SxVIZy1*>sivke3a z7dKL{RJG&d!_Z5#XL^|S`uoO)ChiM=ttF_p$nbmf7o!C#edcL6g$fn#Q2wGc38(S# z`AhhHn`t%QZil|RMRbmg=VON2Y#sTF;=t-%33cUXh?pw4(wUx9|ElCm#UT21D|K$6 z(QDekidL$Y>Uz$ELQkmoHxA)iW)(z*ZT za~4SXIOVJ{UhiZzJf{XL>4mj!Csu&bL(Z&h*1);Je#qBc)o9lh!$UrB=GVz;cuu!j z0f!9-ekWE^30NA2rK&hon-Mx6reanqjQkAM_xpH_&#S@91?LX?@CtblEPcVEKUnpi zF<(DyD!7@G&8!Z0uo|9IgO%lfr0DV8zs$;U7U=vLE1Ox>)hkuJT*dL2pO3z-lhyE? z8mz+aq&4ou%6Osh43)237FH@WZ*O1~3g!mDq2IlaPpN^5QXa4mDsnlTP3rtcK^*V5L%Y--neVmPBW)P8F+TWsh?RG}S$+noOg znas>*myzT|6NlS^P>0)sQHR@tQit1uQ-|AvREOJwRfpSxR=3-NSCkBwNgZ4!L)BW} zZyU)Ce)nH7Kwqu}GCRW|=SOicn!7aD6i#czDbUvNgRHDCzB-a2$wm6#_v5TqmZI2} zB{^^&5_4xc!y$+Kx7d$Y`~f%U=IZL~@bDf^IIWG?!Y!w1ejZuAPo=Cd0N4NgaCIez+X`H2!?*@K}SY&>7}WFcVy{ifdkuMq^z_ zaj=R%IIU2q3RWltakh|Nxto)l^O-&!U5@@^nxDp#5ACE%ac9k6nm5hQr@ni5*A8cY zr=Hk4z=`;1J=~W9Tlk+)#Be-oUK*@^()==hKW<)`AEuadIUfDNmL$JFJX}(J7va7{ zEAUMU#WFk?5Mr6~JGY)0PRKt1Crb>AmpznM8h^M24U*j}C61*A0eV2Ijh;}jNqarc7B$)3#Y$vZ zE>^US+aRs3aLqGC<_);Sv-PfQz{v<}HO<4E1fA1LMSdqIN;>iRiJj_;gtbGC;`P)Y z@;2_qOYRnUo|=O6MC^&QRkHF#sE~tp&Nico@_xx&n z-ekJCXj3XO48xY(z?JkNMH+BvKS;Q^7z~Ckq`^fqoeY~#gW+U6ZT>VIkEXN9;Bqv> zI=?$2Dld*m${unb+5%fp2awAa$F0SC)<>T$M_LO$aTrDV2#jQonxTZed%Hpj^%o*v z+ZF8`0_$Ov+OCMZr&-FW>@qGrNG(tn!qFs`L>mZ?aRq+DLp5qxuRIx;qW1~!N zdFS?k;URhJ*sy5M(p)B1uTp{3wlHs2Ky72~gaWNPTW9UeTFX3BWBV*fnZ&DYk34X{ zwajpPzZEQJ+JqB5Z|0|u{*{2=;kqWuT8ziARgCA`7>~4v%hZxB_+!@M`>EqT1Ya9d z&1n%$5>vL$d6-d9gXbrf?gfRc-if4O^(qpwS$_-@tSj`yprapWB0PvBSra$|*x>y)I&?h%R8=HE zdHpdK&@dMMR>GsVUhgA&>B-q7j{y7}aF+X$F0F|?Not3jg472LJ0 zf5H>$k_pFLcKC17G`XaOAVcs(wp~hsxx!5sunO8n*jWx{U2LK-8)qeqGWZeH6*D&G z0EMJY7j+_`$;eJLnT(8Q@oRJ7oW-=lvZPj%tLii~>td6Y)THGE{74&Nsj*};J21u3 z){zOLY;tW57=(<%PL)i941QDa70?w(f5T(=Db;KbcxvS)4Rf`a2E`UbcGtEdM%&8_ zbz`%A0jrq|+=V@D4#Xw5XF*pR=Sr?bHVtaTNZTB{!aywSfVNtEn5?)Gve6^WG1m zk4F{~)SzDDF`ggeNla^a79re|z4rN)mm=ZVFdlB^|%$4zEup#_-^L`0wuJ4g3D& zd^GG1yT8Br+5Ug~`($!?^{1};?R@h4^@;C~-gob=-(T*X4nA~$yZ+_1e|OQHT#Qb- z63@;CIald(e-J}2)O?yX_EH_33ZI?zdi}t;ch+5v``!Cqe>}SC{(Lrqf5mL^b``BK&O2^sr{ zq+~I{r0m0?i6hT0vSoufy%0+rp-zFd@aG%0f zxTkc3d&_bS_m<`Uk8wXbc?WIJKMWe;b?-p<0RWFA<%{LH;4PY?f41-uVHcU(6RpAh zYS7mFM}Uu3U{1@}RNU6vuudCeoj!wg0Ik*U%Vc8#HoQpmD0#w5Hz~jpz=%EgR7AR&t@* z^%ZbL1K~rdpNAubT5rMQeZ}YG1Hual!WR~XI@SmD0;Et!bWJ=OFldZkic$ZoFe=@Z zh!}N~h`2&EjdLiYz4ad(P@*`AC{CUW2Dz+ZkaZgjrX>vWe;k9H<^y?v&`1^v)p{vx z2J&G{-g;9h$xHb{Y($f`I~KWAZ(Wf{MWjS`sTn9w=<%u#%Ij4qOB9JJXm}Vsc;y@( zKntV?WMkR{ zfK9Sf-I}adf3fw?@+o>}Px@5K)(^e$dGF-nrfQ``4^Xyp6^}|q@mr!pK=1^ZaTd?? z#mXh_RJouc@S4(%sfntmBu~=TXiN7Fc)3Y1XH0pMw6sDsO*RR(F0>IPj6+&Cpsc9; zYTkelh(>sOHf^q~#|_yeZrHKjO5D(;Hdp3xL*{Wqe;y#wkrI%N)FP>wI7aby*sRI( zmwJG#btg~aij*b`PeM5b?|gJmnmzf=K@Mr}Aal4aR&Bn@h%!R+A~c(IDc8qdWq&lh znv8qrKJgo4-!?Nyn(yRqNR9u`iqi#ihe{3J? zot-Uw4E^Wcfh-s64G?vc@^OV~c6ux7mC7cRe~H?wm**0~>pH;7RsgHA1hDx#jWRFx zip&S|BjA#E0->EA)y3Nm&DEo~e{!WsBx@R@(r%TQF#ZNwdASopeC*}UJGR+ktMH!v zmWOziDaAuJD(!$$KDuamJrOExG|Pp*P});@fa6pv!~prZbVftbj^^qY#7F~UNS*}km$YepAL?x`&a1u6oS1-4GZ4xP9qw@xoRP7yJel9hfkbLU= zLcERh$5|WxUs1jIP?w=1Rui}43s{LqmwOXbCKTOT@o!tV5&qqO1%dw34KN>hi23a4(5HO}LlE+M=syDr%OaB(p*6qDpH4Yo%HXQb&=(9@<7n#K}oP zGol);KXR0kStAT4sr8p2*^rbo+Dc@*mmy_;>p8KbQtW9Gmtt&s!KEY#Hgbei?fo*j zl+hKW1gY4&po7F@)-pqCZ<^7I1Z$BLQnnThJuUW>ac?#bJV-UE*{CiDu{Y)5a%}Iy z(d86d3vxNP*}xQM7JGXPI!mw?xXjv~Dq56mPcgB%l=d__EEvOv5LT2;4~8%!P0yBp z9ZMz!14K_Ye^MY-o6`zOQ`3VtsM?4yKrUErSVP;&W&=wrfh%mNNwqyi2h@B6J|mgi zJ$8b|CRHaItY=K3Xl}hkNbRj)ND7%XOoUXi*)^vOQeeYWW;O~`64~q)TxPbpG8YhQ z#$^85R;J>Qw%ILEF3m2+rZt;#h^~YSZ2i>?Nd-14yON@pU{zQge~_yYp`o@smEbgx zva3m23+Qp6Jv9fZlA4~niXN;N#7qd#AuPR#=52z2gJ`D30w_cqmB2M1n!`!3pd<4* zK|IHhno$d)kaO94+u}R8*Rueh3w18U&FG$d@-PiY6b5jM6O4P1>*$2j>FHoF3`qy4RNd8N*!?z`oDGi8M^|Y6 z#R0)x_VHKqAD%ti!@ma(mTK@B4%QErs`y&dV-NOna&|Fo1BG|&AE@$e!(4gC+s7Pd z7j4Xx#T(K@VGkrCQ7;IgsF%!ESQvlFCV5Na$tD)~5_9wcIU_TBz*6MkOW_Y2mm=F6 zryP6$v_z^tsI7AGC0Gh89*g~HjYq_fB9j!@22R=RCxAX)K~lM6*2BW~3qSzy0#V)l z{U85yNE8ZqytqC;Ke|;R2K5CtKo7h@)&`nEd`g>WlA7D(O*Ao5P>3Z>*L{C8J|9mG zF9*YsOAW5NSA*$vG`VmzyZp=h>9>c|!F1$iaMryXUrb@+CGveVxHKy-kucynG{3;Y zCQ7pl2A0wc9G^YwUQNcs!_o9@_v*#V?#<}^^k``@Uk!d5;e{@yql@X4W&4JtShTD0 z^<+4@no$tD_5JANZ1DB?eOrHI!*i{4g!U7(MCOv2?dBX;GfLFV8*_CB67mKs^Bx6XJQr1yJ`?>3{nyk5RVe)6*Qx|1Q!Bdk=r0`MQa8sDUjuj`xQ|VctqGI0G}m@ z`5pKy!O};APhA6_qz?g~tPAi-J?5kybCPVu4J8JT<-GBDiQ+}%u|0l#IX!!K_Mg$@ zN6@Cx)pRoGX>rwrmDREsv%x?r_i&^og&XEm)hASg8)%l)7~K7u#OgKH zO*Au#t-OhK;Ezu#n`iwB-<90l6@=~I>9RND~IB3zbGfGZa=Z{o^ob{TCkJ=4g;#= za>R`AhC{dT<$Qk+587Smet@WK6}lp8p*y#Ccj&T))zHV>r3))tCx zkoEcheL`SD=*>uf_a zMwDuGmCgv?LuZy079<6;o6;tlD9%IOM6+fu${Q#a_|?iL($hvSEo<4R#8O2O0voBt00tu%JpeQk)SGo zGwuR2bM=4rp$6e(KSTnssul`W^Ig1(cfjfxaRg_X+fJDIfJ}RzZRN1SEmSwzV_DIf z7ZBCl=A*T z;$4K9#Z@TwNj=#Y4@Z_lw0&6jbXNg0+wa%{&H#U3y!4fmqWZx6#3s4|&vMMGw4l^` zXhB)u4TV4Xk~dKVM_k?Hc-or>b$#Eo>H|XB&Jo;%bnP>C?PI(CU+$X@PEUUvy}z8y zKB+71A5f{=Z6l@#nxMS&O$0PSAAO|%x*nV?h8iudC~i4a+h+@iz?-@v6x^q$HB_Q@ zPJ(|{A*7c7*|x(c2zrTYd0fIn^0*!Q>4RRvoVeS$pSh5GfqOxEVF#aVsi3Z^(J|Ey8>tXuXR9ZMQE1RPZ@0cqYOBYJ95S@`Tv-!_o?nNw|j#Ei3dCM^IPQ zwT+KkH8px!`;K#)rky#EwevH#Y8ufD^x0r7#Wk#r^&wb0I{-7o+BiSYXopt~NB;#2 z=HSPfm!Tq76SweOSfNOl5hqnAm$;=^9SH<+2CNH=L9ykx-lbR!0)KD*xE^-TudYTD z*L^!0pAE-v1H3+*bbsr9=)S`P=ACq}ho_Ub6r)dO7o~W?oluItVy~%+uQi?=bjP>v zCbrmTg@SHDaq*Ee5x-Om@3UvA&|)6s9;ueZNlAD#_= z@BV)K<17E`W%urK^nb1^@%(&74LfK5QL? zxk!#B+M}U<1UUeGgdW0fN34XM61d+Z?<^K%KF9ax(;f~b?bQ)N-&P>_$4S+`v;zg( zmA?&lx5aiwTk00(mZr`4+x&M+E-}#m(cVFGY8-MJ-&}y+(LF^|sa#{e*a=WO*Gt8I z5iB=bDa)0#80l}w)uW8^dZT#Ltgmj^MM!jt*{ls*244ZrV@u(z{H?ITF=RGbJsti1 zk%;{F%5n25h=?$eI*0GHSdq%_21h0gOgx=8HO_Wa;5>or+>U5-X>AsrZ5`QFR!Kj|oOLFls+;Qe&>&E^0kug`^!alqYdv z-yFS1KF0%m1ZI8Om|W3}*y6Ldod5RYUqb5yVf(*>Sn)=e_>%ya>j*b-$Yt5(I2Gam zOftZ3*h8eVsvc4GHE9g8)(y2Vt3-55sv+{Yva{y$Xqedwpb3ZYr?4yG1S{5L7cAB! zvKAv5#qAYUHrbCFpZ?dQpVK;%0*%XE0ovrJOj)klG-bczoJ(4+biADRDIE2r~Rk(*EUDOwdjKNm6!TV&9(c_DJRX#+S1Ac*{{w)iG{R_>&=tr6k!o6P~ z#G|-9RTnnxG{EVnj;`h%)<+AHaIye4&K|Q?+VoU^o-%Kd$q7wsj!vL{ z$rWbI)1$E&{1XUG8>c~kUK^)()oB9Q7{R=VIr)cai(G7TmE_7rL+OtphiFdmM7^r4 zC>yry4}>nu940&q>;pgi753xp*Ne}uFcOdY1Sy(LHKOi6A8$rJEFSJW*&L1StCfYw zaAh64OLJ+yvv&~&Wf+3@qTauIL$DJWJa($iDoGz9o`UbiPa}95FY~W+C7jg&+RF@C zVYdk4KQ&uw-PjF`1M@l);oWvK7SP!?18EXy&dJTeQiPp@Hr+y4L~jCVKtsUmtLQ-H z1t*Z}!LAg&B-C1tT;~%Q9{&=Ds#P{w3{=C_JJu}2mv%t!z)BsoJMC;=uvIlTG+$z6 z!vc+VE`nk#=St1DIEn_z&mCw1+-C@FRg&hDdhS=qw&Ph&P&bd13tozF=NCy$581*y zq<){FKoXQ^@bd#!zN039*0J5+qwPMxXH4JGlxP?A;$Iqc|Y(m1K=(tcZaIw6wd=MJRz z*E3{e-yM-XzH2zA*qk`%T$onaAb9}JG9Sr5MB~y1-&N95p1j9-FR*!xNz_(tsmR`u z*JntmaVI!GwkqZ}h)}|wY|Pj|OpT3xIJUg#Q#kOsx<0sIKx3C=tSdzo9^PTaeh%2Dvu@0(H2Z@UGR=hldLhQ7MV8WmT|b2kOq*tW9R@V5oqJT z2_jNZggdrIS2f|v4R^;am6?U)0{ly#EM)*)jXvZ-Vw<17gu&}GXm3t&Azc%mm(|q|cq=ah+ zN}*|DIelJC;&EKp_OL~)!rD1m6A^V`85H|&O|Sj;vs5n_!Qcr>7SWoxa`>acemb!A zWLhJ(QTka)EO*d_=1>Z#ym*5Efb$cu>kcuAlIeE8*u=NOnhHwrAfs z|8~*qg`5Z@jN#(taa5F97(Q?~@$4}=E~^L?UXmqQ*`(=r=5BY|MnJeq0mLg$p0ubh zh2RFJ#E6u0-u48hHf&u~fPf2y67nVxWXs)`fK3&W(jd;{fW=OND~Q&^nRFC2vufNN z@O&&*|MkdYLPV2*joqU7QFEma-eBjTn#Pi~*uMYZ&)|g_&pTucjI9-?dk{9!CTwgI zzsdh|y?e3WrE7+^I9k9*8@Kf0bq?X8!j~%91sz(7S|-~=J9DQKp)>GC% zpIvl8(N=c5mU631iMX@%kJaWz_l3M0;AGQ$^%n!YP%9fSL^!A~2;~zQ*_0C|rPe3X z9Rr32R2j|7QmP*d#?2_VJINMFVu;fm%NwQs4x$1!g4^F(Y>ZIIu$0h^!@;N@b! zcjFxUS&xekYE^Ai%-Qc9Or>>W27v{w*I;RQNSIH-@H9^h>;ksKplkJsymcYRwVG(* zXM=(=ZXxdQyKS(=-@xz)Q}*935>hm(u0yDilsvh;nT70c1v`5f5(k2`k$bEXz%U-) z*L-dmRv2rPTasg>3d-%DH&NAk01AfKahW_XzaX2pP;`u5_&$R=Y8mOcG8WkGy4oj* z6V_mS#khDjHzUHLG96v5BjH%|4F>`5jp26vCb7Zdo2nVTJ&nEc^KGNy<8t3=PA%l{ zei*4P-`x+lE#_~NumA)568PIaG4RK?@pCh0C*DPh#@Q-IsM)zb$<1Z>~#!&8Zl2CGy>&@rv?-ef@!YZ{8=q4Kd86;q&+(})VaBT#q zG%yiJBpBqX_gH)5IqJ7Ig%!|ZfX$Oa(O`_zMl_1@SrjqQ!`~5YSV@}-W;6%9SZvb< z3Pw0G^Qd#UZUycvu7{`6W`lyKtH+4cnzfjNz_Ti+px?{3u%_@!wy3J}Oa3xgGIa^{ zaQiNgEW#CR3h`~n9Nc^4E4Jg$5SY^1D+;ydtOm@S_1iUzArlC+l}F|2fNg1`LUDbg zZulo~&A4rwYmwYAnNTek4rT_kQnqQF%5_kgI!xD@;f&)*FSRjoDqlD%Trp*#Yk!=^ znRc@v${!u|e2hgvs0QYI4&$%pTlJGU+)lK7v_I_{hMRHxi*UDoH-QH zM*LotBuyqoh6{3)5Saj<7aO~sfV8Ob0DMu=vpeL#T5Z-OUT0f&7{4171p7VsWmX=I!!!qvg=bld$fL3l_$B#Jb-uv{w zE^|uQD{wn<*ar72jae_+fbJom?t8JXLzCO-bNvl$vq-29+L2inwDKSAHcKB}2J?y> z04LQ9sg1HJ0QioJ_tVv;6ZBU3FmEFy0oc@7qJ@rG<#-zR`q0h25xsv$>DlOtuN1}m z^RD;DSEV6#ROMN(+XfSMl%b=+dLwZCvNfw!GtBXIs}u0=-N_End2V1hW8fY#JL}Dj zIs2|X>#$4FJ03wT^2#-ro2x`+DSb2U=`J92=9fDKV4|vJdb36NT0s4kFi7rHRs!q~ z%NP8ojbxUhk<~~LS)47{+V~Bz=f1gX-ks7nTwl{rY}zy4Tl9wep_E9U z`Wr6~7qUI6$p9m{@MA`rX$mb;O5WPNXY0zBqzY8*hS6E~qN_ zI8#^wuub*c&5BDIBau@TgkNXh=ySQ+lW8cA%~4m+8YWdHeJQ&G{j<1H@$5GeXWooR zhCOTw^7DL$M^-hBu?oQ{K88EddSs&7dFv@_^1Lo{7_5eVmfI)*M>>!Cj!7Nr#& zOZ$`)$i)Cm6XJYT%!Cb+AZYhoppO~SP}vayAd_f2$_*vNq{kF(&@`6SL}9W{eF}8~ z%5LBYsROvQyL&MVczcGAVJ>eIf3F#_io4UvQuZ6W#rU6GLO^45r`vsw^Z1Ra_u zN|V_O8nTeO4A+I~PKq!u&LWl3gCjk2iA7O*OBAP?17fl%K;!t^_=|8D?mt>jlZWV2#vR2pb~A7hX0IJ*s|sQts$!H;=tz_lh*eCJ3Z z4ChFs8&(TQaB0b@=+0QTk|^0F=h^~G@}L>4b_4GG&DHE6W7HG80Z2L~1fWF9%ur;k8W9+3h)Z&$aG!N{ECJNQ&$_pKl3W7>~+_k71brs z+Ku<}k*g#uF*_?q0L(Gy6dZtNZc;}DI)s}r(mgSzq>!4b7lPvK~aVdB4?gheoms+QE`Js7}4aGFXNxTa4BSLZDZ zYUs51cvnkJHPz2m`;VYYRSk^WxyxJM5Ds-PWmRc#cJL0l+%T)t^;`na@DeFj%uf^P zlxM8+#5VwjYB6H@=@SIKMsl|n3p3}K{pL@QVwAi%23r}L08GmBmyv|Ore62Qw&Bjv z4&?kft*rYtmKWdSD5;MEGxwLy>ZO^0)k73$D=*OO6wt`X-yvq<7H%4HT}+fJFUxa@ zeh&?NDk0{4D&6Z8bj{+$8lw%iU>pHibw_ei%mM&6pP##umLcz^d_uQA9vEi5YRi$4 z9>3KN`vDPmdjr+!?>j0}=2K!W&xXjep!%<_={-+$j9WkLJ%l8iQH`e^t4tr7)z_^B zj#w(J7aP||InNB@B&@@)ynC8a9f6KBk>Ylbapz^>qNL1{@eR{B1n$YMKBLwW!a?zq zC<*{c%l2WcFKDxG+0G-wDT;Xu7*Cd$ah2R6OrW070mT=rNGJd~d;+O!qPudbzj z)aXCkkb6^0r@z3Z_z2AZKLhTxDl!e2)<}MBX3qc4%v-;UGFWf`+@EZDwt+oVVg*`x z(dkibYcf}_?B{(mR-QmqCB=@Y7nP?sGe2I>HwUkPLx2Y=c`5a?Jml|<^GovFOTsE<5Qz4G32PMEXSARaU35KdayT^-PtNJMWeMu!RRtgL-H z1!wjQjZzcdW>h1smTuZp-~foVoZC=Dvj@`A(dH?J5${t6(2hV8$1($i-6;NN{@EiE z{>kU;+^#%ZyV8wxM{_=6>mOo8i@`djNOKHx@XMy1RFvJ?)BkE{7af9n#r;3U<$JI? zgt&x9eaMAJU2;J-(A&C$9u4|g;iOI>FCl@|HZn`t%3TUe1!LI{DuDK?)j!$irwxfQ z0(RLN&JriL+YdkhBlT!jxpN8i^Oz|`K!G4IMX+*1n=h6VurI8_H~Qg%7H&LhXFF=9 z%?0E{n~yyl)xePaG1kTs<|Uvk*_||G@U!iX;K)tEiMWPW_$Nk@5V8t}TqCP6TOjnX zI5<1~pvQe>{xAbq0f2GAw}A0TVUbdMSWC7$uRGp5|6WunnJ3ykqf&a&<|+aO=1)`F zepj;d$|S9IbkdjGZM%q62-Ra3qCgn;$XxFRTXjFrI_w0k-1U$kQ)c<`U_f`O29rN2!z)e%)jQ1-@ky)2f{lO^#JcDXOLQp9?Bm0X#02zxXthbv0vK` z#2BeyOiEx+Dc2;%5B|@6m6~ynzd4)Lq1#vGXsnAvcbT2HM!b?da)p_=W`*_*j))Ue zufL$b5P5Il%+uHibWmG`e6&@C)6fX*{>vc!e+@&=e;bCz+W$2S0bn>S@J$>LK_!Z? zKQq+Elk)FZo-!!oisUm&B-Rpb`xdVq9Npb4b1V&FfiFhczb+F@=C<;@rO-xign1O5(6Q~f5W5Y%ivdrR&_a(9hrEmZUT54(3y`eMS zaom4Z?&vNgsVMR%Bqpde&zez`^0F0)dU3H8 zbrdF(V(J%eqsZJd_ILqmEK`0B5U3v!L?f#Q5yZqTkx4|)uKK}E#YbK?Y)6pU1O`&e z3Z$VaI2AQwK*NqE8-t>k4He2mWJN4k{yG;qMdvO-Ib4Z^O{nyXS4Hu~YBZxkija5V zjlB+t@lF{MC$3CZK)`(?(Uh-h?A!c)@!FNdwZv;wY&K|VWdguTVuZv!V=NoboaLXe zZtwMDiFb=9~c8xM^?8AlFSvN{AZW*l%YyzoeY zk(6+yVfl#3jRw5Njc4YYb3A=Xg^6efPsUNhH@Kf#td z{iVW@Z2KN$8N2}4{{9oL&0ys@P)G&IULEOhrI%`uOel~O66Ko3L_wN)o~phe+TrRP zkT`$Q;|$cT`0jjSFWUVBP!!{O-fBEwM$OmxiQ=gB?{-fWO1Bgx_W)UkZ{zn>e|qK< zE}LF-?|$A5(q{rZH<3Cu6M@c)gBbXWj;8fsI3hfg$x48%QK*GpE5C1tLw2R9RyKb2 z%;+z>Mr43jFu=RUz|Q4*AB_R)L8NLPtOY;8e*7XVxb4@ITB=P-}{|^XJpu-6kaFY2>7+@%!NeqgA|eH`^Scy3_2wAP_vveHt=xdJdwWeg5Az+tCeqpoierof~I+Cek`Ed;Vdb=>lkV{juLcWC(Fq zG*If{7fG$2Q>!26%Na-F>iO_Bl(cYsm21JUSm%nY(hCcqw)RYZmp z8{p+KI5WL>aKFUQytEbCF{XxkvN?Zm_n@da@;1Ys+haAA5+ z(z6PkI$-X#hC>tGad0DBC;D;+ftrjTIY&W`u*Qxz!)Iw-0TD_eA_(}*;kUnVj269_ zr5zxH;=OS84UPj)^_lLIi9DIgNQ&!v0MC?aV3xYF9w5pY&3nKy{BC?#fYUHs%3e}3 zG6*K9ukG!&em!1_2xh9Sjs}Bjx_!Xp1u;KO;?h1YZ2_i&1{*LKLm0G+!;UIdS7U2q zF<83X+QHGrE!yMH)%s%4-QCK?!$H%U78r~Q9Xa8|g!G|Z-;3 z=MbzRfi1Kyv`vp$lK0uAZ9BveMHQMb@%#d& z;D%it3V4hjj3o<80UJn+_0&HafFmTetd@ZIr^2=K1kHou6q$Cxv@nV0b7M2Wn17@V zZi!37uXz9H<+m^s{ z%Qe&%mOFOO59{I9cFUE2jkd90UqutJ9(&F(T`JL>+zPmVmU_rdznXa}0Yw!S&m^0o zYf&pWLnk}vlNb%+YVgim(A^%lSxNC5H!?I0yr#p(`Efql9D1ihrL*t{%cnY!7Uy_f2f*dx(gzD5N3RFv)@?T7$EFbm>~XJ4fGD5;F1P6 zX)B~Q?Hoa{L^ZWm`o95~|C&TY+psl6e4Csf>Pvz?n=okk$mvDxfPARaIce0n-P;k8 zyUXT3rkRjr{e1bSD@A)*XX!CTfI^bFW@C}nLg@glo$W8Uj3juBxot)|WQX&IKs8iJ z;87{ugh%UYMTbQiFRJ%RV`{zMi8td%M@n$=T=BZ->g5}T$m1WtgmW(0T#2`%n4Y54 zo&%A1(;Nl`5rs07>cTDuDNCdk3Wg>ga2bN6Hz(tizB10TgiGoNFQ^QI%9^>E@MYaX zw&-{&NoTZ6os+booO=L`V=zmkJFIEfDdX|_l&3J+NytG;-Ii@^@SeW+WCGkNv6r%h z1)TJlY5};3j9~}hWL@=9o3^#bB}k$rz*@-Qk(6Y2?l#-kjKcD^Zl*nW51m5#jfJhy zkEW}lF#c7mNcgFH;alQ#Rsw!~$B$4feX8~;nOe)x$}wq3T<2qs+3dfoFX_b%dcivH z4LbU!FX`Mud(N5||7msfD=b0V?)s%NUk_--e5^!qDclY~(@35a=y(3l|67iI>-Ph? zHYQu0k|6Lf^7d~YD$nHm!7u+L8rOl7G3gr5(xWr$5^pZ;jJn16G=Z;8E! z8IDM$@q2(%!|#b}D>t8{_YgOkc=N^uQ6f}fkF59Gp5=rmF>H1yW%VQqBrv_xJMDya>f zo&RuSzb<o9`erC}oIhyyk| z4_ErTGx#1cRiFxddH=l~W_>F^X5KD`fk3mv4oB*Rr;mI6zEP*uZ!Tv38xr#IZJqZ* zoaGf+0+$>HC9-1({+q1D#nKT5@>569WMRg`H#7S2>T=liY7aQRU&VL)`FRNa_VvKj z2z(jN?YKNj0y3pZ`SHK3`nJ7$06x!szsld%58`S+!WJ%%U7Qy&c?B=k>EjmKN}1u* zx4^?C+aIrZ2#Mn)P1B!`+d9)@JCzDg#*dGidWG+5AAg45A^?7W4Bj1iKew{3q$D`x zcw`GrQO^vEwd|=eo3fJJV5SbXdo1~^b~_z^=Dqpdy3KdH7#iN&PXO+}*M*0FHQ!%w zAkyDklm=B8o96uXwW+`gtuU2FE<42&0Hxot+LXtKxP}#HK)_0B3C37Vj0lg)BVl$;wtNfj%nyb)|aO{LNnFJS(+~ zJ&Xgq@V|W;ab`X+&KP!O0^`Bl3DlhH7Jl)!gK2{2Iy%CP>mUE{W8N#REycZ1R8B6y*O^CEFmf}9%lIB{I zX6@A>R7B_r3qCM@fM&6#ZD=$$C$@Wl;}X?{K-=wrx>1}%u!hSJ0m|I$U#I5CJp@`# z;;1dL8&8fQch1b6_++V{^#)Fn=abAF z#|NwDB?c5}u*-R#9#o}NnN)KBsWz^u%8f-8b6TNvghCB%A<{GsF&jZs-v-;+z|Vvm ze)<|&fKv6w@VJNI0*X1(=bVVsRrLF!5tzx%sg=h?59wD@L(lQ3405xJt*h$Tr#;cj z{*n5IFVQnGW5Cu^Gb+*h3TI0GS}Js@+^#+&WZp zN$%ed(O*MMbfafx5V4r5UUpI)HZMzl>K-Zxq=Ld}0Aw9ZfUT?~(BX}fb|n*a*?D=x zCI_b>&NTtSD5hA@%aw=c)oA3t-0^kh1=uq|XO*%(@83Z5FQ1Kx(s59G^(eg;$D{o0 zTJ;K&shMHB7{N%D7(^b5uN49wx9np2C6YA`m4c&$gHLH_Y}JU76yjN8O4Y6LcL4u7 z2O$FCxL@i$pb0^sUT}RjKtrK>p7W-?Mz_8%l3v~vUNOcXqGdZ8p)0%#(Nfec{w^(1 zmi+0t85t;ew&6P#+14LshuroOZx3pS%8p{)8c8UU0L~OhK|l-PX%{4zOIGVJG6l8H zfQ&~0A6RHVGyATQInU$4=S6p^)uNPDKnW5 zI`2bzjSc8tW0_P}1si>m@f4snPM|AZ92-Cwo3Zxv{;MeEfUrD?u#&=^r`TrKpP>R@ z)XZy!POV}ivy7Dux>@{QOaUTpjM!z;j_ffF%?VwbUYkdED?ApP4%sOymyQXK=IyED zhrvMt=&U^<{Y8)YtfE8l)K1c^SDQB_9ltWFrkdOb+0S?0v%tOhD*S^UrQ2lc3~jMfSr7r&St{d%2u|02=N9n3yYB2zlh!h z8E&$)X!mka3eQ8rFrF?P0D_p(q+!V&v3)d|CAX+}F?He^PQ*$9aPY}cJ(FKED(;of z7?kgcp>jjBg}Khze{#MS0fM9-!zNuD43&TtEQin!*dmyWTqqJ3fI)V~ zlx-&n#9>#5ipZU?r>3ZLCDWV}Ai}MycPOQMgST@AKqIO)f^LApznK4sHC?ndXyJ^+~kPX1l zIJd|v2J$OClK&+o-#}7z=uo=@S%FKWd=sfDwoE<;GV=VR>UP?=(E%;N#hN5QUqs32 zW1UqL%z1Ck{e(C_Egii+rib_`#%v%_SL`j7WqK7FC8IY+-MxAAPJD%#Ec1;!ED}1P zv=X4}42Y#2A0SbsDNC6^0J6S?B;U!hug3*^Ds8lLFD{=sl~Zn|e>ji=yaiX1l-{{= zxgJ5AasK1MJNA|ym|#ku+C@WbxAE2^MHJWNeHm*OLC4sJrv69#O`#_I14;_jWoqA~ zfk~UN)FiheNlm0^yQu7m$vjA zSsrPr+}tL<{2LSB&{&x=GkTX>9N!l)mKLaKHB|!kEc~mkmXZg{!M@S-&y${AkGw-n ztnC6~g|q$l@(Mj$KtOch2?AAGejW-G65N%Y)wY~s+qBNKqPSfLi{2b(C#Fxxs*ceI zof=3=c4&OeL|)NlKxCdBQeMyk&ILWM`r-024FWg@kGkp}cuG;T@Ve?6pBt^RH#K9% zxc|VS@!xn6(8YIsNOc8dmz2L8H1dkF_CC?I?dd%UdUQ5d027z;nJr^a8ZBLU?-3Kc zVn#W|c+jY+X;~b){R+;*@KI%**?VyjCJYEzF`O3oMN|ue zQ`C^Q#z+bFBierp%9@))=qwHyc5T??b)RKTJ_2yzH+14F?>tA6)f68w4}b3P#FGNm z?ZuM7q{c^}0jAZ>;~ZP?{Y7kMswBVpmSI%aOy~*7DcUs>w;}7!U8Y=x3q zCaA##Q`_y1v>>1zyMX(z&*zn=#w&wasK$iCmniHcz#XnxSKm7drM0R-U&2_l>8DX0 z>h62LOH4W!KLLRYQ)$x9+1z=V_shG)lf}KCo4_ttuVFOFODQUpiy;1=Sw=*>L;Ws1 zeZ`uRK^1SzwMt@1$I&21s;jtjmVQX*m{BVs2{}!ePY1o(nOW+)SQkdWtFr#W^11Ds z%)Fd%fIzA7I)o>ajpB@=6(40&q>_u|tJjKAhs1|e*Ys9zH>jbtVLy2ZJxlo!t~0LQYabNLo4@=Yx&9g9{1p~V zpUWbAH0mUrNP(ajv-Lfu2-z<7&A!J~D%eJ&#FGM}qvpZ`JyFoB(*v6lbWY^&?743!|Ob_jhPQMao|66@QVq-fO(v zyD;Mnj6s)f9Js71Fk0-n?|sFV2*n17E&K!_=Y1U{m0A7}Q*C(ITwh$Yy%86dLCcNT za3Yfz1e3;y!|{!)PHTXa3Ti(v+97!b1cQVz2NjPPkp-uD2U`LIyE7_Mt-@zf@B$pe zG1U2Y-_fID>!1DiOR@FG;Xyu0f#r;d8(_9QxLW97^oc|sSI|3LwV{SutxO>+J4L(b z0={`Ys9BB@7fOhWlvPltx9P(AX1Ha)iLHP4kk`~8v+DshU6#RPNZ=E*-7&2I^Pl-e zoy-=#F#)Q~F8WsT(sar5N6XJ0ly%9nAgQWL#W~aHrvvD$8z*Y6!|H7)yXx9u=;QKp zuG|rzvtw7w+v1B196}+5ep6hI?boHeHpQ4yKOR_ObsWtWi)UlxuIm5u1oBf-1=Fvl z$VDf&1&}Y#(P>hk$iL(uPy+19wNyjcwPk0A>FI#b#f9>ll8W-btykuG8pBff8M^FJ zvm+po|LK{O7|m4rI6%DEGZP{!&Pb;H#u--wCD#`8PrzG-{oC4hxXFOZt-ZjTJ+%3_ z+Y=9B-)ThrEMQnT{^2*9|L@lO65jLfZLQP$Vx#-9*l9zQ)~+RI4i!L#JyCTU@Bijc z0h}O@d0OppAl1a62un^KXeQ&a&=KQyJoJFfAg1!%@xVO5^>yg==E6~=PTMdHO}d)| zy7&hd^BBor3n9I>*@dvF1qX~$7Vzhu?a@+~J z*xSsq_-CfY%^zJWt_=ud)7HK@5C%WMv?B3EU>~aUhgxrN5H{jl{vC)VehzyH3lvRs z($~<*Ya+Z&SGMi1&?%CCiI^j!(t<7xalr~j911HgP38=Y3O*Niv@0mG!gu>6bwd`` z07#c;sS6U-OE8v^lc%%bRkg!xw7TWlg8utMcNHYhK8ih!QW)@Cl0)0wb%Y)TZ~V3d z25}=nl!26&jC_SU*h<#6$f>pcb*Sn&#pYUZ#DC()5YqueuxGJzV^W<|A3GBpH{VW{ znA5ok&to1zF?AEQs?vVWs;H}_Za(laE5V48ufBR|1&jo_j%Ow}(^`Plu1v?P6#+le zP_15xp&J>$`yL=@$4}$CP?w+WlWgu;iUu0pP)IV8@rYcUvVdM@&jZ3E;biB9>!L^gpBz(+b9Z+Qcy;Qjn9J`Yv-o3{E0YBC@!>@4BdV`9QLnR>mQL_-j|~vHSHfHAvevpyxAFDi?8PIFgztxc1rIIt#?jAVb zfk37+HD8{pxM-}`j(ZL+94B_^%jsuJ7S8{Sl&{;@s zN*Oh@uA=x5kbDI-NR|NZHOA|6U4MX>`UNVBW0j^Nri$KbXQcB_E)7n?fI7{wN(T`T zaGf}qL8{FVXu&n@2G4}@?Fq%n45pom?npS9azJuXdxa~zl1NuguIqNrPm$xzv5yco z$VS|yr|Q(7Lb3F#srMXirxr`9-hXVI(!^Vg(cE-ypPhZcfJ;;llS5QLIw8kM%Za6a zI+}&$fD^NQ%Sh`AQ@0HrYYu_>D-sQEG-3-5Jg_fKUz9d&Qb)1(1rDye~51gsK3iTbc# zJkVdvd5Sq01Csc#)g57C-x(&a;zr`yd|faW_-pR5lD9@hLDFr0xj$WajTc7_6Fma8 zKcdJ^&7}Z1A{joV1;%2kO$pRu(2;du9h2d}XHKmUsXLNCWsf|;rl;Y+UB%$o(PK_& z@Pt@~oama$78&k}V(G59`2Kz?hgTKOg$xa~Yz;-K!VUs_Vgjz896c0_@Eo!t96sBc^|1hU@SapU?H}-l!mC!OZFczj=@P)e+~Ke3IE~T2SUWG5P>E_3>w?zEe8@ zWv7m8R&5)Oi7pJ16GD-F4g{LP!~WYeqi^dA16k<&c7aa51#GdP?_pm za02kC_9+#y=HqPdTpPg9=^rz}Z3_e(Sd2!#FKi`+H6?b~t=Rrr5n9=lBiT1qw z+&CT357^Pa_U*+4btT1mc>Y^wNfPMME>k&gAn%ROedk`Y(4b4E|Ja#$^qC;%?K!=2 zqCJ8(hzBu+`iu4qY&w}BpYwRkUlfcpQ|5UFE{TebH_iQRwfM%UJR8w2N!OPHIJV?g6}8?*$Gr|f-~b9 z=Kar(0n+m~H{U{KTIATysPQ`DmrenaqlIp=gQvQdl*=%aZw)xs`_{V>2Pum*PZE~J9c5qqL7C_ zR?*hKA(+*i3eRRP<$WDrc4gY0#jJIA<`RcHT>gcPV1Dq5X$>&41GEu)WK zC3Lb-=CqW7|8$(3ExYt$14IOzw0N+{(3{Y<-cBYcHCc)j1~8N@l3M)!t#8#_OCR(f zA#+PGNA&aoCyuU5Kz+N^;y-em<(#ojkxH}KF=p()nLgDI`5%{CX+eeVg|kOVhdyIS zfZSc7cKH31e$E}HM}IPJxfDd7!hMe8fFEe{3JDb)!5CT(8Ze8K_T?cwoBuXx)#8et z^DhJhb8~$7U#_ffFClXHc}C_k3B7kqy)yg>3syX5}n~wc9MV|Uh10wad>?Lh?=Qr;6;v=_eqEM1$8s(Z= zQ&+tF$Ca+?xA*db3Pi}a3jtcRqd&%}`5>ga=4Y$FTzJ$RAO*rVU>XM3 z7X1$Wn8xp=5U>U6d&w_%`n!lSnpS_6t@;Xgo8z5PYD7{NnH`lM>adINcEZ$#2cSO2 z_Cuf50gfR4m0+n=hC&d1CGK*Bjc=sW>;K%r)_`ipGzfWh_Yoop{Ba z7)HZ%bttc_=I<=)5X4&W3Xb7cBQwWWq|G^?$K6VgKi0P#Zqy-y`7X3YS#>7K()Jp4NC9HCw%6Usf9&kCbT9b)iEJ=R=_ke3pLYkheRAZ= zaoelNNlaP z&3=vB8VC+jmE=hOrz3O+(KYGbIcJZ+9wXZU9^jDsD*6DVWYK0C7;LOW07$wa#B&LB z+^P?ZjD|^MwBpYqBM^(qVY^5Yppn7BYTA<=!y=u#|MHi@|Mt0-FNG6yFW*~T35tS* zOKeP1y;_fp_zhiMDVI8j> zbOeo2aI$I(wNcD-dm&Vb_k5ua0&&|>C!X2*uJg~Cy;{8+BveMcy(VtiX?~(t5zv;` zNru$OQ9_LB*zk;yU8w3nbqeV>Wn$*mydxcI`3MS}`ZH*kjBK*rhB7B5j!2qAdcO3M zl=mP3E!*iF#xY}ugO>N(KaRxKT2R;#%VtFk`>wTiY$kaW2N|m>Zm=>D&@aI{*FaxJ z{F=06cJzpr+oQ*>fApNjJOUc~Vv*xyDX0q_AwyLkaxf(Tr^q8HChtE%5J{&a}At ziz*Y3MZ6P_G?k4i9vFJ0-fB)M_AaQ{rhf&Lan<-tY4ez=F=ZG_+-g)sj762(q(ns2 zuUX(}Vi+USgYopH@^M1EL&j*L%T!4V0f|v-HCV*ux(=9WWq*n*0jnQvSHg7%povfdq#D2Ay(Ka~ZdZ!wc(U(VCAA!IDu2?W0UN zVSa2-6C3nsean2^EWz+WA1;O%GAtOJ+$5>QsOS&k99iQ+Cnl*WhE3%Q;w+cbDaGy#pR*&(z@K7emtsCSDE09iR!N#HJw2@HACL*O@dC|*rudWj zY@=&Sw!5`I?X96*`bg8b?h-445!I!8z|11Vtm9wCJSN^YRxhJ z9M&=>tgK~j76i%Pn_9=`$}^?=olRlpk!mC}-DN_%!-_azyheo=Z|TOC0g%NwK}{_T zZd_8px6il3X_oBefA9KtaezI)oQjKAH4fdY)E`HC4Q~Vy~VA8PH+D*-iF{=Q+g09L=(TnZf?>lnFygk@d&TK+(gzi5XfU;MJu(-soOmxT_ z%H*W(!{b923v?ob=&yw?19_orefg1TmAfZ*q4h8K-f0WX6@WvgA(KV#M)vE@zUkf0 z;oj0G@c8FlYnI{WD{|WO$-#b8`N_MFTI580Xdwoa$fWkTbssM;Izli z?vW${RUz98hU2iq1Et^HUxDoCTFV7c<*qI3VM$H>5XaRWG-9@E7NOuBdOgBO zRu`o%tkUVp`%aKc`{6MoxGo=9m0F8mjdF_xntP6HpwfvixUQ6Qd zfXTJOx<{HS0l3P0@yl=Jxvx&eUDIOZbhSv!KA3mQ4~Cou_2A*c4sVE73I|XQQ~#!7 zCzaft2_-lw$acsb+&NgcCArdMU*X%YrqcvYQM8J1%m#V5a#8zy!a+MaC`y7|P8NK; zFf#!HfVhO>a`jDFCvhVyQ1WqhlNSp9L>dWLlbdKTfMu60>faRNg!U+Z1{0@S_Y18| z7Jg@HHKHx_T91qER~v>dwyDETNSDRt5AfQEM`RVgs^AI1`Y)5>-&s31pA$jZlw_JR zwoa;`tWXAFKS6ZwO=Jnr#5NJjS@@}oB(;Op0B5l?rUed*`SnmD17`46jCTDNEA#xS zn?n0qM1hC3R*HFT|5bBVT{X@zj*;kEu__nT$ImZzwQT+2X#V0IUWD1c z+=BsB>N0~1%Q1m-wt%zHgOqAsJ>pofx*qii_>)o7Wi;x(WStLVogdtWYfM$u^|uI| z9Mxc|ic7G_eC)906y%T9GmH6E6ZZ6n9!TXJJjz(Pp5Q?;_WdAl&_oA_YH*^7r!>kR zVVZVRoN$9|*3sZFc(ZClO+8VPDZ}B@h(Z9+Q1Fb9DYuvwp)F@m0#Jxlhh(Ore>y(O z^6bObv%@7n*x^KbS`NBefoHI+xl6Ii(gnYiW%b&}`go(+Z)*F%!o4m;ml$+Y*@ii6 zho;lCV4nQu^JD53ycJW&ZBwo(MeFce1K$+W;IJcIW3p+L8>~nuW6UE}^8ApDD1HV? zrbzW2GB7gk|02*es9x|G-Nm((7P3$vvZ!9@Xg!yVwO~@m93T^Nq3n7@G;x=0vVP3a zpM6}qfMisBthk-nqUHQB!1FoXq{!`g3%O31_*q)>K#HBdcx-gAp_GWe%PTxcOC;q* z`fq%70@l5S3zSYHAc4#aCAS93OwdW!lj}-WvI{xwMKdKYOv%?DwUcuc62 zVl583Om2X77V;I%4#?UD{3(VA=F~tNJA(h#V){b4`mOBP^|KdrIN ztzZVF_$eH1vPiNJo4>Cj*S5cl$GEbbk2Ijr+-+S)NRAHDa2>6h2$V`z=xdCrq*2IF zg8bDGlW(Y$Z>R_yZ6}ojD2_@o!k^2-1!yM&xU|}!`@m4&B8wnUyvOh)!-3ojV4AnB zWe~Kn)~z%py9t7%s<*Xl0b{yghvk(ql78uE#;i!0;oUYG{0sa|P>1uSSQ>BHKYy87 zhr=>019vr%tO4>nL53C!?=}?9aP_Q@-VG3CPWw8p^s(^p~6f!asJN{r|EID z-pK@ons8}Z)eM_j(}iw_{yJa->b)w+Y$CR@_oX^zEO4Uze9@ zFnq)5nGx*s!V)x<=17m%-=8sURrF5}QecpT+m(>@U1WoyyIqFis6gjhuojStQ!>s( z<4-km49kzSz8MV?a43dv4G^B9odZ{=Cb5d7G>_hii6L?EKzN01fe}$T>>hJF#*}zw z0w%=h%)dl1_*HFVZo<2*r98t>)LEZHRMO_Nk0m5|xiOA{wIx*@LNX-56;sq4eV?K7u&Zf9p@#hNJi%Jhh-_=pJ&On?vxNa#b*HH;j|Ly#>WbHo(N zWy%>)BJQ6|^T%2vU>_sztlzW0-c{mH&h_^F`Bs1b!u{~w9B^gj+WL8Ij`-ut&L?YX zOYhws$A>HH>-CbFXlfIodb88r^XuUL<9e<=CucytI;3E!z98>*bhIHcIp)A^%pzXP zT{Dtu^)FL>W~MCVu+-STaSNvak*P#=&Dh+NGQwBCU)s8W@5Sfyb}!$%t4X=~;>(Tq z-0m=7YZgE<49v!W_wo$_xG*$h{9z2~@Ao~)K@|9xJryjmlM!LDb)5q!g}UL9Ued{R z?#UMw&OI`o;Y))XM$Bg@PCAxg0+~Qm<|q98i~*8534^+1c6xriUKb$PN5fo!Co5ub z-eYAN*MeFxarIw+oIjkuudI#Uu!bVT^e2pZ@$(7513R8yQjotXaT8Q`7P*4~!}axC z#=MUksO#%RyyCPZhMJ$gMCZ}0bqb`t zvkdxA9?sRj1Pwm`!i(o3R@(3OP6kOmp9^w|nSN7kP4GK;aylgsh2Q|A5L}b5{NIjbt z3E=B$O@)6R{~a0kjNmot*`U2tAqP`yis)EdPL(qfKgGBC7X(1-(q{jwW@xkt-^Tb9 zrS+4v2gIoeoKPydEW^6u0B%54tDgb~e)Nir6X+Ub<)_EhUmiQ$ygiShy%L;Y*a>m8 z;;$?%n)RYt^M{bJ8sr3Nd1W8Zg}n{Yg}r@Xk{ir;1M!C5m5)=qX3? zUCITQFA&6O{+SsWzsOna3q3!C&JWdTGjiUG9+`LLoMfQc;mxuti z9AMY(YtHd@^8FX#dNT991=8ij?pUw37PlL|l|Or%mlb@U_8^524 z{UG|t+RI7C+?V{+mouDdPEOAwA35vU2l&N{$C2*{8vxPV5i&c3o!F!_2ithx+U>y( zTC}mvv$bbFpW}+|q=+=`ZekX`h)=S*0T|nq$f&t-sx3LypxjBS;&YvY87OD zdQmE^U4NK=>$ln@%*AbB+nc5k2@hnL$X4tOJ~D3Z{qq+yTN_U(LwuSN50(fP7YIuj z)}j5TZe{JVf@kcOiMOR{OeNt$`xeRtHIkawMQ4sQfUJI&k6-R{ZBMvS!7Qw#nETvq zYC;Sm@E7|^+?!dpD$@<#6dV8X1ACgK zq3V(m+(f;IP;;EAa$Vi%Ha3RQT@vwLq8C(D5w7)~{IB3b?%L_439Nu(f9J3Uf#84$ zYv09LbL2cI3m*tS6tV};Nr;`+5UtXjU^XI3ou<;W7O(vtLc zCX16QYM&!LumRXvide))&QOVmOEdTW-tc@vDgC$395QhH2#G>+4#C1)1b&`@difQR zX;p#dod?rW=D`eR%0>lP<>TIyqx~VsV!0XV~Jafh*i^ud=_KY>#vjl zi5k-T@Qw~Een8&M&{;_saoOSO*Nh6sXpZ4|HCzDtV( zA9zZV;_UnuH!l}$$lz~n#vB#_Te-u^oG5&Ubow1GMY}Md8fjky~4V86zn{|36Tnf z02A|5{SSg#71fes`My>%vBNvERXiTf{|Q5p>e|NKDgKU_l)w$Gum5>{|Ks3(%p$@N zUq$c7iJ<!$%6o9Smg|;l}F}etUgepYG{tl;{VQOwGhBvo?8d-G<-R zv6U#STzZo-BlawF798Y%uyU3fi#mlB>?xGVNL@%dmg3dNkI%TlajAN$hSP~fUzfGu z4Y-w&g}R?To#Cd5k%$S&Phf0t{#ge&pj|+T5@i zxLd-PYLq}^v{EVn(hZc7U7S@3CF+vYOYr~j_!CfRmqJBOC`I|Bvi>DgNY%8Nz#EZ* z8Krg+R*D>xhp-d^@oVf$_NRx!subZ%Ac}}(0#{bHN0n)3mX>n@)J-@M;o(XnO=6&QEH^}8p6n#os3Fa z%HqSM+`2h5Suz+Ue0cTV(A5cqWDuibFg|HXR2Ht5}_PC?k}1r&bF#0ChE(} zZ~n1uMNyd*jN*IZ%4c-53$SnP!E+%*23D>wx1 zA71>Uf!dvJdz$+eJVxEzSkgN!^!R}@9Yo%#S&SDwIU+}`CtDtRxOU8&~Iv5D1s^1q!qnx5w#I`7Ok%BSpwm z|9pCQK18UXWCIX;Qc-K)1-K;wdQqYkBWU^3)5`VLNzH=hRcj!R5iE?}>jFsQ7@h*% z26Rayqp#L$qQ;X<7%KDXSf+OF;lAdsi09=41da`%ItvOd#U-plWmo=YC#3l(Ka{tq zWw_wPK>2gU8jIdW>@Yz1T&mrkl-g`HD4~wjYe|>W&_Im*9c^1@Xb(>53Rzw(;0~3u za`eT^-crMNZWUOCmAU9V0lQgkAEh=(k6A_I$(kKA;td|IX2>l#(MC;zlD0kkZ=?vY zspYkZl0KpvEj9bjsaHdI5jGFatXaH)GPuL#RlX_Uazk=mWoMT6!*uJ z9#D>W5@$@!pud9F5{$gkDRY8x8B?prYmb+{C-F^#eBqO2exB^k%&UiTlCs*8}uCre$&t z13iU3NNq!*bKnsZ9UyP$^5*Kn-FX5l7OH%vUy?eY5LtieD4yko5136-zaY7SrK6FM z#_3)fpgw2c(7d1AsaG~&{|uTAp2`1ag$i1FSRdI5OTMEaJI>3&xVr$8rx`^xd=n(z z27%Nt;kL(kq?YO+VSsJw>z2d^kT*msnNV0+xPdhWt$UZJfeIq{HluFvE2b4H{of3I z@5JK1zN$MV6Zm_##zHtnBv;l{&436CRQG}vxHnBLp+6<_swBWuVHXvzr9zczM`{F! z3NWA5awgT|(8efuMxO_09g{JX!$`DUWKl^hyAvWK+cdBVf6$!*yc?Vy)O;M*vo;9` zsgckz?OY!SBBo#&uzB?zJL%Adzy}PC-!idgQ7LVeE>r*j8bX0p#QcZ%&qsUc;?@WZdE@D2+w{>NS1j+mp1@2 zR$W8YFqGdCdUlNfZ=IRQahH-WBflaa{r7v-I6Bu#m>+|0^kC%+RLgNikyr{XZsEO2DEvG10h6z6zFVINbW@D}Vid zoC>*egVdmt??``pYgX1qO3$J;3n+NX-J-TQa3_4b>hE85k_DHg4-5@D3?B9tMA)g< z0mGJx7aHgM!-DPL!qb9*NR!=TrIW%E0ikt^fmMwGVd}VN zHb2&SMUs~axJ)(F?(xOa$-@vT);HZgHn%;c%La3YQYU-K57-kl!?bvTILUWLqp(^H zAatqy1zPEqJ0?;47D>kloG*NAqp2H3$mD9Q+syFNXxU%S-{dgsQ+Z=9}A z4}lZ&K*B8j&vtyTU)ddma?ymayQACH0awslM04lE<1;7ssgc6Mk+7Pfp~__#C`f%Y zDwR|L#f0KOwrAUS4_>!LZ|5kp$>9_roZ55D@9Qm>q4MBx^RuWwlYZk+i}lNWuk}U- zi3am20l@b={jSrz)L|m$6b@``D&py}Uf_~$eK6Smvfv!xr@^99J-!!D7tU`zUBurK zx}LfC9XRsE1*0az-$r70fse}tCr(0V*7j>JFRq}dquurx6nnZU!r!3W^~5lL01(IL zNbKZ;?8^yM0oVyQC*?EuZr8gjcfDsbZzrQ;uiZGGtbKuu#RcOhjUpDdBHuLP7@!?x zalskx<7?5kuX`$FD{`yZo7oty=MiG+_ceJ#jZ4+SPh}n$6b|ij3Uf#y9KEA4b zvgNC*zIbuoo%laq4&^uryYb&0?|_%5*B8f2y<4_EZm2%3I32Ax-MAS1JovpuPPD~j z(ITSTYu3E;+#VVG=hmFOQSl*W0cWEYU;D(-v0omc-RY=)&})=}Io{dM)UqlJZgPoQ zA`@11Q^s%S$^ZnFj(o^!G%Y2`&-U%Ms#>IfG;91)FVCWVZY#g?XvO};P(f{xr1p-Pj>zv-%`F=l@rKLXh(i_(!>D375zew z1}OuULQIddW#}M3BY9KkI1s0fiwgXwFP~%;s5>l+oX{<|D0LIOXl&0U+R-8=7tQmN z;n~yf%wcX!FiC@pA=0ZkmVey^;&DMgC$BUO1IgB}##PFSg3SptKrSM{3S90y)Rj;l z=8Rgjd*Ypi_<`(Kj#J#rW^E%cQ`|SPT*#B;!T&+{GN_J^TY)wz516kA8%`NWW?AUU zXHZq~zVlBop}||vQMQIs=8OjF%7>UG+i26zVP3SZ?I)wXt~U#^)>IQFHMO$2?lb`g zhUT|JnuGeCJ2Mk`ODD3*%;_f=tHKyhUceo-k(se11r%K9i#ud~l!aU(#cHoOx<)WV zQ~^r5a$!j1k%p_mI&eLlzQR++ydmsCrzyM+Y_*l1_eT!bOmR^x0(LuGF!9ui{(#_r$UOrV8G9b>3*udrnUHxA zsHVHNUER?(q>7)26rz(~f@v z(sZ5I5iBzVQQ!4td<-IY;};3JR5!#JC^WRSu*-U542T=_)M#6&=;xs3@0u3rD-kbT zD(k{b#eW_)`2E$ewrcaE)Y6lCEMlz_J0(!zs1_PC_u zdrHcFlb-S}k^s`wRz`0klqjU+8f<#PUC>egNCAOcaT#ex!!dP)gE&k}Y$ul-S6VDI z+32O=tnb5Ps8na|{(K`jR#wF(iQC`B6jEq&tUXZ3a*3Y^WpGM>%dQ)_g`k z-6yJ9#~(HEnLWerOKDDg!^jQKj))mmgZ-m+eOdR`wHWA z(^Ax^AqUzM%hiQZw#0O=cxx!f;?X3@v4ZA?5p_$oi&ZskE011Ymlo#q6)S1p(p&>Jv*{ziidh`4SB_jK<+P|oguPp+KyN{C6TEZsr{b^#yQVeTyO5Qfs$&)?SVe@er zW98*}bGZMsob^i5LXK&O+s*1s4SD-i)XWhimCS9_|7)El=x?j1wy0TiX)?9Ql|V>j zl6*lLj;lH;aF^jZwo44^?P7YLld-c_R2~G18RYs>37yw^f3^D>OPVKmgUU>m27sIC zRyw1hHY64IY?_Aq3>)*zh%379VO}bj%Zf4K{Jv$5@Smg@ZfWBHo8C}ldUW3D2D_5U z1j>u12-#Dx)$8|&=|Uvdk-%J%(#lZ701^LGDmPgL^h{}GsOe-XKC`Ai>1&4qJ*2f~ z$!7?*x9jp>IMk#bhom6;&g8of_l!x-#z?>=9m-B_c0*BHXc)E@Rb(!KuM#l^0CtP$?2S zUSN9(3TPjx(j(js+d4QO?5nuEF9dIRKc7jII=I?ZqJ$zBz*_`CvFg4q@0hL`AW5^Q zYepSGohW<#ydw!g4b?g9>!?Ho08<O=0X~%33rcb5y4Gybe_$ErpaJ?eA6hSSA&!RLDh>-{`c~C?ojM(>jKlg{sen(TR#946}SFE*n&t#c6LW))y2PZ z+ftC|ocC*yyTd!pHQtOV?DE5h!S*CQLb;bc_*QJ~~=A^Hs$29xT|guvH>9ZoN(J0?9f`Wp$X zW>hQqPvs_ly+PKA-w`W-mse|E3%QbHJH2T2au+U+dEL(k$A`PK1-Avftqr%@)asr+ z$jnu;TQx=|7Hbr0C+y{!Y?P-qDlj_EQ^uZks%IBh)CbbD!T%H?-~r&aO}EqLf0EF* zt6*6D-v<`j@r-6xJ!A-KD!A1#SG`dZlqeF3|+)LK*wslJN0t>lPGRs2dqg5O3W zxg!i>*A9;M#iJxN&PFsI-xs%ILC2ND)PB&E^J^njWtp@Rxkq%vgbz6{OvNnVi@o>C zGPE5H_6m0)JOUVLX(IRFqbLVo%cNL&58Ek;yiY_;mjor` zSz0xYQZLWPR2`23e7dxvi|-nH&Dpa>NTE3p4n{*+(lpbw>QKT-3yTXWqy+x@o6aq*r6N zz%&fc1UexCadIj>Q?!=uh*)JAHH*=Q&TC3zRVg$YSSc~gxPZF7|2X7~FUJY~p(%M7 zumXox*`dB6_%4wyakk7%#Tz=*KSn7>Gd?k#6B59!2E!yI{2l>D4_M5BBjn~2l4RJV z>=aEj2X@7#w}V58>=gJE^P^q{mXCN>(pzDD+-`N&77)o@o0gwUT(_fMV z{$XYEzlkr0$lt{d@qJI=Uxn5MwxyZ%sxkHgXa_|zq?zvz435Wpr&9v*n4pdHk%qbm zBE7kAo)nP!j+>16&f(a74I(8ArDB@5lN{F&eza{&vZL5cyVy>$EBvaBiMjaNn*+{m zt&Z25aDY;?_Qjl&4M9Cu5ZULugmMEIO9-c#h6yTUn&%PHTzEv_xEJ!HvIFEBsfm;n zsi*6hJV%Xbv}-Ew=J)S?GwH2(sYivcwH?#eBy>ab6GfKof6ttD+}d9Dd2UBz=?xe1 zJ#A|ep4win%zfz-Z80X-F!{R>O#ymsowUH-J1k>_tIb{18^^16~U?OGL>?qGikx zkc>K*D#5ce6XJ5T{BzGHPk?uXc~k}6Uk?B_m*PnQv)nGapSBTV%pQr}6i=59jd@18>Qzq`AM=m+RPTAv~ zM~+vm>r*=Izx`bP>>NiF>6`+gxp3)8t@`_3!*IBnTWv6EwQUj2AG|gR$^#>p{357>@jqmocz`4RFSWM#6K*j1%IiV1ik{f zG2YqHdPQk>J%qEKj?qkVa{TU}ZKNd&9NLHp$T zGx!E-%A)#UR&@V0b7OB6Eo6spPjvhV+s%?FGRA1a3nisXyH0+tyYOh`Oc20_A7BLV zWEUT%0Y*ser&{HW1$gRTjEIKG_U&Lb@kw$f=E_00%WAM%kH#(^%7B$F%L9!52>de2jJ-(T zCbAWlppA9(%x}|KMKYYh%V3|BN5?9`%_u2d0rs^R-+ecHRqaHUDTlHDl2ztmk!(p3 z@kI)@NVDlekjhBufow?p%fMaPsV9p!>I6f+Yf7^olA-rU?G8rLUeShXZk-hS*f)+1 zN;`z+>Nm040(lekA=vukSaP~Zdq}BtohA!LlC@edx`XHi5o0-P#tqJSK(zIY(GkoY zD$wT|^o_7LDD@QE1Yr4=%bvWJzcYo(y$UjbGWldT{Qx`aA4EXlUu)`ryq;i*fz%aSmuh%n zWv~e*13><~zCn4-)&iqm$ML2t)iCrPaK-THaN+E7omb{-eBZEx2a-1uzGL$Xf?78UWF8k6k|y>w;9zV*2>2y9P@Scx$+ONhA4eH&i8I{(hw zPnxEvf9LIqCrt(Px}Sym$AFpp5pT&2VA20jf>c{s^6~VxO!~BTQ zeCm`zovC4I-y)$gMZs>St2M%^r_6n4C*9k`-4goCgq07!Q-FAC178vjDI1MR_kF=o z#3>o)>!li4@XB3u%vd!w6=O^2OS%gWhhug_Vauvy4`z}O2O^uTNWzXIHLA_8AN`KN z7Qq0d$kJa{EUt5AD>ngFrZ2o-TQ2ro<)<&?Dg8GWw3sA0Ni7vBzJvUOuk)9D+y)2yl#`7Wt!M! z48~=fFu4C9GTmh~sv}Rq>A?L{m#lv(k+G~({?U5ry+DNe3k)Q{6R=YOC!7OlG}R3n z`WUK`O)$-eyO(JX@!)8D%5`vzJ%+l)JcxI2yr1EHWy15qMC5$8VEjlFD)~baEEF0b z*t{PVB989G88DtYEL!slVa7h23U45-`*bSlyC)6uidx9i?;c@GtU=QU-#adfs>msL zZE5F(Gvv!u4a7G@(CN_>VW7Y?@;8K@VSs{97WdV9Q@N@k^;-vPGByfKx>nyss;D`I z{fr^EJ?d$FhWNrVsZQb;XNlS6so>XqGu!47gev0Yl1vu}gX@FDEZo;c@s0OlLD8xI zZSYx`>#|5$ckeNbg2weQ~>>BnOLemHC20)Z@X4qoSm0)f2~s=7<4 zVvKDlUgXA{DG6%4)C7V#*Om^eLX!Bv(DTYgy7OaO8H-?$vB}p+_+bK`t`JJULgF5k z4n`uk5oo_n9XXG0$Jt-rzX;M9L0^HOq2L>61QNMrKwcqBN9GC*%0CO#0)<9qIHIXc zy2Bt=o>V3pb3dDXTu2F~l^4M*&I_MY7_=zaWmUN$syld*PaMY`4J-qqENmv z)BlU#8BD~l=Fkr59PuxTBWxW;6SI3OB6DC#I8bgZDFK5V1+I;U4#EN9$8JTfVugnK z-2xj~>{{uM1WbX4vJ5quB~Ul75L_-4H-jK1iK=3guzrffjJ09Zx(h6o=tB`87v zgwVDL>b=qOPDFDP@6Obu$QqPiB2p13bt6dI_~B{BXWyDdexPyq7pQF%lST4xXe}+C zap3KNpts_P0(}l%gHEPCW2xQd+EN?(ygzj_2N%}4HPa}{6r}s+90O8!q`MviYS^V& zPB$(air@_%2cFc7_S-@IVi=}Ni!e-MoMdZ|Rn_b`MS+)jo}nfkYvv^rE1RSS11nle z5G7(G8De8Vzl$BKy|3&zzkmV3C-9d43;0zfK{am9oVew9hsDG?a?8X}8fn-mdwb8s z$_TWvlI>{T%6E)lTV2IyG1f4`$UQ35SNokoe!ep$Ez#a-*M(oWiBl7p{ZYq(W6=l` zc={RViVTKb6&<36HK!9B1pK*e zjceb8z^M(D$pAi?Orky(OLsTTFz(>llU4Wn)2>`AA<|(C6aTiBas|RgI|uwL9@zfuK?GXmW? z^IzrgZ=Y3ls*eyPvB$@vA>9tavGo#C3WZ@~eUI&ii>MB^Z1XJsBPCK8uL((TE~5cP zb8Y&S;zwMNM*eEZR-72fD3QN!1N^2PGBeam7ycE}D5(MCMAvff7=>=4OSe zjmTI6F)n+|YD`g_66P_bS70IASEpH$%d{O8OaIyitTcF%?}|iI4&?Ld;N~4y18J)w zPiv!oIKxWLK#|q*blg_<42%B-YY@-)XK{&{1mqZzc1F}J<%QBr!arApHZB6sods2( zxypqMBPdJN3ip_1fI!X#(|Q!%K193Ko$y?}Wm6TWSxj0|$?QtytTRQv$QOrvOj3SJ zro;<^#Ms+asteZgI)3Ee{lyU9qL5AP@#gjHbHTA)1zCLPnVNk#!SC4OU6>SAXW;P# zEv(I&azkZ<-i)QI1Im^{+N=0~B3z1WybdN%GnuK2JD#Naf2luvG3_c03!9VeLSpNQ zOC+xS4&Gn=x=oCDR&{cV5Hb3O31B|;9Q>jb11M(+qTACvZbX{yX!uelHJhds1DrCC zuqDQsG5Jq*4vA95bwjn|(vW+B%)GxYrM?oQWD4u|VWbDhWl|~H3!ex|U<@ZI_kdYX zzw7#EJD(0{F5~`4n^a_ozEs>0NYR*i)hW{0jRdp6<2u%^!w2&=!G|M4CLQ+368MkR z1dBTH%l;lc(FoCuKONxu7w_~iX_zcKjd0RQ&s}eXZY_}GOI!Zb5)$Q0YMyDmA^|oy z27M41>%<>ZJafu-C5zIC$ZjK?EDVe@++d|6M@1UpEKq((3aAyiGsl;`Yl3B z=5I);3y;xTdkm6nO7kn>SEjIL4o9Y#1WH;-22>F~f;9%_EiP$>8FOeFDlo`oJOYBf%p0QCMfe#=Fo%;Ataz=Sqdh>CR z!|y6U>|9_A&;jlZTCWNX!9T~&RhA`U!{Jze?1JHw|Nela^A+4V00S~YXN>NW9*fOJ z6#rgZx?6cRpY62L7XZ$5WqDm$akj6YK82qF(_e71N(Q(0+XK$j?H^tWeJ#9dh% z8S(ne66xkRaqsNB-0NS|XPgXgyjZUiH3B{Fl)k#Yrk%g9pyq4(lkLb$R1yFIkST48r6Y>U=&*n5fMg$<|%}~ z0+zt+&aB3%i6`}hy16Y5fa-hnEZ@BJjam!b0ZAXlg^=5T+KV`6oQ*;7MPEVzTVKc< z)^#=NL@)f7FfiJN_h9(3@^`_@%ke(IQB?=QqK|mHyM>Q4&2>I@Hx_)Kd z_va5-J*awpXreYpo1Xra+Qt>6IF=>1KTVZZIgv(Wrdy@|i(oB1c=xwYx=zZK4wSa1 z*iBFQk)neQL{!9eLtg$JDz}_62ns(vx<9RNNy@q3sRO4r*zvc3d z1Ju#qSwtpknH>sr??L4K_}xH^wj0v7mRO){m103N19ut6P zw);hZwBU6dNq$7h52YImV?9g%-{fu$+(b))ZVARrf%f`m_SC|zn$-teZh~M~AZO|O zUc>lmz)0LI9&=5*>gKEESYcHMRI0hVq<`BBZH_6IYire9pmXC@pfPeps(Vs%_qLSAsZ}U zS{X%qWO+k;pC>a>!QkP9ldj5sN1%vXx>Zpx282}eD7z@~vucDTOMFH8-+`p`-2J8AV5`JVM~KzyCV-Y`Y* zWN`G4LSKDHi~m%nx^i|28@V5NafW6Xy>_^fw{a8WW6#rmJ}Hp>WyS)G>GEa~0Ka^Y zXj#lV42ifSLXeO18v&p!A|%4ja9}YjwVaq@Hoxu5^z*p?v|uraH_ zz-%p5c*Z%Sp(qQ^2`)@J8p{>nT;gF2LM3cRO;zS0f0-dQ*|Dm16QBhwZ<*H$TK#Vv zY${t0ZK~Weo~E^0D{2GgBg|ndN;wN^uY+$QoLWdUmasaJLEt{<0VKS+V82V&n&9;# zFrGF%1eqvGgr`5KRK$o{^0vm!t1;(-|Dim^rF7&c`4H5_%Hu(KjCAO>tuZr^kPH=Z z$l-z&e3jX=Kw=Qn05A3e7YhE(RvS;t+ea56OxvNvW_sJxX(7o^J4P%Z>(HkQ8jM8M zVK%!d?DYrW=QwAEr?Lj3Tj?&5R_=+;>}@m$R61a4@AcQPZ2_z*K=9~%#aB<-V{)m4 z6>aIh2;E!@Ji-D*}mkUuG-=L+h07H9(MT=^_#Si;Vvcz{Z zU(oLTo9_jU-5_slMaX$kIMZ$N_mdtoNQ$?}8;I^9t>_bB-hC&voFe?yHIx0#{uinL zh&BH$GsDQXS|r{+Z-i7jOrR9QRY>$llJ789D^zN;|Amc2ucE6fIXF)k5od9XOeR3u zj>3Rfg0BN8r)A7i-{|+KcnNXQrfHP&$NkD=ytus7cMimg%oy3@I11_X^>@Ov+ zXEVnR=qi$VV28vmQb_{}qaORk`d>o*tzTu0Yj(}Tw^4h1grFUG&cvS{E1f#0yPor} z`*?6s7y8<+8}IM?ZRJ}QT;38f=6VDvU)a5{40doSfN33!X2DDyGu9OAdp+8enQ0vo zAOlqwcQW0mP}O&sQbB99={;ZalxqpZ#q>lIi7PY3ELfYS9KK5F8@h<6NMOd2&t1x{ zG+^;hoV++aQXxgeCEdzVvn|u5Mls2VK{b@x`_L_UIjY*S(cEKB1F((^p|DC2O8{*XG8Cqar#eCXDh|ak3x2=; zAB=))TREEwPG%E7e~&a;DH0; zGOf!v(NqgV!wVMMAh>9`ZGbzW+SN%GX(!tCp=Aq8JhWwHTf7tiKC75umiu4bRAr>; z9Jpte#`-`<784$1zuvSus{yP!AjDcoAD*)LTaQIaFm9>_vs7C?Yn^WgfMq@b0b;rK=9Ca+&s842uavVc{HU0ay$_HlWay2YcH;J{ zCyU2xQ#aO)BjL^SU{x=rWg}UBqp8fnes|=yBc!?R3m=^CCJUx@4)hKuZtkyusd(TQ z!dI0{x9$(DQ**{xz`f}QkW(M|t_XwA1rmtVMNP=t+Vpw(0(hjvf`3`dAig-tK%P4p z+>gDCh zE{E!}bgehmxMdJTe>aaHkj^YZYt1keS*pJ{E3)`b*C%?z zSUE`Fz;Sq|&LIJzNvsg%2Sf?W2lqvp=t0 zxKoh`C!qAACyQfmzEOoRihYG04U)bs{6Jqihy4|BVG=P2c3xi3#ZID_=uM>Jw~aGw zrgqoHsgvMM5N{5lr@LybQix6sG$!ti67S2jMzB z%O{WRQ5mRHD;@yA*C4y;!$ag|w~DN1oABMsjQzGf=dEeeBY`A`m8=3laS_G3eL zWxY@kB(SPwhP$+dhIF1uC7~A`KQ#;^>v`J-k%|*c>ofc3_!v#FxmYog^N@PR&||6I z=fRgj_eJiW^0466judh|U=o7tDGRB4nxTVI+JFHNNb7~y=Rw!;-gQSIfyH0_2G15h z`3VWK5zQXOqytMzIQsH;GC~x`oU7gx#ws&$Ps8eqrFX2OEn+jO2R1vl z0wMk%Tkja0+4FUQ#?Hjf#I|kQoY=Pc#I|kQwvEZewr$`1{%_qcw{F#5UAxZ5(_MY~ z?A~iF^2Da7W6D9?g~HK$fZned0Jd)rCVQzerTjC?t&QNPw37O5(3)p@2jU@xuZ|XY zQPW3q%Q{trn{n)6xtNME)LCrzV&VKSeWT9ALU$#S^F2#AcB4j7{kIkhZQhk=F&Gbh zrEQ@^Y`Cg_*iUzg-6er4GsdiDs+B-X5G-K39*jy=i8km?G;U5AebpD5B!FQT#>*;G ziMFSiG9H|0^EbC;6*o$?0F<8;YByD97H_H-Sg2?7P%Ga_HtVo#2;|+7O%?|f&^9ZF z@?TS4D|;B?l&XG;Bp#Sy7Y_K@tG6|7b#)SA<7b%a z4o`0LRRz`{H1ed*cFdvXbJCzL_wDwRnHf)zF2p$?fHkHT|79bZ-SMC^% zO^PpLXXq#_&aOPmUa#Xv@3!YU&ps%q3M3Sr}y1v@|L zB0`2Jke}OQ4^a2k+m4_r8my60hET{b(sC`~^bEwK@p-Y;xHL+LGs zcVX@JZdmDl^F99pYy-ITb491a+X7*7fPJABlQ$E9V>RBZ%N7$>7kG<}!`FQ_NwRqL zF3pJ7Q%A4O4dut=( zQ~fpRQCj`iv?rNU>nlLWQ=NY4kb?W%E*`_TX8+P51_8{{$;s<&bh49{pCP$$C)mFD zdUWvcyF0lz+0X0R4<-&idOG+Xxp#d`c0M9No)10_%)9UJ-dV%{M%Z;1`om6(u#4P~ zhefZST&&c|0A*n8)mbN+X0-<16+v+!zmgL)jZ(xah>r1m1us97Dh?U>c)vRy7&_QE z-1#^%VFu{!(bR9|r_~=?^>k>_T@{N_=FzE2!8jI=T!fNyJ-^*s9N%@DbeokGLW*m@ zgY5#uup_~`Xpen1HXd@sN1a{s*p*q7u>aeDYeHy%*R@_=*m4_mo4i+#yf2~Z!u;a; z;P8%xeK`bAac%PbMe_(fpC)x1a8f*k=XIonrU$r>C-Fwz z{yo5SKN(Hejv*SOuph17?2*#UPCxMF0XUqJ^cAdj!!7Mo|Ha_dnv=(VJ8!_aqAH(? zN!zG6tuEpjqrSIL5vAM4(~V_$Cw#B^mZjj~iddxzOGh@{TVU9vx@W}&T37jFZrQ&f z4+JPavG0(=wd=82aGZ=)j6%^)l(Mj+7ZSjsUL@8h$>}k?%}c^cg!>eKfa~qA>Lo$; z$mz}7_O5bL@WAJcW%mkqVz?%h>QD=zBG%0o*ny>R0(u78Lzt#oOTd+?Uy@_k&B_VU z5P~bsB_1P+s-qw%cuTrphU~Y#W7~IMaTtiJMVnC#5GpRg*~P4zW8dq(t=DjbdoH1K(NHGCy!cA_=!|KVBR{)6Zt&%H#H)$QwJrCuvGHS_b<#=dcHi}si& z2=i%x>xCaPe~n8=_5POa2>h43uLp(_wzSl3DVS{+?nc}u9+BDuKB48ds)+aSHAvJ% zZLb;BfRLB!B|!z+`;@M%BtVwxLjoxDBo4<gAAq(nWeNg z0x+Pn9m&pPV{o)wWD1^vc9-P%IGPesNHx=~trJ2tqOm%!v3dZj<_f%>W1f>+hSF|v zP1OAUn4)(7YiA*@1EVspTp%gl;}65I?Tw~1zV0BdCo0q|ZJy452HJGNJ^&zRK&Dvf z2MBpo>;3+YO);x{eBB*i4bjjj4KP&4!QRf>Pz1>oh+Ul)MYw1_vjH|Hnk#K7k~v6zhPlIJ+e|Fx9d@|CCQZp+rpi!_E_@;{FG8lqjWDDK!A9&2%tkJ&m? z7$jmW^&Fo0-|eBlMLquye{K1f^dS|J z^0UnO4*z%y$N_nHQ?EckqDbftdUMlhE0osnpH!h~lGI~*r7?BQl=6Tnpa`}hx#FUN z=T#`PRw<>+ax&r6%f+C$BcGW!MWmQZy?Wn+wo5mo*$CK=hDw#hqGrk zNebqv+kLsjh#uud3+B`PxV#;s@yFrNis8Y`x6|==@%{JTSHR`8(B*&&F@T2f0r(O4 zS?~fheK*b#uHuq%H*M?>$de~i{PCczXnaHB1m1i_#7(%es8x@(QogJ6zj`eck8Eow ziDTuNn-=W>s2x~U2dQW851C794EI$vcF@j+q~*em6LWIH5}^(r3_0-ioWDGw+_4DD zwclT+pTv%DAD9GpL#1YR9O$J|Y_fhhSkcVLdjZnq2vA|96yVSZ!`%62Zb zz_KkfL$>f4Ip4-w1TWLbe%9gYX*=+7N1xka_uQ$tjLqL$&&_!a&^N+>0QoS^dq z4);UH(2%?s_y8d|0R78Bm&0%ORFZh>yZ)QSi{35M?XvXB-iGU0Y`Yb6&SN>pjafGP zerCI+as1GEW9Dd8#je{TR$g3Bo^R1YjsQq=fN)KI9+?2LPOZ9w$J7a3Vfq?Z1uxH5 z1-lN>m=J6kc5!hK@Ghh|;a7*2KnSi$@-`~g5L(BwUQmuOZC8n(k0htt+S)-ty0H&}&QZ)WiM(K zGeybSh8bc$VvU9R>MASid=RQZUew1k=Gj+U$Re;H-E?tRn{IWLpcjRcS>5K z>Pgr;Mu>_oRP;5Y6oylb0ijG7_v-7#@YmDfZio$v+Zr+E85HDSH2OKl5b7%UB8-#; zj>0Ge(z#(5ptJHUSM_@Ub3L!Q*D2YYYSmTLSBp=i9=P~~>6xJrd0gIl{8c97h}4#N+N|NvsF(4kKpJa= z8bYc!MN80!v;`h%RrepVIU5rY9r8115*X4KL|M2*fFX9?c+?QmKH@Z{jbJ>W(=^Zc zG0(!!R3IY$f#6iXd#x=2hmC@lLwgeb;wllxotOQgSbVB`Zka&QRs!0sy0Wkpnv&hb zu5bYb^@dE1t=J4UxAIJQD=hu*Y#JpmyeU^s*6febD=PD!+k7YvoQZCmJka_@P}zT| zYO{6S03fu4Q6{%AGJfqcl+_(|jw}VQ7xB>D)%SVP*>5Y=^cO06Q~n?fz4<>3${%OY z=a(6R0krBXSA#dxtTL}y4a}aAwyP%tcIrU7o}&J%6C|9vgQS zQ2QgbXP9ixMv7dQtzjqY13qtAtP5+y%JRZO;iRp{p7O)cDD+Q@`Ag+>?^~QFWD4pl zU{~nPPocLujtZS#;V$*{GGl=D)a!Z426smLGj_u)o6^NJj^$oQG}TqEk>B-_Y*t zYnqk`YWK?zF%R&Y-Cg%!-{!`GqBPCfukm@9&y>fb#*kbfR!+mz{6{;K)^R3xhR)03U-q-e`sY#Lpp(HGGahCiS4E?bds=vboNE>(O4+jpni<`7vULFlwb8T64 zZXOL6j!suT3AftcE%uVrMs?fn4i;IFZh7 zXP&qL9-gi&ui~r-C5?fuYTnFV)3wtJN4quI{9V?gn>EvdMs7q&&BFT1BM~H=_Fbme z&l&G9h1V?dCAB5f#4g9EJ~1VUxy}6hOPX0r zX2q=q)wR0Jd>?%|z8GTUeB9oZe{6UxxR93u_}Qn=3$LbEd+_A9S?y-GvNw3mx7laK zH#4{8J4!XWR|$zEdU9yUH) z_4LAM79zxlR1sB@N`9~zVRU&B`|zCL{2Z0pxc6DTFxt3bb*&)FhegByX?q(fpk-4) z51&0H)^CTH<+$P``?M;0!*DG98Ua!})&=-TjT_Es2k;7$O5R!ol{9G6;BwZg>Qx3A z(x0MEZGxIW7Fx-@g(Y|CqbA5)>8d=CCriAr^UyB8z(Rs4Ucss15*@-{IHqqFfka#j zl+dVf>OeU%TP9%pQxIT#10dj=sbgpW&^sD%UYo>WQbim_K;=fCs_hOHyL~ba$5#wA zP>lSBb;|2Dxy{&C-N&q$#5A&s=?!qJn1aLPBDKsak#Gi12<6q@fJsUkmyvVB7uz*J z-2-3qmiR7~w0X-`cgf8mz1&Y$e&AbTHzH`ebT#+Ji-o@Z_UHa%`{jQb;Qvh}Uwkq$ zb8mdw;%;~Wk^{NiZ1OKPx_j+Ep#)Te>PHQJlMM1A1?*i6wDoBGwYyHgQdOL##ja0K z8-G!20{Z3p^fBzXK+45qZ8YV3F+!UjKYmL9f$d<6(8bMz8$B{IJa4d?9GSz<1AF@> z$ClrxR92Yg3_#xkhO(B)+==>V#R)IN~q{#|+f{L?q?a(~`nOaCEpR$e<2jkiV zd&iE_8V8%x0m9$or6DGQfev=g-h*lIQNgNtFxPqd%NS+G#^g5m6X$V%eec%_6uLWwe%QP5I(-pmvrn;!5wG>uafQ2`j$fuTdfjA789sSE5J zYn`ZMwo8*V;B$e9r)U4*UyJ#j^pQdVADrn$L1 zGT0qb$q|6s_D9PV)v3w9P}2fs(3GigUMxN$j2YMF1b9-1bl9EY zx08sAvk~`F3K}o+uFW_beW5t5rBCC2+#1C&V=$YY3y&V;l>RgujOb|jA3dT`R;nWc zSL7kjxLuxH;cU#cxC)d&9JO5=L*YOhoQAcCf<(Z^jZtFLS_FeGbO;0r$!>NM)_$@n zB}AOmQXq1Xaf`%|t=gb&!@`Qa7y_vUZ(U>7I_U!00#dLkjT){mfq>7dp+QAs?4BPzg#^ItYT;DYbt-EpJ4qb+T!3 zdA4Nq%tR0QxctO*2rxoNh&%=6-o{dO0!T z$jgh58hxL8xHXXaMe#}mQGdSO(P;cu>9B*4bL0Kfbf(VU> z7(JGLMtb+ikWkj}amb-JplOX=)5DaKbKjgS`I7h46^_xReiyHms@sQw`Hx$9J+t16 zS+U0Y$or7Z@nJZp3!)t(k-Qa}&N4Vf&`q8`P}-QAn>&+M_H5kiSTo2?z}ETZ)!@td z#Z3zFbu?d$0ch5-p{q$bZxi8GY%SUH!v5`I7oWyL=k56FN$L3V(WRQFW3liXXQ!JEn^3HEb{YI65yrG%RyC;hmly80Ioyh@O+jOpdD0O)j&oB z0qyh72pp9}J6;Ea0a~W*-;etI)YNDB^n4nYFTwAepI5~oMWqiLP_?+@c9){*>2tsk z3I6A_QG@zuoC8t-K-|%S%?V(IbUKt>RFMN>re!!(saKwjE~ALhOaU(oVokh(2!~O! zjFK)uUL_{yrB|@JjY6$&%jwh1I)}I>7kHwe`;F$CVYJn84&9mS{o=V-v&1erK{ah{ zIu0Zo3_c`0l4OadKbBSnT;&x#w!R9Bm*(^BV)CPuoz&qs`;MuUcWSik3S;+cP-mf@tjb5 zXOvL8WOA3xHz);Q`1hq>_SvssA$s@u%hd=YsH+PA=r2c2=C)A`8kwTs8j-S!QUngA zS;^rOTZ{=OwWC8|B6q*9UWi#?Z|RbyumYRltU@vwVB}QM%#$f|NuM}U*dkEYLl^-& z!Yke&y`mBhd;eXX*%XPQQ0)?Cx(hKkm=UES$73w>i(p96ml>Mt&{xR=vPInntE8IjZ4Oz-3p_$n3V(>A;wL}mWUcH0ujVyMf)t;I z9XC2HS~M?^OzJ-e1wy<&L=Ztl5Xf`s6tcNDY_c`p?!)uVPk&cJo}wZ6Y?bT$1qz8P z^8J4$JhEgRUAfeGSuKjzs(l?VP(W~Oj93`Q?+N=M1E40aP-Dy?F3(a&XBJGjz=M88 zH$JQ<+V3WHqqWUS%1_w%Qr->E+%R6{w@uCR^a@KFOt>czWzWGa%H`on-gy+oo=ZBftfC*o;!$ zM1Y`vGq4wKr1~_w7X2II66>p9lc5s6^*YQAR@@Y>56rFUdEb7p%V4+?1_y9ZCxjy% z<%2*#(k)tLm%k}l5T9KhWf%eRFC6of6SS@!<-Qfi^WB+No zQ*yd1#Em}PoxB)7{4|8$88GnLZIP{RPHMePfN?3N_Ao`JzMb^M%$AJe$NZ zZSW_PBBiIaE1+D}T6F0o3q29u5J{AJ9dElei&fMlScR7b!pnUjG zvMRtD^4SvC68ia%x4vgXIx=+nUy7-gf2+X_;JsPg)9SSFsgB4Lw`bzJ{(6h;#_Aqh@gbR`LRJ1FpFmGtMLxc489=h0KYy7Kq0yWe z56^<-;&06)mzNvsK`h%(H}n`uxFw`ckbdq%pt*;fVBu@64={6e`cJ#*N4d!no^6{| zr?6PsMiE&NB=6xifq0LapyzD*^$&j0j4>#*t*YSJxr~r%oS*2Mq(j7z{e&w;kYhy* z)c`_${>Y}04y1|&b>7~<3TUbq5yk}~ZZ4*hq%nbN4MH8-QznvuLwHIj68Kz=0^g+V zzxAuu!c1#Dz@Nk9KsauLZ9lqN^Jxo;Cqkj>I)5^vcn!Qupk^ygw~AO z%54xg3mxHP2G7#3k%U4M>J2)BJ`Fml7?iGq?30%(|lB@Jiyr$OA{y7>o zqfwjc!oG2v>OLR>j=}3`Tw>YAZo2{Ii7(;o+h zNdYR}0FRIRcK)RRWY_1qQ8h! zPQ=ee^cPM&9c-t%R*Cdz8y3C>xypL>r8#CLfCu}@lsF2)dBfF&%O65#i?x;kp!~@y zdq=o_g1TkUNfiu!`xf`+mp8VY)*Sr{%TzrdD_?bz>+|2k#ntQ%)GifJp$7y-geY@d{utUwcXmqp~xnqqHLb#CTYs6D}O&eu;$BGUFa=e zNJ&zU_vZ4=<6)B4T%9j`Z4lv*|Jz+%E_6KP|F^rQqVwqDKno^-*uWRs<9f7m@#sQ; z06uf?$8R1kthsP>b-L4ETmSQ>4BqWL9bO+F_6_(h4cwg_j2(P_XZgN!bYxjCT{84{ z4JRF-2T4WFhTdKI6;cZ9)r;+$)|2yVc7R>{`q%8wQF`q3S^j1gntxsV!hGfC@TRr* zn;12g4t1tRP9A|TLIC<*cqR|+bIi>M;5a#d!exrtlba()ubYjJCmZk*z|h5!<=@!Y zcV7#5V|d?Pys&43W&zxId$NH>AI~v26=hF2m4$FjOY-IB{z2D+F;qIs_cYD>fG z&X{@%#hA@Os3pfYg^lU_r-%E+11xOTIKF!EcThzS{8U%2mM(@Y^l=sJGG_L z9WK7`JV>v8J?pkD_r?2hcvgx5xJ_Nyoj!e-R(O4J2Z28(=FG6?lBw>Z9SL0{vunh~ z$H&7Xr3@V%JRF|4clC@3?p>c8>h#j2g0nr&n7cMPi$tN;RGIZ#G!!ya9x+SSTJq&Q z75@|ts-(aC?2jRfYb{*}E(~v$u%K1%jCF-xhb7uB)1jKH8E-LHhiRe)TxPiPLa}t9 zgV8(*_;QzR^ksxbRH4TME%%Ff-+Lb0$|RA^H*R33MewTP^D9&vE<~3-2K!ggJ$0g& zb@jD#E2ws0m33KbfmgIZNms}8?S-q`!1{^#i3^Ach!e#6`H*yNE<7usiOoL1ZZj{1 zfxT(;q$25|7LPJDuzA}8Wc3eaI$svpkTfv%77zUYiQN_`#i&iBhCjnf!hT?))u2Y+ zn4)eXq3I(^df;sJ_Ysr)aU6a{1_&X~RYA5v=V#BktsK=;yUZcMf z3+X9|Q+^XvqF4KN6{|`wg(3S`odr{sVPx3!RkbgJZ_T8n5m-I|f*HLu&<{wabJ6RY zTY$lF1h=-r#GPTay#p=H5Bm8$icdGB-Adcp*FM>NWD^O#!VF}1>LWQ|?T zcr>Vnyc5aAh=y)Jm!i2`jv-mNUmbr>{FbBp@&HlP!xe6w7Su%m1>4Oi$V=S?*F|l8 z5Ye^JNma}<{hy;xJN!=}no*!v8&-oj0htsn6x1>GC?jwI!U3iUKFY8WOV8WIHTscj z>~Z-yf246MdYfzuehm73-R6h{>suqQHdNC-wGs3=U;Phm?@&Mt*L zp&1PW@1<4#vcVwESm8HeN#s2^fJLngl59<yvv;e`lp4bKBtv~yZ5)9+y5n|77LRba|& z0;;G3NbW;bfQ{+ffGoFWWf0`|Ov{%2jpC$83RBe&n=0YYCwnvJMzkR!&7>~xFS)Qz z5Dexj^rOOK3a~2(tHxkZPq;)C3->>R14grfn8G$%1P)<*r2_S)T;T*MI;=2*Tf|tW z1fy)s2E_@bj7A9gn`Ui-DUf{Td4m@14pD3Y01!m6fNRkiwg>G?`K_`zWdqSqT1K$I zd)es*8xZMY=mZ-?aFq7Xi@hB@8O9irxt8xPaL^9i=}TIf3)UtbN^vLE}cVsqT=V#)bu_I6FJ2jPmh1(ct*FuZ}Neyc~eWCh+H2vu_*x+LTlP)!g-`<^99Xdv;qc!1kBx*O&9P&2#?e;m0fN^Sb2wk?~i_w6`1TyiG>adfec~YmhX?{UfS?B>s#=wjO^Sj+^s%v#xRrd zc_dsbFta1oj^(8Ur6#;5H z0a!d$fU$cqi$5anSTG?0Hp>=n1myy2K8Nmb|5qq?&0I|6J>pBU>W4uCM@|>#=}bid zXK7O?;GRw)Rx?|?fdB~LCoZ+8t=&`>1ijPVTE-RpJ1+f|^~~AKoqV zqFk~jVV;}WvZ5!cm2{oh!cp}%MRm=GtbhU0fxwyIFRSEPP98E0cfA;*{(xmQGPhv| zyvp8{0BK)z0(O}_?ST+7PcOXk-(L)*{j(ENEym^`HQuEcv`E3C+BP@z1i_#cO-guF zB}D;B{;rBta4yV%he>lU`iY|{pqqHn#!aaW9Tq#s$Fzd6bn}T(`vUWr3^98U!g-%4 zgCVs`wL>jnmT+|-S!1xgWP(gT^d+EZ$d^6f9u9aBys&(c)O-<)wVGe#krq8wgO{9A z#gIy&PPbm~4T(F*z_zf3rx+Oep+FzMP7FZ^*Y;?K^GALIb~rL@jU(4GOdH-CFGxZ& z#s^skE@zMzsYh`&3q~#)ZG+1LI%rl@PlK~bPi?I~yc@iqpBD}rStTwmKmBo8t|~dd z*>baSXFJ9VSRH&0<%#;Hcih4W5KXMv!4|y(eku9tPRThN>2Nm>ICOC zf;XG$glhf)ygW-^Vy7)YBTPm$?I=MFwbUEJ&a z+fO@x&)C_9-d zL7CT#akLat9he#!$=>+n7l6}--Jnl|S-x3lV8^e5sxSVhZPkX?U4D|nZ-eLXE8E2^623jF;Hpa+#?y5#oUdT zxiz!DNOY^=pu%KSxPjonw@0{_*0+O+86-6`(#8ulGqw@L*>zZgu#5Ni!OFz_8GC*YhJ=Lra3yHW=t(??c7{2XksO1mdmON4Jc$%9he@ih>#Q&0kFTrnlH*( zgLBVRFgS7B!?y@#Z>4T%lAjP~B_7szgnqqhKa`O$+>xob^X#gWb`*7@h;xUc(Pw$A z0~t}>$i$^HEYGJSM%Xvq-_LG#0`#IfN{^5Cx14*U$VUsu^9QBf{&ipIy3F2ytKquX zi4T4$;I1QUL5 zf&d&aogYYK!YBfoWIy-Xwx%1%7(th!_D)3z=-_?1&PyxJM=lXb3?qg9HJMKvW z0ogL9_|y+kgd*NDWk0VRxP;JwvG2Bj)&2@Shv?s%;OEfCW;n%AwelBA&KR1ImsRNB zdccYsRz4m9CQJ&^BA~%B#=;AShl?6>@XT5u0z}ECJQDW?Yajt>Tv}v${*F8c1eWSoAQQA#}3OK6khk(tpkmH1%M4V=f9{W&E&~dG*nIT+^ezL8++}0lLFi;Jv=d==CI1B4vzSIK`)3UHqf98GndC?v zox<6u1RFn;yw#pqr|Cs~fqC#01F~c3-sf-mVeWjczHF@I@c*w2l5Oy3F@w1 z5|9H91wKz@Rq;`ycA!;7HN{D&DTb*f&RSL^4FUG6a8Z%w8nz4ET!!*tkK4xS9Hup5 zFO9C#`T&5qHsyr8a(4|>XoF2I7s1k$UHW{`V>>Gw<#-4bIcIKeQ}ZtV0Q57CA#2D((>*gvTB#JAV1bcS7refoKfwGIv4Aut|C+ zx%-QrU-6|>A~e{F@8(0bIk#MtF&zP)p0EzWHXJGLkuQyQh5GP|1O2j70djJC-{9B3Rc5Y-~^L3T3 z9mG0}X^R;*_hNIF_hQ-q{pp4dYerpGQbnC@2<-}?B96R+QR|RG>k9fnXp&lP(!OEw z?%qkhbm~yO9oS>iu~6$xI!>4>=0sB2>;ZJ31<2QDx#*vQ36UIFwkxW1U!+b(#)8}| zHyr=w^{u+V2Re>3#~$2(LQ7ilJZo4Bvjb^CPLPE{rr%0Qzl}z=9=q zz7$|>Pz0j8`-}QCk<`Px^Ud*cjB=w(x;?-jt!H!yi|uqGZ8^C*#Z`fH9)@qhi49Pv z5f@&AE85%hWSIh{{D~9o43q~%e4ru`OPjwkDRTs=%xD;jjX-J{J@U2*2q~~iBPxZ( zS@=nX=SuL2%ZCR;S-b2BiSi_jX2%O^D*bR1Bg?UYogP?jMjLQ$3q+hzPEpajz-;Ve#H~W@{|u4b#~5j@gxgn@ zX3o?v=txpkp%jYnr0E=+4$G??Yf#O8Sq2oj^8f7*o}1>Kz#d@qi4GlV0=TABD@7YB zYW0}$ZE%Ap(3J`#cop>pz^)Z%)Cw)bH?JCmt~AiBOSs^aZfTg&xxZ}rPEoU|G21|p zUiQqRO8xa7Wtn!9X@*owzJ)?0<#i&hcKc zSB4ak^|OguOe7hUt4`IR130YVwyqDqJzhp`yXHp6if>LXV9+Dr8FtoZj!lJf$(8Rx5^(Crbd=g+SDcmC^R(?d^7p_w;tCp_6Zt8M2rC;su z!ep-8C>CXH`9r7VQNbx;A}x-0vNwD#_wcsdqwFsA*PGp!7ZwS=uQ^;ZPe%Ut!;9X;RRlBYUr)mZv{-p7HLV+kz5_7M8=H!ObnYq@jCs(WqVrga|qrf&`{X|Ll3HQ0^{qiA%FZR zO@RhCI-;B)0eoh1_$kGK=DPUqfHBNV0!CXp+>K%aLsOmdu)ZqBi}VqN2H__8TC7|9 zJEwcBHOt6bIQR!rk#`!gU?k zp~y{W)Ti)^9#;2}5FVL^wdp&RN=FlKs>{8g!HFssfSiyPy8As%fyo;YD$Ly%rhY;; z2@NJHWrV`5@PVM#fs9)4rb0F>*0%+)-!L*11NvQaB)x0;%Xc&w{BK>S?Va{G6+pI zr7>{}pgCo8W2l(ql0kL&7y7tXGb|_beMlrB?!}(x81$Uh_=gSTD8JBnO+^3!(LwNf zeB_^Kc*H)*)~2D~99sS@N29PaYU{%Tytb>*uO0~I&npe}x2>>F#3=I-qO_fg=j)ZL z4+qw&SXBlKhl_6XfS2csmpwx!tz@rZpk&A=F%Nk*!^fiJ&Y1zV_54puQ%Dv?!*=pn zp#uvF>O-PC!hfF?DG}u4#p;^ zp?n0UKQQ}&`4239VEF^9A6Wmurj?Jt7VSP2m>z^IHP6xt9KiX@_qrByNB8Mhm{X=5-Y-6>nU(Ow>P&|vi}?^dCz6DMvDly;(D;&8e^m?hTnQL;J&*@QdNp0S#qj11g|#ho$-wgr?p zFtP>}-4PNJZNS(Z$IK(;7UErS(#Rn}unhdFHEcT0KrT~_%~+^{gl(8|Harm|3|D3( zff1EFcm#*K1RT0>I>=w8sYll3xR(O-l2Q^AZ4f)TWH8|wQCyhlQYsSBIKiBvpKq;@hmrp$i;*8$!y!B&LAY=-HO2^WWCmCV-oNb<||=8qi0U%(L*~xhm{w zS)}OqyYMsZW#cW-OR4=U{xT+D5&@!RjRx)7nu=)+{=Oz`m`H`F34%=O9{o5)8VSYF zhSb8ALKPk0mIcX7j2F=NOQmp3`e3GtOc;cm?C}-GX?z2S!9&V5mILaBVZ+jOCyYmi zk8v4kWq>a9zD%QdIQq!Sf_?v&vzT~n#pQ2?YSc5U$z}x!i&5@E0rESY7+Fp0F{-{f81iCtDIH78D7Z78VWTmqV~OAtXRt;RXsPY<=Xzn&6!YEl-(I;`&t>;&AE`Dk`18K<_k@WVLpsM zZ@1b3_^;Q@%*+-%-jD9gYjU5+&3aic5f)Y**tzS%IG*Z0&EB2f_x&sJb=~$~fu$Lc z0Fz+*Sm(P=S#Uf+l?Fir2JcnIs0fwllWk=^yGm$(cXZF6_uYjh2=<^II#^ym-ymjF)j*( z}3SB3`)13uh6|C5Eb`K2C zclSn5=e&+vL#1D%P9{$;RvQ8(WtkFW_jeoRWb)aY3i5ZKKMxjVY3};YQ<`@AuI-tE zc2b++&V`f0SzR;71EmI@W7BV5B7rKBm&C!FW~k=&W?lF4U;7a4Ql^jX?$?(E*PI99 z5zl@60)v7AWC<0~8nI92l(gTCk(-U*>i>DKO8b22z(*$7o8kwH3PEk|(fBh8r|--a z9M`)}SEIS7&*sEys%wtU+u)tnEd%dpD6erC@1lam3XG>@p zuJ*7gefdrr*0;q-BZvZw-NDvZ7+d+*&7Dd)*6AW8%nh3UzLR9mdpdwNsbvPUK7;Me^OotD(4>x zav5YdA5fijoD((IYOlWdH3WjWGQtjrGj5yFyj_&`Xfyy-iS0 zyj5$y&wW`?w35CZqH|l!=mABFyi;VVD_iBWd@cv5-E7epMEjP?$lXGx>H8WmA@GO! zRKJ>raVxxkt^z%4+*M{=sxrUO87YNS-jWOWcJJNaB8b^ZV=rLNKld}DI!gu>@$DeN6v6G^_$H8sug;6D| zoKAhbwMuT?ll#04>@!W8@3)+G!?mETD?ao8p2msRoaQ7Q?>{)I44a7L@(3P0q&-aE zE@w|Z73o)FDioRKYF}g}pPn_kUvT@E&yjmj(eG0Sd8M#7rlwqT)5p{O-zmmjHBn_2 zg%TA~)Jh_a!%Te6avUwOMxXj$@>(y5%eU1DIB`(S3hUAIJA55;n3t46G4xTB0XtiRDQajiR4Um*|3*KLG|`dEb8nI|iH!nmxjzk7Lq$eHxZz@3H%vXruh?I~OI ze2cCDTg=mVx^zT*xpnJ_N^hp3jPoa=FP z1+XGm)$_>PxUIG*PoiF8KB>D|_Ay95Nr84V zLZkYqRGJ3@Dzwkb!*-G0j^q6(s^#}H<3gUA^vHoa$+7Rv ztWlzVQh#kp3ov)@*JYzo8`aUB*>+3M10Fu%{v6sEg!HMk;Iy|qcd99>@{)8@`(`Ty zymZi5%Ln=Muju8kB-#2qxqlcjj-Og(DXwn*foduIHmxYQcD-%jRRYNGH~3#Y*+W9I zpc4Ljt7xV`K9pRMAnp5@JTjvP-1sHMnLVoP8L7n3q9Gp$`csSk0y4qvhxJ4d6=MLz zL{mTV@a+qRftp@YjpIm$m!`PrgE~aeFPPl(WOfPl`Il*(VJYmdW65MM@DpKKnN8w7 zA6qWWAj3tuqB~eU!{*n(7C33|dy*ukGAAO2debMqwxWVG*BfSk^Znh-8RINZPEdN_ zEOB_YV9c#D&csoz1i5YRCg%Yz4a|yHmx~}9!@QBCriSR5o~xtA-Zb?8dVpUJhFb;|q{!yf4o=T3h1 zgsAjS3hAM$kyUs^JkB&Gn#5IMG$vWezZaD_WKa*<`6t@e77F5=|6>mQ0 zjOE*o?>duG2VxH! zAf5+nqHQN`tUE*%Ivv0A^6aIWj(@11CV={J9;mSkRyNGDgD&Lk|ca85{J;*hiEAN)hCO~$Vr}|HCaif)y4a+`d8nB!h2vRmr@gZa!NA$MObo1i9{^e*Zc zEyDIVnUqsfE1S3`Rf|(nDH~cpV0}kYI~#%=Fiy+m{0cc;cInr?MUPgrEx;bpBaeyW z;G(Svq|4APJx%x68GL&tUY=D>NgXqAdnuo%{p%Sa3vMNz+ zB+J~)UpAyrkA>dq2F=AYNUMEM5Xy5jSN4ZABj#cT%T}WFh*6Ko`s>?`IjTpzfpHwTJ;_xBX5#bYF@I|u>Jf^+0n-G-gVi9=!=8M!2I{ zLpOl4watGi?AElJ#K7}@FOT&f3@OQ++Y7aNAwNfZpj6IgXCv z->IQ)qSMkbZv0_@OqD6nlQq)O>2cnd$<{z!ERCnIaQSEGk#CE0a+gNs>AZaBe0NesC{nLymQzwqr;b#Wzmo59uT$8AeyJo%Hmao(|DBDITW+kO z#Q?25kKbQt)xBx@QCgdt&e;giXZf>#TQ!B=0PU4}q{E;>>_0In!^>f;PlKQuTLAi`PDrG7E zlDfKtAqiGm`3z)#HtyRz0LC+T)j*c(3w<6-k7#z?RF((Pq=oskLS&) zO^+-lj+J5Pl)c9tXRT?qZ1}fb(YRAfC=c~NQDtR#6X>QXE3KX=nR2S5$c7VXl|fFC z=jTx)HvojM45l)vkD^b4PZ5-}60-rX-RKnOYYw zLSw~Mx+KW;6%P=^-&#c8D7cWcc!;Pydp}R9x1RFNnEhp?y;Xs2Q~e1BdfixsMUboS zvzz>XGMMO}5a?z@XsD6sUvg@tm>=u9e6lQB3rJzr?b4-wZX?JHtn_=$e=@i<>v6?j z$b7{u%@zZQ;ONjn5@2D{bM~uC z#4%VA=~JFVE4!$?3-4Qr5u$+n{PbgelsxM7iE0jVJW$S|ajGGrqEn+ntrN+F4AIUt z^+)AEDf<(W<6sAVern;(4LlvAF?iO8Jp)WTTz$tmry`1kJ9kPeb$JUFcKnXg#pZsm zDiJ{tRIO6T?kGhfY3t$$qNZ>Wq|4*~30fK>oRPSwpDuY+OEr=a85DDPCmyPU40-%| za_dWY0CN3TXB07ZI-c(y1yW}0ZZhhTj;Rkv4{fq$Vp1UG@QtWZI7{UxM))Kn61Oe$ zo~j|ZTQn2BRScy_>e0<@?^K~_x!hmDt;0e-L#fcNHF+p2)CrTvYCF0!sILd+AMkpkKdi3@tw~w3X5c}wLB}yKSi1@_ z)o*b!Koe&uIl1L!NnC)wSp9s5VNjN29S}PyWm`{LF|;Z&#P@BR6v=C}zhPjIWHE;{ z$?I-6WTUY4x9%)bHN-t>`PLtVY*05$exA+Jf8tj9p?_ zn6tRl!gc;JN-H2`@Wlu5rJMBc6*3>lOLr!IUEAU6rIl`)c2j&Qrj%G)`#{Dwbq6dh zALz;FOAFg61{x!Iu7@3uA+26YW%vB6m6%jw6~~r!fO?~)fNWZR)~ppY=LC|LSM_4^ zxBBTS+%em_!{?SH(e96M?k+{aw}d7NA66bsbo8NjCu2 z6DJ92HkQl1)bC+AS~?E&G(Zvi1G|a6EGhmRs2(B z$K(7P0St@#;Y$Xx%d?|{8Av2*s-5CXaC$~pnrCa24E5XtqeHoT!_C(^MaTba+Pc-0 z<+G%O#zAwLtw&LbrZL4|D({qj_W`CqR9c>psti}^7gs~;x(`_h-i3CViA%2S*atHC zjKP16Td$T}n(syZ3i~~{J@_%XoNtXUYjgP|y?a%pkE`QfeHv?5*Vi)OKb(bGKC@b9 z2Y;;h2h>+yg=sW*9Za}hgv#sD1?_Q77HXYsbD7p?1#NOoe$+Z!=Q8cn3R>fu9MwAe z!)1!o3R>ct{HJw><1#%3Mv!ZpG|T&ftY*H4`~;712XX}i;YYxz$Q0qcM34m-o^k{) z6}bbPGx<1lB~7}*H0}@T*I2;i%IF@+pH%pLb#OV1+zR{`26-G&2_t1yq0Tsdz24w+wb?wsJ(87vNUin**FmSO-AZ422Rh6xqi|OY^B8&q zM^Fa!#jwxdlVhmG!YwgOGX#Pdy2fz75wJ`*+X(a{f^rS&kKkA%gxFD$h1=usXzXYo zXAjRlT}zKgKk}rUAxyI)c@)VcLdp($=-E)iLOJu1=|xspl`mITa+NR54I$({Cs8M4 zLiZwTYNmDWI^B7J>{&CDqkCvDp-=FMIWo}-KLL~ zBM|Aye=3jKv7)cMV&?Q$EBBKeIJK!NE<)`JgaiE0b-fech-@B+a|M9{giA4g4x52_W*c`q+75AHziEefqcP?vTfvWVLvWL9?g@e!gTH>RH_ z$D;^75%MQkfdJ47wjlf|I&g<5fcwOIM_`8m_ZugTYsCfPguC~<@dCgBw*#mHL<5Ke z_yTAJBC^7{c91(HJDNNEJ1#rSJB$H>0c-(sC--(xSQacxcP=)!+Y)QpJ&m=EY>sr= zkwOI!2Ji$h1V{!@nt@S}Hz4;Nn>vyS>^b&4oG=7b6-i!4d_^BZ6+(2u7VtAJ{prQa z%uaF(_`PS4O$@{*LKZ{n6Ujb8x)mWmLiztwZUEgh@J4Lx5?4VXXs|5~6o%!%N5iS` zBM?MHD5yP*RT-^L1ua65#X@zc2p17}>i8NkrgvzgWP%#BPcry^w{bGG9zoF$4TN#f zg5;R>@ekn2#3PPWPH;*EBM^Jwvs%1KxOf?OvYT9wbR90&Ld-1X`+sK<0nZ32D#}}M z=8-#h{=z9=J;sw`PlX=nsZ)%g-ogUmlxSMCq8|P$#C;;sg6l8~h8$(8L52{)477nB z!5{)!hA)#SlkBk4P)u$V{+~DotrruI<*Kxs9x{i2e?j7&^EuR^9E6A6j4#o%2lqBcRSB^oBdXJ=?*Gr>#zKU%J7Cjl-(0p` zf)8FnGwIjpNP+LeSEB5a#Ny|@y#^ng!z7 zyC9#!Xrx85gaz-)WIYj_RA?lcp8wl~4QBA58hSQ?cloUF%fEp;bR*sLYj&gwnD74_ zKl5X<1aaevkQVaSU;QFbMnR;w5xj)<5r?DCD1Gp2!A9_b`I^Y|^&668S47(jE7I7; z5yzvZn99FYBhSI#=&kIq{|GJl+3=M>t@K|&w}fB|crOI)e&J~f#%Et1KrF}?=&9W8 zY3)X#P=;SV;o1PX9s1;(5Q*`tC}|(ASALIaqkdXV||meDUNnud%SH3dSx9zr+poM{QO-^F!|6$`SHxt znG#AH7_dc~jty)9ddtRc6(EmuJltzO^w3>K+&hb&+`T8>@q9Qq-L!4$*Bc$S$s^KD zW`JC@VY^5_wZm(GYVeBB8}NB{A70_H3Agib?$c>Jmrk`FW$O7v`luZ{8pn;Hv2^X6 z?5ZHgE#H*10o|r!_!SublA(HK`hsg5wPfKRp2)Bk01(FD@E``cmFZ&AwdkRN1F3xJab1lPO_Kg<|}PPh#;u&mGeEn zKR3%hUJ8ulQ-tS!=wE8C4!RVeLzCc)*S)XH_?5xF?j$5Zw&17l#$z~u~PNran>*mcfp8)N{h>{??pT6KhY>g%z> zg>fyL588bM64Y%yLg+&Tu_K!ioiDX5^(E}4@(iaIA^C`6_(?M!J2!uz6iZm8-+H@(Xp6qSz{7mzWQYUh`(Q zOHBI0Plmq$`^8%D+<;?gxznS=)l zUBQF57x-?yDM8=eC-trb@#xl~jrQXNjVWk!^|!?sFu(aE@=J1UT{0`IpxFVhDPJKz zoMsqR(iZFJZ_}bCb*T4gb9J=7)}ARFYa*CRqc}!Ux~}=0lYBP$CfW1VqT{_yqnb5| zyr@^6rQ$38s|#;z2!nhWh;>;&ocRv3e6RD1e*cefzxe=OmQkrOWR>|`IV!Wy5|HvC z{$*(y@>Ni2ng4o*OmG)Rz~xY2u>vpDXAx-GxEG2HQY8yCux&-Mp)7%Oflud+!y@08 zH;Ir7*-b}7D{r0BfSq3qo*6RvkmGOLtsn2_0Tv-TzmyVve3q3)gJlL*6J9cW1Pnha zf{}_ii$I~$<_GeHjmpGe~R6Db{|rC)@@oOR9amqob`jlVTC9m8opg$E>qQW5E= zsE$K@H-NvuwV#-2Ip zkAwhCN|rNUOOVb&;E0oF6z!VlDTA-N09xr=JAy~AyKM6+`n#Op_+&*jtZ-Zj&^-is z(^9?3KE1x+6TCh1viG94^HE`q@4s$hn|%Ci)Q{evwSb63o^F6sJokWi1nBmByFPnr zL`kfxcW{?P8A2x8T}MMEs{wt#GJob?9d6HK=AVk^xrbk@BeHt;+XbOV8T*TT%oy=R zK5j|_*!=4Hoo31ge(TNE;R_CFQ?Nun?59TIsc<$@1*E0px%O`Cf}yJx&q}ttDa}RC z`Kq?7D1sl2;^Fl*KsjD{TxXKhc=tT(rn&6KOk9{M8lgRTi2NfwdB|6`%?-dcKrzIc z`LJ&q4W}N_m9&RCQy`$|agCT$)S^Lgi(iB~kM+uREA-Dta8Lfh>+7tFbfp%WvmTAE z)9X>$^xh_#3t1*`@5*()M;Sag$%?1nH^Pdi%)cjk5g%2o^NzMA|0~{enVcmSXBckK z_rA-O!Xg5bEZvQcj1VP_|7#*dgdeGn^SEN*;U@y$=qsK&YGx!LQ5gNFNZ$SHd5!87 zd@tDRZ3007uJFgncm@a=^*S`}sdE#+N_Y3%it;NRITrroB5GcOQ&=xvp2sKw63*U_ zkNShb;{Dt%Z^TcJxUWZ40cbIG=pOFzHUfS@+=>U?LkRYnAP zj^fRokw<^S{J^_%(X*!+u{ArmPM5%T8LY^Fu2mKgy~)yS+is*M`UxgWlziSDIH8do zR=i7kPh=TC#4b6L$w{M2jm#2Tt5Ae8V9-k|KVZ)$SfbyF;W7FnpN(&5hxZT^`^j`a z`OZ7(JswHNaB$qaghyF5>AjB+vlgs8Y39 zA6olxX$}LryANOC{Q#vTItbQ@85Z~ZrW5I{6BQ@wt@A=YS=u#CZ4&hYKZsDpiJqIh z;c6sL%oX3geMI`4SkH+}wx{k+y3F8v>>H0t7z1XEdVo-PM>u@_Lm*j}Ex+<6CC5ftn<5@opm3K9OzW&L5(b#FMw9)YYgcd9^j~ zcMA8$&2cA^hsL|6ffGBOXS^AUsr)96M27&WmK4L^?f;-Y(`g}lXgFlj? zo$vHp?a@kVOCZTa&oy-(uQ5E^OY!mE!aJ-oiZySUM80qoJ^l_M4e`!h|CX}<9%tOi z6XSOVu_X<$eWwUmw+QULZ}W1+5pXJk2*I85E+Zjewo<1e?-4}pc(d>)Eczri&~`s? zdm!*RoRRcmkKFhrR417z6)v+Qb8t9Zp$Qng06?e?G6#6)deeD)2;UUJ-v0qxP*MgX zT#n#O_6T3?GD3iP@ryBJ>5(pa&%?WdOV^Fj{GR0LXbU|@L}zXVl5GYgiGV!A^QEWV zmos+8Kg3C(TAUDk5BQ%ExZxjSd)Id;))JME42GknCbOaW-KXqK6$lX_}fMT-q#U=)(&oYpXJ)! z#cLpkTAu3t*x`WA1|DMS(%lsrU12xNZnJ4@wo?#RWyJ+=k!zo-{E!S6-?SkwgGdV8 zJ+h~uIi_;2om0GjWhs4krVYw0_)bi@m0RaiXr={-bJKp7ePUDGvR}KrJ;pcKtU0DM zc&%a5={B1=|L3L-c63zm1+lm8bsa0-nJpJeF06K5@hq%H+zO7WQ7)IWn%=ir(YzL= zEfak2?9rpB`nKtXg;uZ(vF9_7DMjv4qgS564Hv|QD__m~ALzlVR77y3tk_}B&dC}8 zKLO(jEJJHeg&3pIdQ`v?2#baMfPs}Q`WJ(nEC4fzk&3bi&ad8>JQ)T*yundWU?$i% z#kuGF9e6*T(={@Y@RI0k()QJigqluyVPr z>*V}bhPOGnT043YPF_}*9H;(g9X(lBpvzm;G?HTKT24J?`D~tpb`GDM{;ahCFp0G3 z&&p%Y{fBxS6dT7#+%3)2QSm+Wq`@nbO=HAU0?${Rqc<_VJ@V%)(X+V3=+F!5XzRR6 zKGLK((_e%^0uMvSiZ2$)rF#P zp|eZ8n#b?GIb;DcKU^e#^mOj${A3v|+c897@nDoB#goJB_=lguC(f&T#?bzcNmb_y z^yWElS>J4_Sv-EDc3Woa&PrIkN~RcZ%!l)5Z5(|$c^~@!3|E45k7)$i_lh+H^tlgF} z*_T7*m_=}Xi-z9~uNm}eYyLx7@Os#}VBYOZOBR*mX@T|MCQG%L;VQ$7()*DI|CjkxmDt~1F%7!HN2F2v3k$&Xe=*kKF0Eg>gm z6Fmm_vG}O>u&+g(7f!~Bct2pQpCa*rSr1ExYb^7Kf0ppyQpybP$zY0;88XgzlAoHX$!V%skAZku<66A4 zaXH?kz{f@6Xi0d23PUD;I|YE1kARpFD4J)GCi=@Bg|a=t5i%bcO9a~*zCWDuS@W7H zfolSQ49dU(U`+`#Su}rOHO>Nx1Qt^-0IBh$B(pqdV>kTcg{xotW_m9Vd@Oi&X=@}! zT!L-UKEvI|2W2; z*zY2ofQhIvyW6%BzC?v@`41aIw>Y8`_4)gy!EKw(D2snP_vjYq6IJiVLPY6hPc`Up z%ZW60vlJ7XnBNqyHy@(|;zIu@RNSA~#4YQ{sN>T5AlSk!%&-m^UY`FbF0?n*M5%+# zYI?VmEsJYZ!%yTn&#(hWk`XFH5gjCZYV@P9=(i3R@B3do@8)hEx}?K*xTYvu)@%sb zaUm@Bs}S&8S_njRXJe&pc zNyJ^o*OE+uYc}l`zq7?%8WfU2Ekt?a_W(geEpqT6Z9DaY^|faior7qzwdo?VR6Wh zkZwMIYE}Vm!o8NZE-=oxL5>K31-J#e{#AOsFem}T-iSi`jXeLZW@0==GKFZGi+Bqdf>GNWD z1besDO9b4=@^&SpO1W|t;%LXbmi`~?#uHfl`u|QIj3~qQ1Z~TiZypsO ze}7aYx=VV}ri4}deOzf)8xhjnEE*H4+02BbPgP5< zqU6hio_&}mWBzt(OR1|v1AjM5;W?d$x`-v&abZ~S)AwK~_S1K1=J2tw@+?^|920uI zc?7_zJ$HkeO(xp!U)sT`@W^`QAQc#kR|%#;+S9sa0xav4t0K3j!eUWcWm@JkM;im zm~$`n0Bfzb!g!{fd?uAh8JEq>5~U)#_VeYDDL?$KE)`aUk~7e=KN9vvFYb7JBPjVx zq&mCu9xRn`;h`7E`{8?fjvtu8?4@qjq{&Y*?BTBtaLI%*57n2t8FW)W_gy1gamjtI zI-%G2D3yaH)OD&@wAx!yC$o^V=ylOYFSYu@mEH)%2?rQKnG1;*9=6ikioav639K84 ze8Qf-M{9QRO#!f$U11$tmVe4)c@riHzMxZ;NBdy-(#G#I| zE9~-Dg$fQEzSiV`2sRx4ojJbj-K%$gF(b(;*|++lvhnCnJ`)5^PQMC!w4Zf(mM+T+JIzANI2 zeh-^Uy>CV02!H5lVc;H%^vXQw;1lGE#Me6e&O*x_aaYSGv}KDf*i+fsun0^CxQUkCf+KItzaG#@7s5i(jJ~fGs8Xq@N;K3-Pyuiwm|yUlu(q)aoUR4xBDgfv#{UekD((PQ1-xzI zIn(^r)A2UIK|uJdA)aH_1R=Xdke|6*ux-3Wv4-d04O)92A19u16dpF>nzK+oh$4?f z44w3n(ylu&efkNw+YE8+p5{+RdKowf@7TSj{t;sS8geYSzyG=7KIBPwCuV*5k%2TQ zApb(*IO^>ODtA)R=8I|^d9D6;(1aV*VkPNXtra%ZKJ(+2-~FF(T1q`NHx)de8BNey z!yo+HnSoQa;zi(F?$JNHpH&MgPoZ8lR0?0euDA<+G@}XL^*e+lmBZL@<0h}ILwox& zdMgDlrhC3uTO~W0&NA_T9;jy31MLY2i<&~STZ$J}Nd$$pLS5q&ezp0OIblBSRoK)- z7z}NMDQm4Y7`q21DCoyVSu)2`w0@{Dw+VhrQX$xNS=(epT4NcubdMI;G90BKZ>dGp zZ2a_8kdMSUU2tsLrS9Uoqn1_1-F}vS!mV)0gaw-?m_D@*ZLYGr+P8qv1jfs`kRE>U zL{<`tMIuD-J>7<&bVO5Dw$g-Y&@qGDYIrEvSyE8J{%>HE6*rlE8aXl?T zL>2C(LIvzUi-NcaE*1;+g3XXf3^l3(_5_hc5FKr#BJw4S_--U^GR0yw?(Ogo0s{nd z3*LdFI<=N50^AQ}GO62_uTFv9_;4PRyV(er`^F)p`x_!IrBKx-fY!!@BTVfxfRoLS zsG9#=Fa;+d&Bz)1>M%Vdou^7}(S;ODOkA(^jR)CD7eBk+L>JwtZZyxJO(r|NF~KNO zF^ISg8%x>aatK+t#J!VKI^!)siDOtJki#&{KtnMcWN5?)1>nwYp?pz|+smI?V`LAlCB~pYqgF;7_P48 zEBhZjP<@T#s!Xm0<%gag%5vJni94Y6>N_(**>onWm9#XIqF!=&-LR&p#EthRzkIX- zjhby^;=Mat@x)Sf-BZ!s-nvB3jn5`0Rei=#;>mmP96BLZ-aZh!kj$b? zPqnGVf%00Hm+v(BfXm{-lwLaH1` zH8Z<^PD0t3`1YMgffzPT+A{g&EUqxwByVJFr7)re)YG)qOsH#uh z9j+jGU0q_XFY_3J ziE4T?=WoCZ>%8cSP2#Gn7M~6-EW1E?7yPo2OX8-D+I9QvZ_Uw5zfAS_9!3FcP= z_z5gOcNu@O%EvbZv6=qxGG0$G`)wPdW|@+2lTjJ?=;4x*Hrewk)7*x71_Q2%^ULPL zapBQajvYcUj0!&-Wk&@Lss49ZTEU8UquK2+E3rPh70bl{1fSfGZLIHm&{%WhEx$+2-rx#Rxs0Qts1Ma1Fg6=f{p}Kb-wEtDQGP_I~1+r(BE{h~hz~<(f4! zxmRzL@K5o|xG$b?U%7FcZNxZz;?{95i9nGhKd+WGu%lspQXXcCNvka>u3N$5ezvMsL$M`jO{uqBJOg zow;Xy8pfv#e0P5-cWA%RnjbS;%b&P=jskuu2XCGcZ$(3pa%AuKVU~A(+|plF+4V(PUx8-%AcnRaRv7h@O!AkUM0ECT6Tiz+beaM6Q2&Za2A6N`{> z_1HG)2=b&6L(`8u-UQ%`zW^%Y9_csYvT0bz?*_5P^iEx0oDTW|fgcP$mgjMV#v_iK zwVNY9K`pME!or5X2+yi}k3W+z87TyhOriF*qLu7u6BFG-#rK{f(Dza^pmerI91JJ0vhP6cYVy4#T0Ja4+@!L}iT z+zOIv&a9*RdiGQ~ z7Mb0zO;yT6isAK_%9}a!3_@0Iw5|uTKm2nQlV-`Gqbto@SCb`QV&Jnp5t9Zy>81t? z3(G4nMh)$)Yl8!p*UFrQt%wBz3ay?>qS zP(sHknkgBww{^A>rCNIz4#X@c2^ETenxLa**u0REy#tq&JjV)oGYg)`$=(5LN}gt= zJoYDkxXc%$qxROi17=&kQgW~7z>_T-3kT191~t&8H(jGzz2R;9gE_mOm0gFDJ7~*% z@~VZzDDcJ8TOsC)sVh14H699jd^$+fM(@CEN{ayCqzK3MeGD7iF7-0Mf?6z*7Xmm}bL>Di^sfO#?8$huzT& z8oPf4J#M&V)zrg@P}4&ZFNlid8Xb!>h(|Kn^Ujx`IA$YC70E^L8+Y8_7oEEPksFv4 zE1~}SxhY9!@%UNzAM)o@{SBRJl*Z^%mVl2yq5qLT7?O00d6rv7OdArwGvg#(Ks_io ztA@_w5QH(6J495H%Kh!c+1#}yo!u`2Zg;V8f{p2*fUTyshnJ0BLuc~i?^xfsH-^)1 zoG&Wy^=0o143Yaa*bi*rtTro|9*twUvVeGVZVqf?Mun zmh-x(w|E!R*scWqjkb`0*V)HUl+sXBxcL_)^*?;XRHaC{tG1KQD+I2$e$Yym_e6Uw zg&)Q|awdOLHIRk!mJl&7w}S07U)`%U>3=MK`c*k?csI8uZ)=~6v1gD%Y=}U zoPi`L5IzQYW;eS0EGtDf9)+>S67a$39;5L$x=yXewIE+-77Uz=4k<&dfNc(7qi5R} z>i_f3%J(;2F`!I}11GMZ#ALpLhaYzBEnLV&W5{SNuQy(#-vbu|K7Pwu2Qv7hap9N_Jk8e{ymuryu(TAIYM%0Rm1TWewrkF>U&kW9-d{x8!1~WjB$hZWtht zL}vtI(VkIY;`F5p<^Pwg>Hir!2bd=JOD73rItw>vfxuJVYkm5lnS{Y_Ed^%dq;7R*|B%6JcaBJ8`6FAU8WTCrnabZ z?&MUq7!^>7ZOjC5KF0;lkGn`UuK4b)tD)WoDyD+tZBqL5RR7T8#+g^Dyk1WLVRz^! zt~sETiCb>CVn7P1oCRN2KYC9`e%c+&I1m3L-fnRZl-=+`+x0WZc_R4Y{I4W{ICR+Ar#=eCQrvc-~GTf<}3UwT8h5oU`j z@+s{6lQMSAYSDpkEgt&Gi5(~MlnE+l@|X!=U1t{Qod60g9G+s;JOx1zaFY1nShXc% z9O$*FYn}<;syUoP%19Xc4y=vLz?#8ce|aTck-873?{5q*XxDTtOV24! zZE(YVeao6=%Ef?Y#fBISs7UM_*p{dBRi@?y^S6E_xLV~%cMPgPExTYJ8xAyK1_>_J zjDy&$mVW$WX9r%j(@xBc4nhKGp9MUh{6(qj>=SI1NsUkDIzqMuV&NtdW_c(BXITRS z&iysWC3?3pH3pGI{^X+7gazM*xK`xfF5L@09ZE_9rA9SUX@!da8(jJ|f)7{UJ>%dO zcq@JcCCgBa(Y|-^e7`g-Fo4d5+?&OP(WkG ztlfVtcxSS{fLtO}$GFb@cfk^olQqGUxZ=aCJK$SFYLIjb)fOi*OVye`o-FPAwNoTO z;?6%sBBG^rrC@=#zwaAX3N8Vdo#4}myDY4z?6HrH6G&j+fET?UPi)2BGd(C1TpF)m z(H^yN{vZ}*DFilk^IV*sdR6jhl-1dsH72rfVJD0!CR5AJ^UA!!lt4_4`IeCB6mDO_ zNDrC~>Q&J-SN-~jnI+_JtR}U$xnbe$h5E^llWTZ&@lS?+wZrJ$QKG!p#FYsRAf8Ul$%Hm?jje94STR5PAN5$Hg(jXy7cSv_h9U7#hTe=&iJ0zsJNJy8!mF|Xj@b{1Jd+)8qnsaCN zo;~|;&)u{0j5y%DvRK{qFsE#$7_TvOa4e`c;yq&%*zwRL$0MMRu??4YP)Sz%D`vez z{Wo|PuZK@|e@M4}UVuIa(zWftmFw@*XTxg59O$M$UNxeI*fQ=ZmGWVyw6S&eA~z*7 z2S#U*ZX=k(N3~k8EH>n16xGg=3$QBAjSIOxiP-)YMiv3I^Qw6n2$-)qO>jk!)DN&Y zMdZNA6LEgv90;+q&LXa{<4kchPScb~lg!t8lO~y<9f@jDBSXs$t&ND~bzx8>6VK{p ztSl19E-6{ErwBhqj|_IR*zFI6 zXxzr)j6wS~K7Q`crb1fNIC5e|ul*r0C4q8hU7`L$XB$E3Ea$3Mp3`(kG za-kFMuXCpSnx4BlRbv+BB7 z4z#!+GGBV*3JW5U(;~Uh-u!Zalud^rrp2nhQAq&Uv=%HY+r}-rQs|Qu^tg%gIFb>jPv9lR zTg0-mHv~0PRm8l@6^5$~V^c7FB<>7W4n)EeZ`ZBXU{>%x+5Z|s`QcqlR3I7$MxmcZ zM2TvJBhL0Wu7^&qVC_Tr&M3r}9JW2qw+(bKacd9ct1b+JYs642pkrG$xOEPK3nDD= z|82xW5VaquJ3|c4Su6a>P$#HktkFVU{SZ(Y9mLbAzRw-*n5zrGXZONG$vLQC@FPBc zG9UJMZBC=9MYqr&e+m|g=r$OQ<(1}s61Rpw`Pg)7#pp1OWCt(I-)PxG<(W8b zfgB0d#D?I@yI}$GM8pHvb>=aZ zE{@I|kb@K?eO7GyVgdtfsV>aU48&Ug6u?AIxp1I-bVAQ1!}R zj^03$D(r>f+vzkd4x`F)nhGJTea_HQdR?Au%l8!G*TNhcTGeu?)^+Bix&|BX^?ThB zu2{rdY}coF_5Z(($)sC$)7(-OYu+z6T(aKDy*Ie_mG@L7ui(LY4nOvJPrce%sR-NJ z*+P~2SZkpl0I2Y26YtbdxTO~^j&jWCW}zQL=)>!4f?m(_*GB!fc{T5vjY5#NqlM$H zi=%7#&Y~p>Z+`n*l;}Ur%*fgEv(!EM&Xk64Q^Rg4Lr?E**T?J6d&|a5_DUl~=NGdV zb?v<>oGj|2T<6n}8vAwk*$7V&fYV>oM!+eO}?M|IQ!fx4H}K|Ca3R_I{TcjQVw$g6`)8_Y}hfWtU7L0Lyr$D%)gqK(GQY9 z>=K{c3qiE+0g7H1Jd@A%qf;C&({j!8--JdX4@agG8C6o<%UD}TEXu?H2q`#xtP~#e zw?z+?OqPB>oF`L`ctP_x@NY#M&Ed17p*IytI9w1kMr1S4<_&o6e0M>t)Op-V0h&&byYz8$xs^%s}}?O?=3QPG#f zKtlJe^y3Bi*Y%%^TJ;SB6V77=85k&z1l5)=yzrjlVvQ!Wt7e`*{+6(?{imD^)v!}) ztv%QEgI_-BMt24LxAabuZTLZ+Ks1Le`>YuV{Br!SMZ!1QvAWK@ag=>Y8Zi#N{ZiA* zc^tUZQ1tGKZTp4dufW<=&8>>Mk?$6vg6=1A5dy>U(4XAjb-S7g%XJ{%68SrAMwrpy zs@}hP>6{St(??-`vUNlj&Q{|UA-7wusK38eDHmFGUQMMMn+PMJl6+C#1NqwxwhY|uUjl+)xgw(5p6yrv;_P1fB z)Xdzug&fErIcPcc2)bMa7;Ey2X5MbhJ(tWUj6xVUqqVP^DReQ&3oEemt$tcN_N2c@ z`6ctD0{-)gNhxYCm?&Ss^&v#dA*8OLht`d3Fihbpmo}$ zhV6UB=qn;$n)sSEOOe%ikH1lsQogg5R!5|tjcx|zlX<6JX0aeylZRa5-&mYoAkjGb zB^rO}-y#XqJkgHv<}WKm4;(lv^1Ap`c&Hv+B9V`Y38#VZ98W_0FivMJE_)WoFYG7) zU-pNDnN)Jbb#YtY$GSIgiw5i7I?p7pBWEoZglZ=QI3WHtuLjZH(Q*&YU>T74#Q$Nn z+$6ElmdK(DjUw^^6Y=T@kWRU?sKmb&D3i6FldG>PCm-6Q86+7)@}qd~Q{|4VKH(K7 z<66oF%B>H@O-cy?MNA%bK@RdTYM@ujOGm9!KvNE}_-j6fMM%_ATaGHGjzm5kxpsFB z-LCH13%1qqxI$~`v;rn&i@Zv;iZX$D9$7EEj$Ml^9%7*+7QJs1Fxjb|i~=i4t>)gR zr7SsvU}H3?S`l@B<*rUzm6X!BSU_Bb$X^>oC*NRudiAL^?IC|JBrLKKnK?(<+r7Ct%?gBKkqs zXVl`7n~KZ_)td~@zo>glsT@bXupBthp$BuRhoH z$PlrfIPOY;4;nV7C1w>NbRS@~*;FSJlZ+oOokG|@FuI0Ne-PkpzLBUCL#BE!!Al1>D$I}SS$QdJT&)@_qTI6?}5(Qr;exp~m&wDs_tjHl733CBy zG}xTBU=wElBu&odMiO`(0yfs)CaBtU)Lq7FPf3#txW8!fAeUz3^peg*aUT@?e(}cI z@CRv9hU199>wIoqq1TDrY62jy!u(_n69#A2Joy4WIo$aICvqvv??*zt5!*ZA0S|A( zX(}W*p4*J5`{-q~N%Jc^9x|i=2;*T*ji~RM9AL+3^db!5+Mf;OdjJxyoe2bME&>00 z;FIhkG*xk?0hCX?M0fD&Z~x_i7dK%11}6qT2G;v4!=Xd)7~utYlN|E*ER~$EG<8NQ zg894u=J*g6BNy-{U7-RMZdgCzL{{|r;vT*3QsYRVy&pwrZoT-o&Nr=?&R@t;@Yrn} zUJ!y~QCBlqWxXhrO;+pwx7-qUyRK#~tL&J%5um#_hE3& z+sX5@J92rFnO9Mcij(JU+6sWqS&aF^L%hqDviL+R6rl6@nGkAY3RmPZ$bCs;^rzwDtOX{@a;ERO0#$04EkMt?Ngo={;Dd; zZL~bMwky_6yVJf7PcrY&kF{&_5kdJK!BzCD(7?3JI<11kYTr1g*eI>S$?|+h5jNfL z`#kv*%#{(ayxb=#Kv=_kdP8(GPE-}h1d_9`tVbyLRdrFQlco8rrT3fhCy-ESf_a&0 zT7|b|eR%$_@L2PXOo9!sjw5lTk0V&Nz}G3}k@o|yZg?PSFGt=NywX8~?#_IetVjaz zTJ!=_2qCy=M|yqVR{teX6*A?L7M!yLG@y|{M+$ud#7-z67|_K%7X zo)|27XvM?1bPQ@&1XXZNxDr?qeTNYx)HaH|MOY&0*;phTiiACyo@1i zPZ|B3W|0Z2iQNiyI?niN`t1ffDH)wvx%98#4=pFB8pvlho!s{18;nJbMk|w-{vnIla&>bQ@V<+8+rqti`?u~YdtnmDIyJ= zXXw?zrU&f5QxJ?dihP)9Q`2gFZkHFHxhJ6gZA&-{^U7Lj4O_}$H8U^RE1GCuK)Z3v z;w&@I(JQ)dPvBX@mc_!qJKDgvEsL4V6K}^-1rf0R^_BD3#IT6;&Bfa07g3S#?UCdC zBGObB8(Z{Ce}2JTMW3XMwL_jT@oP{RIeWD>+^(GWMf&An-fIzVSx-X21BdBh&wz1NP~Wu3_AdfOjRw zeK>uL?HIZacx?VdII=4*iId?H8+3rL8AIoZEVhsC>WaD+JMh zs${c4ff%Oc`=iV617XcCOOCmjZZ_FO5l$BR0tMea{2>B5ht+-^=GCC`{nY z{JASkQ0gaVE?c{4w)moH_VSTp4Ljt|6V-;e7S5vArLJ+6v@#Tr1JW^q0YCBbqfuSU z-u=GFCkbbF{U}~3xcSo-1vb+=z}c$`byX{wPhb+`p*#PrOkwb+9?|kof(WO)nH~k} z9}5-f2th#m=S0!l1=q;pbOKnYoN;j*Zr5aa^eb2L(mcs8SMjb3#qlnSt7=zS9b#@K z@4m$BXsY(d3Cc~S`l|E?HkXNqG^eD#xNI)o^5Rs#pQ&!#N2$)=k9(kA?`l%%kD{^r z>6o|gR%%1>Nu&|%H!}fut+zCGn7wKeT$qxF@j$?B#^=DDkV~!?u$-5$^Wo#hDC*Y) zBx`*!+&wX;p_}=GW6NQR`GRjEXxcGjjbyH0t5Sp?z>*3FXDVtqX+tu&9_NnJU}MPw zAaIRx4k;cW_pM@aqa9Hmc8)()j@H<4;r<>-Ly3vzTTHEfKfz#v(}jcP%c$S95(@lO zxt1w?olhE`BlCzffvwng_uC)}-hvZcQ5zE^Nd z>}?bxa?(4aXrPz^ftbm*2d+2(Q^&n9igH?)T+EsD(;#Xd*!dKl#+qKh-*|ei7|*nlY5DKHH%D|h`(Zx$qZ>XBq%kD zd`7#DY~1JADdz2MMi+U1IOahNd)JhB|qYaRq{9TFboGg z>@M|2wB*UXo(GZ}{XjAYWKeply~bMbZ^4bAD7=QfZ}vIYF!6I(_ZR989CT?plRbTn zuSJG4=P}+F$V*v^)@}=EH|yPn)=;p{SxiVp)WgI>>MahNkQm45m+SeUdkvra?9?oE zu-EMJBg!-`i$FMhBRG#2y|(vy$RpB1jry{_+vP?Fc)?pJ zsgvOH3zH6{_=UQa7uHaduL!m6g}F_3%_gJT5?G|GnJrrY1oAN-(;Mf{3+I>b80*)i zbaaO!Rrr5O`GYi7vZD}eq4x3i^RX^BHyyO+1(N?|o`NSf)!a52GGHrgf$t5HV9TG+ zy079KbfuP=XDvp$u06_*LIr^sI7rKG%eAypwdw`)?DwxDk2`HmEy~Wd?wv~00P~5B zkOFQ)`r&|IhbRhzhs&iV@d6ygn~-6eFW3s`46{oTBudAl0l`+u9)|uR6|JmOsl#N;6 zWycX=4Xbo%*^;l3MPV`&BlmmF0l**+RsHm+MpWd%CJyM>Me_iZG+pyW-RTQ;<6>F| zBIBAc7`ePs(fq?sgUNbIl{X4o4`Czv%!;5|SFg)WoIb; zAD0^{oL)-zoW4`;4qmzxbi9i;mm6zNr^#1OaQ2Hzxlh)4Q~7?h%5Ewq0Sd3s+GU}N z-&ChsA1LNk3S_etO)Z|k#t%(n9Di{_Ps1k(@i!~6f@i`X1d`28m{|N!aiu?EuP1ADPl+tN3Nv-bavvIVxL}? zk3vqJ&LA2>I^pt(opamBKyoqAgF@J14HCbSjMj<<1C(6X7-6wRB3YPH~Pr7Ge~7!oeC+lwS%Q%o8=p0-D!7xfGdSN-OUH zN9pn`nx5*@P+|n+5LxbB77msvqf{JrS@p!c8Zz1tQcjRuQGgLT<~yqtx*lPY&93U0 zP=>%NJ%SskaSC1!Cn?iCn+%Xb-7|{NvsAYlpmuiNZ;Ug6J!zc6)MH8#Z59fpatp#H zE-J;50Q!xJLXD&_-k+2;oz=9CsG5&L-Ld~IO0=wIkMBCLXp$zN3$3mQNkdP)$?{vi@ z%;(P9m}1o{7U(Y=GH^7C!21`ZY)}lA>7Z9Xd+2Yp5gYmv+P3m00IIsqf~U#U@lnNq;w`^pG`MK_X|!VB^0S<1bQ8eBR~DpS*MG3T8MHd}40%r3q7mnh4fJeSW)BT6Giodb^D+}i~T?mNMcyB*V27AF0#QsCdIo@G=vDqd66Fo|DN1RSIY z!*E>t+Dx}`z5B^$DlDaNFNkcsYxo8v>@kHGe-2Lfk0t{gXw(&VKl_kQfW5{y zGHKZ8F3OKoI189~+fz%6eCd3R--NCRAuZEfVr#qbV}NPrQ^dY}Y{ZIzFb>4wIZa^< z7DDaa^gq2AGzEVO1Zw(qQ*i9X%X4)QKpAG*W2Ko;s&VJBTTeb5u1CK7j5UN@6IEr| z4bdh@GuJdZ=G+w|bd#F{;W!0QakmP;k3a zYt`{4t?X29L}^$xEnRvj;%v1iAYO*kKqa>R-q`r`Ed(o>;=&ajP%ros4?IO&2t?hN z@hyEjwX8u(9QN{%pMGC?#j%_y;s-ic!ynce^akCXIVUP5`Kd(k6eU);B+aHIYeK!s zI=iOn=HJ>oN!EHg`zB`*tR6!?ttit7>MRD}hga&$LZs^x-2n}{7)wqdtZs#MM!P{* z9_GY4I_SgV5dq9QvHA@8C}0dhov8W|o?eMAC6q2-!AKGWrt5xd_axo$vk{^HIqqL4ST7v4N-H09G3k6jV1@2bogAx1@D216i4ywzwBOoQN!D%J zm1kB>(`CQ4Lz8YU-;~<561|pva7++PXgafR`Yd?^@Uz{9pV#Ew9M!4a?cEsT$m*0P zSqIObYvk66gA2T1o$J4Vw9~5O=nc@;lQ~v@=C_i5K9r_*_hWAMjVUdZD)wGR?LK_? zAVt!LVEE5))@{r94PQ-Yqcr(<+LL!@MJ;Rfl5Z|5qd1J;DANj)taix^hi!E|!I9b! z`ualMyn~+z6lFnpASFjO(%7r8cU>|pU(J4i*RVsWe6i1x!_=d^N(e@r#PV_!xsD zl#L{3L{=_8^FGk?sK)f2@R7=k!l=l zej?*9o}A?VjdRYJ(LHGVXhkcp{wvas==DRG9SAGCTpQshQfMTAc2H=MVHfkKDr z_^Zw84a@QL56|T@N!dPb7H+gHrCRYmxM1Qsr>2Bfc=|JyNWyKbFHEGb-T^N2*X<4zP5dxk&iH{gEU>ZpNGlbc*|<4OrIOl8ax zwy*~Ou10w8fBovp*$6arHDTZIoM>>4jqrDalm&#QG8PGFi95|118kLd{i0~8Q3t6< z*Z+A2&O7z_(dbGxp<}%RH=SCdVj+S^;EtwAS~%?Edr!)-rAKjndwXJ-6I6P9H8`@h zWe~!|pJ-JHh=z0^%&Y(?nx;7c-tB{DS64^<*K9w#MZyM5H@*V*_z;m#!lmy<_Bz7n z3%gxX(7w?ut);1*h%^}E$BN+n`gapM5pPCa%pmcROKhsOP1Nm#;qZr?Lzr0X0sg^0 zKBe$~F~Ltq!j7UI&+`~YWt29KOnpi}0%Gh^N%QzkBAhh4vS>2bXr!4kJD+O*(xCF&vsG-V#Vl0Q-o+ zKuT#%sXaS0Z0(arrtVvwheGc2DChEAd8MG+e3XrwH>OH&rVqjZPba=9?@*lkt2=+q zI^5W)!Zh{={RR34Uj~@(>e(1P+PQog;8}X*pB1);w0t1GODz5%F?gdpb5OjOY}UbY zWA=-^)z|Wj{VfmGy)EVnh+xqneuF$W7U*m5_4gC|xUc`Y(D60$R0rGC?Lb2>qr^V3 zQ-=jO^#I^j?dWMTNV>z01CcP=m;Gnihwk@E3T>?-pBMYmT=Zv%YyF)(N5w9`aOb6} z_(5lvX2Ta4zouIp3-gt|kZ(4C-o@>I_B4&B0eGWReY-A%6mBST?!Z;lI%00v3(}Uo z3Fgt-msRH3=X_B=00dJ`LFezXvk>lPfOjMI58}Htm%aePO~JBKqA%=1%;C%(ouBQ7 zfso`f{*nit_1b#!%i_&CuY8O9SO{pOBy~SeiM6`-6s}K4#aO}8d{VRfkF5gFY(!Wd z!c$Ge+ntY>CuBTsGvM!9O_^)EN+ZTvQ`0d?q4!*`1_Eybqsn&~XHx$tUckNelmn=W>){0Csx4qS_ z+q2PbmBuH@E9eGvy-9`!|07!^S8aW z**v2C9@_&uH2^&oWzrwB;vMu$kJWPJB5d^R4~ZXj1sOH*z|>&i zd&=75>_pUx0DD63vK1ZVIi`*2TbHfTCZFdQ^{-;hm^m{z(y&SoJ zX(fJSX4Q5t5VGHkguEP=^M8+C+XpA@r%@qn@f)&3%AdLa)91r(U*LQFx=hrodi~&U zu+feMf^?aVMCytK3p&-ZVV&MZPu9h&dixizBc|oT)UKd{CE}3xZ|L`@|F~><`Er7$ za+z4wCv9sRF2X{8R|>7a=IE0vNb|`7D-qj38kVymn+0P64;6jERp?kBy{C;iYd~)` z($CBhZAANgAu)lciGbTP;3~DBbLr70g~aES`zSw2H^Lz3dOse($jrWYRS-gANM;ji zJPS`3gHx1E?&kljS*wKx@foR^VkW8Y`g_be)bp>fu&hDx<%04a+y)BdsDQ7do&GLc z7lS6t>kbHSyCM8I#4G3u=*QBi#_JIdXro<BY-S$NzwQ^cqzWA|v+5o)J9L5I z)70F~bxYXjj4vOr(Wg)O$ZVH{jnf({;ksSxy|DdZg9ydqWBx&c_%7s*fc~M$MM;3{ z!l@^*6F~zNgA$O&FX4gh&!svZXlMJC`65?d6E^W9@^Cu0`1Bq;aT;&Nf9TJSywXXA^}AI(fErm>?Qt7`jc&4keW?LHCX!a@mklcW`Iw;Kath7*7(-to-+cl zt&_OFbnjvFd|5R1tU}S9sjYM=he#RFfwWHv-M@bo#@ z<&;67=*ZS}<*X_8ixl)pL&0G`&=D;W;RUnvMqm`CY+q2Svu=Od!RE(jNW&7qqWLJu zSb{&o>}JM#?IMgs{|dE#yI#@_wVH2!^^yGbx^470&0-?M_LJ*--GZwL>$~30!s|d6 zm$ROwgAYApfF8i{vS&qnK?h|Og2Dt{e7Kr)?6;dmy;+4L4|?rD65Xl7kL(3q><}cn zp$ts)j!BK4=|@7gZpB9AL`{9-okO7*TUYV=qa0&k)X>{>J8tWJD90mh$)4Tryfs@>p=QFW;Prc>7+ zMbU4|z%ca?5Sg-Dd^SIV=+yQiu(BhVU9u3(VRfjtr2aNFOI!29r@`fha$ZbLKd3K2a4W#W+K+$J@ttn6dN(mo z@g`#-yD|;f9RJU8R(E@_-#8&${m&XVLx4-Mu zZdNU9oG31HXY5zy?Y5yh#Rc{`N$tU&mqdS7buPIgQ%=pkmByz}Is7UQ8QR=ETrn^8 zxj$>{(UNpu8TrLco!^wWKT`6^Ypcs!6Ar`Zed!(01Vnl*`~9jWCn}iBdPrTl+Xh6GpetX%z=N502?-Q~Hhz1`n4m&G zXk=Y__vHbvC9(VMEXs``*PYmXXk!DyqxOb=^KLI$jOv2YFVNu$b`Ksu{E=!^rzC$8 zVD<1v+PGoT0cEsXfFGx5gQUh@aTqUH=6arz?`$gPFL}5oS`;@4Ce3dL|`#+tc^IL?>Un zkjAW963JY{lv5<1gFA4TfT>jQ;KFPp zbMgL8Z}&Z1q{m=bk@v@Dm7UebPict*G21V+*Thl!Rns8)(o?9s%c3j1(1=(_9x`=eyWhbExIq0MQ(+Y?} zt8f{q-p=h)LZ|Gj>*E}saFnUjK|x{Az|pFMfimbw={Q^=e|aPRT~3 z7TQ>;ky(6ZUGpVC9l{9-Cw?e z_9nBnyWo{rW0fQ4y5qG)Z0o%_ckYY6#~Sy4bq?IFwA#3LF;~8F@L~3ySAyR@7}3p#YB7gReDpe^Pc1F#>>GF39@CQEpsE=}Jx$vNjYk?SZ-+u0bN|`M{&B)V?^3BAU8;<4 z_$p>is~`>CvMHzbI`T-KM5A3F8{uYFOq)Bl-A!6SE$(kXp$IIe+kxHBjrH~Mt?;Tr zTBCJf_k~$eUS&A|%Dy<=Lg<`Jhl{xlsK9j?_UTMSl=%9@>>qTHcA%&>KTu?)#O*)) zsp_xdHq>r@_!N8TD(Ildke^HJ%%F5uF?wNp_--7VeYI%yL-tLUtpb%|Ot}8IbXo56 zsMzpRK_=)<@wVjoMqgG>A=3Iod%SHC~ed`5yw9u4|4;whkW2pjdx4ojeJje4=)8U)VOL1N41Hs5F<@* zl*%j@OJuwXp5G;e>p%V!3Cs&`md`Noit&3fwh$|d!(FPGpk1XhsAbQis_N^; zrIU+tiHD$f2lG!`1ae)%n4o=DV;S=IYzo2g%Il`2cfH99qKm&Xzl{MpKKJu~PL|(i zJ=9;{HcV}G02QJSwj+p-6hHUL2|o>Hf)bbhkIs|Q?Omz8d&QA4d6c#UVOto?FTQ`;|Eq~-c6p$;JO9$FP$npO zsf=^+^O2nJ|8#PRkMtEOfpeXa&3RAXGz0s>n+L_Rl!`6HiTAvjCmSj^Q=ixBwK&K& zJ9Se~PmJJO|9R%=stJ<1oc^0R0B*{E69*m*&KT6m$-AYIqg&oisexe9YUFT3W}Co& zwr4pbh6ISfZUFi$)(wr=;=^KwM=j*vYS8g(1TjaLc8+KZ-KNO}fbqa*HXe_j? zc5PVRv7bR_=j0Rht16P2+SFj+aSpoA!n{6?rzcY8=Uyg0juptUt9$jkY~0pQV3&>XesE*0!+yTdHapoYTT4qIr4b@v8kay#6n>0uyjeG^l(GxaK~5 z>cw$(1B-~}T_C`TuI^a^^@77j81ZbH7>d&8It9yaj}7`L|Fhg*M)gCuVGv6%8*g}H zJR_U#Lj8c#r}-cUNH97XcE~@ZyDs!)an23GaxS4m$xDa7nQ+!dR^<;iKANOQbj{b( z|646zDR1R5Emp*N%lZirG4CONqP|~%`em8O{r~!kr#Qq!ihT)gD*Y0x(TV;W4BF^P zJ6&1T1mAP~v6=|o=$)tXMUkUDd_vdeX?DAa-8{m)p%6jOKM{ow*}@{1m+ZZE|M55c z)ypqY&39-HCwze&Jbv{475)sr_?5tg=}8C5zxy6jwOtzm->Qx0;ir_dNU+d<41^ilJPOvOLBf!$A8I+6^QVwbvdN1hcbxTdvB3V^5$GF+^AO zHo;S{F8ezVVO(`>O=x!yHtLbiUxqD!35f_I-Z~KO z$@&43&APNpq+L6n`*$S}14lc5*@;W!QtquVE~~c1#M1{lnGVToaC%9|vj=B%7Z$FL zR7!7GrCs?fBD?SK(@sN5Ps!)gms*Lgq6JhU9ZiNm87nN9s8Xb-EoJbs^2Xk$oc5cF z_7!rulI|^SP5Np7 zB_I7hr{m{OULe6WO8g5F=RV#-zL`FFPWro=M!3}|3TLcST`&cQlQQziFcQ^7m}I>x zWu+fUjQ)~SJMxp4jgIHH6;xx>4mHEv|l%d zH1pYEoLhn5U(LY6mEo@c=h=7EPGxfTnRhkd@7H7sHbS+G-!U2l3bovmo4-;G_(!an zcAcJXF7j{=8fzj98KJ!ST&g<@S7yjl?q7%NbK^vf^FE)C%2%LI2esy@DcxV)(KaS) z$@@Xtc%2p3HNK&n9`wB^qpN&z_wqc^sqCc`%E27WAvy0Bg!`zc>>1J40C3`Fgx(JT^-07w~!o=FZiW9U@)!nE(Djs zMv}&QDZz}W8C~$DSVcF~Fb!jGo{_3L*vNy8#NxR|&3xNwHNUV2-G+vQFWrdgVX+(O^4QX_H(FJQj zfjW?Z0iV817Y~fQu?J<|F)PfFwzT0rrJ~+86`6sK*s3?@ zR>W$4hx&;HeA4$HY#8=6a(!IkS~aRR&aDhQPs(;o@M${caGraa#r`Za0XeP`+&{zl z!+g~qH^Iyavlj{1^Zgr84oHDb=J7<)FJiZ3w3G>%>rT+5YK1zr5{^lUs=v3b6s z5dgTN?qB0@?H9kr;rrdE1crpIpgneV;^90PZ2DiIJ&W>dGbNAFA>ouvN=jeyi_s9$ zLll;fE75d4TRL z5*f7T;^KST$7(#@*AUOkBYR;)^`6>$R{b_CIYW8R+0*CyXRJ$qK;HuwBdSLH*#ih6 z<60@>it>&)J7b-`Zt!rm^t=?IipY74gu@9Lae+?PqxOY>bO(YpvFmj(9i$*s%!LV% z5`Yg~1sxD4*>~ z+#*K|c?wQNZ;ahFWpGasT zA=qXnQ~H)L)YHnGcn=_;zp6r-;00O+CR$lU$S+N86cWw5__p96X~7F1l~lehMA9@2 z@r4lrizNhA+a%v_r|G?mEc=@j)cc!fu+?OMfijA0B>X#%JsgZrzC-JJ1Zodr<)_mv zvcSMs-9?l)f&RlC_CDoM>h{#)&S_+fz|TiXg%xYjyyU`?p4rF1h{I zkJCeI24g-L-${WMbR^fdP|Z2P(uNbF&M|In_OD1`eFgca=f7LJ}}D+eYxc8rk*^<(7%dTn)<+$mK!m)z7BIy&uxCj%Yl! zJa_hqjp29#$5>HkW=09cY2FYQw4P4ubdb*5hIr3n_u|IGgRU6Qo%Dl#H@a$kFgFTJ z7oNqqF%-LOK3stCBZbnmABdv0Ky^NgQ2~LJ!6wS^e5;rl!Os8M{QqtAGOen4?!*Uk z-eNUM9?WjMQhV)vW>i@JH3%}6G%U~Z-MioK{2!c!2xp1)a8a&FJG-^ zy4UVy4%icqA z2Hf_O+&=;H-VCQBrpW2uJ13Y*Ud-lb;Z-ss#K!}6%R?O!)W$RPB zz-Jv=u~#CEI5m%q4bGbhY8Z+v z-*-gWW(X83&MxffeXebcSx+-~$R8NuC9uHtM)Y~+=Fisxsm02*#kCEzAbT?pP|u-E z@P^g@9pgtXfbF$@BGLLE2q649k4HaQ{v7obN(rw_9i$XX)i%Z|Q0?zfNb!KTU|XB3 zxo}JjStZzJrJ147gJ> zwE3Km8N+d5DjWJCAnthkMb50^QpKG5nRxo4BG!`3rY*H=Q`|_gzqQ};i|>ZRLGj?| z41}k|JTwI1Ah|s_WR$_l`6&%!f&ffhOKSR>AKv1dh)ATk$AI4oDt1u=6c4>21+AEO~6g2>Ah6_6A zLjTIe)t^O`Hsl)5x>Mb)r^4=J`&S+==mZ|dUodf7$vkm@XX~bG#5{`npn%1l=%B>2 z5R?bo8}nwPr{`76ks@pJu^tP9r=z(V zj_GP*38m%<1E_%%n6 zS?hI=-_j7cXKG1*jI^$eT9F*B<+ZL?H;#nvuVyu_spJfthg9{L9yRgAnInfa0(6>3-R1aC+?%iFyv+NFL+c@(KQp6u4YaEll9-#B-5SR10m$I zaLkiJ%U2XNM}nF-Wz>&uY@3iM*cTo@!M>Rk5=*3Np$JBFK!0>GVi2#q@hm#gw(-V( z3v`<`B516l=qem|yXo1uW3fS6gXWcyr<4)h{k8*RuY4L)m#)?#NV19SnvyXC{~h?- z5RwUjaAC$7aTt5YEM55!9guJIWd~ZuPzOdB%6Yo$t9U~%>@d^b@4 zxLjhXnmN#gdBunZvXGkopq57gw76sHY~;{~3Q z=8vtYegI7d`aTGl&0`kB9=JfV0H06Ff-H;k)RM!q{F^CAn}syLml_!bV^YXKfCy(a zuIrBa64Hk)=NW?;_?9p5s67MD5y#0Sh76p&(ML^+@{z-XzwHEQ2MB0|pSG?8s)?p+3rO!hp-YVd(g`gT z=^!8i0#XD-+N+`WvJ@#wXaNaGFCqd`)R$fbK@g>hAOb?Dp^EhWZ}5G;^L^+1=j@s6 z?wxygW;e4lbMN!)NXppv`Ds5G4Y439dtG*ZyF}$oKl4cJ!Ae`&EAYth=JyTjajNp+ zCi%R?lCbhvr2mSdo`k5HJD}GD>?siGB zekS_*gC_Mu#%h5Ut6!^I(ll!H7k;)2r!ng+gLRBB9YMWE<)55SYtz=1GpDDven_0) zV_+Wah8>`5O-G?HbVfXGm-&4#OT@QgfB$o}$@G&Tp_b!ygROFxyeE5^|0JSOnYbzM zDhEYf72tlC)GQ)(^R3y;BS5gj*;vdxa)AFp41%J!2o#mR~pfh18n7j!Q+;#>_ zl*;vD7jp66VcjBR7u^G8d7Flf4iMnbZ`_2qRftN zmVt>#D^1FZ)GKAiIVp)hNqp#s(+ZM}cAIkglBjpNHa9nA`;(k`aL(v3L7X$~Lk55A z-y_Ny(zS(liDH-iE#MLjo*x2g^7fk6-GcVpj&18g`l$YiViBv0%d{M~sBrxF9DOK$ zh;cOEm&gd|^s_;c-n$%cPc9M*A8z6<8TY>`@)-2A;ispR-;;?}?GPYd@fMjSZi@R< z4>P{} z;Nd)EV{TVi-cOPa$$Ax~umcH`F7sOVo5hw!np)ByV&EhUH+_4ecWmznBKZvFlf}@Lw!RA@p$d(J$UyizS zhE6>JSR|7_A1&KJCozu!pDUa02<%h~2S=A|IR?3RH$&1460H9!*5ngqa~*=XGva@A z;u24t;jy6ZJrZo?-rf2RQW!1hvC#P0423y*!hW~w8Lg*! zUcJ}r`M%itf^(~eJ+Fm{?q`3on^!hiHTZb|3rAp<2jJk~+*^qxR61Fho8dK$&w>J& zhu&OSgEAD`xBEnROsLXYxZ(GeNU9IsDTm3ZohQQF6KT^w{8hC4*oHJKtyw|g3Xajd z@|pD^ov2Ufg$8(Cy!vBd?!xeH54=rUdX3e(-&ZnM&+k-%g>mu(7Sx$>EpzeMD>=8M zp9_!aRayg$UZU7O-xOhPuj@lcum7p3Z>;bbd8M^by%#lDl`kdxUqs`!;))+xAKvmI zw0~0Rv!H&3jPG5XFn7?*=6fa`I!V))`;}*Eld{Yw^bL@*uf_XeYd^4w-^KswAVEg! z&CM1dm`65@D0@cidZcAFRk}JzY`thOB;#cA)%-2{q74$$_{LMs^at7rdg_=u?^s}_ z|2i3hJdgsZtrmZUh@l@q7(r6W?g6 zX+eYlfCowOT1S2Y`B)vkayiq-U+;AVfI*4u2)%zei=_C0;Wj2f;W2&cOB5}j)ZMgM zdw_Ea+N@Gf-T<-7#S;ec$h$rxg;^|9@0Qbz>-w7>Op9(KC4GzxHc!{IC78S$Uk!8S z5o3$ulbfO^4I+?8A2Gwt(8b$pfZFqotc=)pOgdIt?+z^kPeWQk1$tEGd5 zDA9zAHo6Xh<>KgCa)s*A1AfOH!6qpL-ZQ1WRXKL~+ z0L2}2TuCnjGkv_Wq-Jp?}FaFCRbNB;af);9+U%I&>7E?YwPn-97|IR#&TvY5`S(UaUR$;Lt6W72`nsACT)#N8?8&Y#gB54j$7&;5Ib*uY_7N?j%ZZlqLg`xgPn17TthvQ%v;>=NjoIO&_(?Cx|^yH+ONg-3l=dGTqvoqoKih*luN; zPhiYl?%5WE21YL~GJ`gufzdHb%t0CE%YZ#7=NWL_QW8cepxNgsJjT zn{Uu=Qy}__wgRRZj!;+oluicPno#$ER%ZauH-ht6y7MQ^UC84<7 zxeL3XS*5dm#uM+3RReHWFaf<7=o;j6MM$e8O?HWSBKtxyHW0X|+|?KGz-Z(mb7SVe z<=k6f9^m6Db1}0mFbj-!nr9wJD%OTOeYl^jmbLwKX)HVytdo*+*S7eL;Q``vrL)jy zI{_Awfone>#Tl1Ma;X>`{WftwaLuNgbA$+W%0at(#SLS&4#r`pp134Mca-;i>yL9L zBS4Y6GFOpY0xCW@n`O?L-M@OfwC%>F0uZ%)i+eMrxO;`Pj}$(?0IZHE9YlwvumC)>+?O0E;kd;OEA zZjvGb72MMUm9QmF=R%x*!_-~#g8@T82uIW#$83Q)5$Mt=SmYe7Zg;|a-G`E2FrFZ& z%l@J=ZL2>QU(p#K97}{hG>i2p*lSWu-dMdj56`RwIGKa->VMgdmNd4r&uoufb^k5c{`TN9N8lEug}wJ{A7fgY}inX`w+M2i0S81?aLw9z$_M=a!7> zHO0;moqcnA{a?rYQ}Q4~opD@RJK}}0goxC|kkig_3=iTm?uriW=OC9M^?0tkJA;L> zEQoi@K!GN$D0q$!ms`&dhAmXe1xOaOl2AdgK}Obn>|JhRa8Esgi(=-fwX_K@@)a70vfR0&BUM3~~}ZE0zP0tWfE zb4PHelXyBUSO;$s7-mw$kIlJoGii%#SUown6yj~L2!eY>V!)T3Q%Bm)*(~#H_s-5) zTMM^}KnA5Tjgzv-1@tlMJML5})*(r=`to8sg#|f2%oMeNJ1vi{=>Z?GJjgW$d8a&h zelgPxi3+1la}^ZEM$}IZIGGK2SMSlltv7SM%PNHGf`Ot;b0o+=mz9iizaiO5-h1%> z9BiscHqpM^SJ@NZN;aP*n~c2Zswm;Z$4Te1vXwE49*kTElek1yLbF|gZC<5%%=CHU zbbS=*(Tmcq>md z3d;}upey+_)sac4w^R!qn4-H`*WF<88jb4XgUaaOCAJ^eql=kEdSNPP<1qfB6CJI? z6x44%=z_LnUy@@Q_aA}dK=xIhdDc{+=)B{-1DOuf43ZJGNs9cn%(ql`RMUKVBcFlo z3q6mnb-~ zTZLn)@(*=4_mjH1|LLyqcrxC4$|if2HNDOAtxO2d#hg5f0^eC(=Fr(ZKa3fl!+TIY zIB4GA{TC!A>>=55UgzF@2|o;pF#+-SosRkURTzJ0BEcD28P9ZFuSv%k_Xk1z{2XK! z#p-tMeN8RMrP_5YWqov-w$s6WhL|)_A#!>zl98iadQ^kq5C;LgBczu1P^4Hb1bn5z zcpxDN`PC#p7ud}TC*6%!eRd?uGa5uQ>Rp;kx~o*mYI|Bd5U4_zq!u4^_v=VuF8wY? z*-v8Wa!gpu&gzSMM#)D+JQGJ#xG3zdL|XEytFcjh5ZBl3eA~?GiE;k>IqJ>pw_iJJ zAoy0G#$ww?jJPNO1hB{o>LAp>Gr({wIZL}wTwRXxu6YF2E_~+p(aelW4@~5hv*GE3 z;I804Oi=4r#^PL-UHAy8P+d1y$g3s&mZHK|7UXw0ZL@movuUZmC}T0FH1#45Hi6GD zS1nzs6*}&P(NdG{(vMo1QhnLRi>M%SWz7xfgD)^OEkOPGF)k{8e=cHNnoSm=!|ii^ z#>BjUz4Am_uh^J3fx$IRr^t2z<_+pTC+&yY2L=pk70u zK;P9%Q$^wld7)9!l>`G8La2h~kE;`gLw-+dP11ATtXWfj=h^t;OZWPzPsIk)BWI4b zPq(L5+@Gern7Ddixafl!R}LF_%90n2`|McRF{V3)u?=*LxTQ`)3#zv!Q+2J( z>}>>;YO(VZu3^uCISH(*NYua49+3F+?LFFbY-beW1A-Omr_+eG_~EM89bYyYf8~e4!6#jXqSJ z1G-BLRy~$6_P}dz-|LB~^)=q!j6#(;U4{-lp8bI9bwjN6s-PbO;HButdICv<{t#ln zRlu(L{g*pz2xjW`g6!|oXA{itruqvBso5#WC>|DC0t{yQGGahH*7oIc8J8(^@L$dze|k1O(VA}4$2$$ zgwt!)=-%ijaf3HvQja4YIF&B!rPq$ zSmMTc9pd9e3zcJrYdpmcE6m~T0`wRSYX(n~F7}~Il;Q?m()3aq{d5xQ8m9q-9B8Za zv&4;9C@GL<1=r5Z%0;(ImuBDpP zG9?9Xq!%c3{U%3EJT5br77R)YU`l2ExPU%cU6Qb>EHAOEW=bKd4Q{Y&)PEOUZ4!_W z4dQajpO+T!!W`XQxTA`2)suc{A#IvcvX(l(jIxa(hHZox0HP;1m|aVGsm+Q(oS|t- z%+sM;5^Q?9CN%n9X982i+P5Ou`jph8olAGA7P79I(LPi&c7d~ zN=Ut1T#zgMH8nBg7{9+%@)VYN0?Sj>WJ`pcFWUD!SqB!k@ zmI+Sn;`x7`mLqqmmWin8yU^PhD{u!-x^pXUep>M2s_m;>2I{eix~%{>=)sYkJU# z>xb=qnz>d_QW?cQBUl>YDo&K#bjy`}KjAp!h8rdEN@@mD_vXF~^P!|ltzM(ov)sr< z;^(QU$S1e!G$~d2u%n{%;G%urRwC&6)72oTGLOg1Q2jL4{?YiR9AB0Ja zC}g}Z`s73?NHkqYc8VbjNv;Oe5r4V*ivU!Q^U>F66yU@w_L|@o3-!^oK!w$8)D6;% z?UgI{FHCCJIllZss7;4N_G;8=w($c8@wV}5IydY1ORUhNq8-cWc0T%AEub9+OZO)_ zbsDemxgC+@`goHLrs$-5qXrUWPjIz^Q+?ySc7+-87!;JYiruOn+=26lFJ~4AMf4#= zUAKjT-a$nO%Vto;e{(NK$X0W_3um_b^Uw!r()A|JYHe#tDu`FxgRJWwk4ggIr}8?q zs>vUcSY5gzuWqEH) zGcnO#JFoiF9sQ$q;UH*9LB#l2`kVJU^A+_K>cfg<%8xn|?>Jy)iGZL`PDFPii#_HM zdS~H$Iq-SKJ5C-^o387fw|%x1*y1>;!CgYjq~fa6yJDT}JG_c)2{yH?`C0Lowr(%LI zS6IoCC}xLSY=wf-)FS^qJF|Zbg_>~xE&CV>DbrPcQ9w*u7UtdZu%-Cisz{hk`Wn@3 z&)`x8fm4TS&uLcw-DRyz?=qk0vQd^y#gl5?#Y83LMzh6@wld*n<436ta6g&E)~$n@ zb;h;RjF)n!CkkMy;B2e+ggusZ#oy5T#IoQ#_Z+ z2e}=NGo#=1Plq^LDma%vC5iq0O+oeLq;2CMf1No1yom4Lfdk;qa%WE+>R zcAX*N9v7>=XV=yqR>1i1a@M6yDx%a8!U(ql%E3tbS^})6I-JK{V(l^_yzN1>?I0;6 zg556)5w7ACOQ3qsedgF8f`H4O?$NV*eOmBM=|S)d>XmWXWQM`+;7&c^foy0! zMP&rIHgY|=Te!P&40JHS_qe&>2OPSw2o+OTV~EmW+Hxr#;$maJgd7j znKmc5m=~l~jNhCJk2q$%A3Hmg*$vR=>Xzopzsl_>Rn|V>n1yDofC92Ia4BZ|CSEo` zudE%=T>>g(K3;*oSjo)5Z_pGl+l8p46cj;GE8rDK|373Y$DFg&GjkGBK4+9QJHGBdoVA&}2o}7W zUcXL&FC_j4iH*)q9zZw^)9a7v@6S>yho2*UjFejA$K&sS-**3`Az%-{7J&VeH-A9= z5B%Qm!98>T6Mh4|qcNUZUFzZKccN_fUOzYL%41LO4N(A#AG80*>rXq$YJ51`Fa=?w zcX~|+=Z!#GMF$=C*5J26$_6=G&j2O2RTpb7Us2GJ$50Bu*q_)VD5EvYJ1|sJ>E+rL}O+6fR7J4p%3l zQtv0B8YT4smad}?FEmw($0hBnO{kxVmCAu_QMevw9PM7gbFo7jU0c`=_BjkT0ct4k_8gw!+ki8atMR3|2iDEfM{Ui z195zysLahcK2o}j<3sN|aD1QyRHC3$fF8p8JxHCgccg4rDc4aE*K#2&M!jD%bX5Uy zshPW5GX-8KSZd}kYNk{a(JwT+Cl^V~MKi-jN*=bRoE03kM@~7hVMXcl;M8NHfA4F< z&ZV9}Nxkh0H!%yCmAqb=<;u)&FuNsV8H*WdeWXy35IpewdC{1i6Aq_t2u4d|l4*3A}fzrXz8ao=#%r|vt` z!JMvzv2J?OmZC4MCQ^R}vSBrCbNAA_;C4yCY0H;4xH6};2pfnX%g<9MQr7LMDfju! z1_2NjXYRT|#>CJWLSt%*u^M8deknR|?_!8!+i_LTv-N4&uf?hc^ij{jeP!)fdYrmF z+qQ}#zp zOmggYp!+@BbKM=^l2{uMK`$iMFPzSNUis&AThmCWONA|+bTEi`BUzYNRBQg+JZH_H zn{Q@+{&)I+sr+oUr<|T58d@!OZG)nf%iTq16PB~zQUYqw~(S3VwfoRj8sCGQ$5|RjAOPK(}f(JZxR5JP545+ji#$3;Ysg;?Xnx0zKQEQ}iis@|k)?FZH66YZu6WUql z|CC)IaEN~n`Vlb4a5E6JH}A#F32lKKZ^dkIeLtRoMLhFrcK8(J&#X_ZAr95#;J8x&!}GOJ(G0B)O0y(`emN2T51R zH<;d^#wwVn9wBX>*G++$&4I2a z=RiuAYKw@D$+I}wANCd5JC|5Q(t*xc?v5gli_%+TNV&G$Dn`_0(Z_~iTdVF0t>Jxu zehsHi%QeV&rIOYxoNkvT%th~Bt(%8$tjqrZ`Iuyvfs0oYm&Aqv7ne@dZ6|-lS<8;= zHVob8EBphaN+k6#5CljvGX=V9F}tFxqW7-uqWAw7r6lTMIqwAM!m%w&B*oVu6+L~Q z^z`fI@U{8n6KV1)SmR;(`ZgK%wle?7cN4$GH9n5IG{eW|MA_~k7FU+RXb_5m?fWR!oeOD-s**MiHjI~Wbs4aCsam%y-k_mJMrvUB zlYwP4Gp31US0Pl5o(ck3TJCJ9lIFx`R}>}nD2j5GpCs;Lr1yU$B2FwLAw9b09Rw}1 zONJH2_XWi|+Zi=$e|97HghW=d4YQg7Ye;aY8ya?V-I~`-XhI=7w{Duj(nd32&vxrY~z7oma%ZIjo|tG%FaNcIT@z zCD|TDaN@GZFe(pr}8d!266N*JK2n_1x6I z80jf`=3#%_N=8>Y2`sLC%mI?IpuK^Fqdc7rucz^efODs_4F_IOcH_)8_qC^u2sakk z#oJO+dPy4b>ojsHX#fWvn0b^n!Yk;Di35n63O_C^y#UqTq6km^OqRPS-t1KHVdTQP zxtiCsQ;0CGd^BGn%nG;`9`Y5(U@&+sUtJHFOTB-*cqnpBM)s729*WFDm1Caf)*9AY zq4fJFOr80$RW5~oJ~&GyHzs@s*mm?}RW22!d#}fDV;UEl zi#LDU?Yuu$sqbx_IAL;!Sb5FGJu0nzSJpOdc&W*poNo;J?N2Z|361PHj8;f*kX&Fi zDukf0D;`9`MBR1VdTl+JdCW{od;9;Lb%1l+#k{gX9w{Ehzep^BIRPc@v6b~2`5WP91eaZH^>f$UM!CqEKer@Vx><21stV)ZPa#px0inu zpIcI06#;ip3=IB^UIWGEcXH9mU4jnEYd5YI|6j$t;k?zVm*c~yf~-7+tqv;ZMJXkP zTTf9g;I(m}ysfnfy5USp{z16$5F;MSa*b7u<-3CmTmIsxg>i9d=o)QT3u(%*Y_?^M z-}WKUm)HrAK+b$J?X&xM0-7|bS;J=k*u)$5J%j#**fdaF9fmh^zwM^h8QT~%borHKYIHv9+zRC0ThR2jRA*cjRLo2jROm_m!mR9CzqE%1T23t zPHcxEKT+Z$kM92Jboc$s`SazwuZB9Wf(4J==bs($1;L@w zS2sKJ)Axhk#<7AhmyCLXp}(6*g*d<2EY#o==RBHpDI;~3vAAEo$UYLn{1*Y)m%%{< z6My)g^|f;1k|ZvG+n@}OQU&hHH$)Pa&zEd*IuH4pSZ~*;TnYi_*;FtcC|w9l&Ws6E zO~@-Uz8@g5C$dz^`X?>;J=vv;32XQX#s=i-OuTINsvod}kd6x3elq)EjlwTLy zAF+=ek$jlghsB;UPUJ>o7_ZxC4UbuvOMh(JX!OXE-aZ*)8}fIPjI-GJn5}4)g*dh~ z*@ne~ik)d(Y0$~~EB1QjteH#QVDE=qDOPBid{+KcD<)^y3SON2+Tw(o6j_-6e%5-T z@wMd*!7Bv2;4<;GroKE2tK7-)0f&4vA=#^$X7Webp{wQ0cIsV9)nkLhML!;h_kNKy#N=ndf%F z2i8Z)$Shen>9u7aNLkkmvujZt_z0upYL-Bb(Hfj*34o{!^=U#CF~AAw_X59P%CrF# z1Sc|o`Bitn^Ti+dW?2dUOSgXOe}6}Je|JAi9?}rZel3E%SCOUM5Ue{?krRU~b`W7r zOjF}-5gRpgyqK7HTPzQ0v~#&Pb1hKF%PFrP%3$vVNPWP2&jCTgg)!scvFap)0TWl~ z(d@RN!NxkCy$7MOoL{+`Jw$INu@ZBf$q_oQ&G23^UCjwwnD&~}phQ*y!hb=SDDaXM zRxmXan^AfhhNM8=4=BasYQZCSOR19zBB<{-qTS7)!PbxhhX=7WoWRx$pCuHu(Vg#w zOtIv5FuSK@V}z%adPqWcDJjTg9HguiA@UObk|3tU#BSujn^S{7M|;%fApXe7b%Yh) zh9O-}K76xC$$mYs1ilIvd4FwWx7)@BJ3xg*2eISC&T{l`vfEY^EEu}N@Vt@XZd)4+ zHJcmkK@7R*u-+^efPv4jCchB8v0qTT8TQtPQ5pkK0DfjDH$BG76?H;o%Yb z`zbZ(`N913$?*WbRluC(6@XE*ivbj?>e(~+=sK7{_v&U|=3l?H8> zld&h$j>>cBCJ)N>ZNfr3`P%!aU~XByTf>&+RuMi@zTGQfTfr()5%<)q^TK$;W&;^a zjnCQ=h7wud>gIxNG=GWVeXZzkZwQb!X+q9ReW#*v4{r#Nj>_WDn`s!4+G(xc^qMLy zyv7@zwL{1K?PLY2EC+cXMpBs^EPLRg7B&5uVG+ripbawmio}NuLrndk#o3?w&f-!( zF5-iSxqg#6HLT_Q)4p%wSOS&3%zB#ZWRQ67=*2JJt~M&Ilz-G=<&qZUq-B3*N)o5l zc6xs)pC=A3fpo#To@p@II{^%lB7f8b;1ogmCyncTZltLKS%B z+|~1AZ&AkE=lA>!a7`NgBSGVC5gRp=^%M_kY#Hs81vhGp*Q{x^u{A{bzUJ83-r8@~ zZCV()wsX(xE`L^ipDnl7H?X%J)Q-czC1VU%26wb;lq1u&f!nQcgM&1mEgX}rB8Mbr z`lO*&S#@DdKJNR9tM(xJ?d{VmA<)F_>z+%K)^4*JxTGN+@gQ7|OR3&%%%~!=qYdM} zLof>FrLJ0cuZnJPLmWN$aw+{?{tj-eoc2R#z?C+(F@FcawV*u0_)(JH7fZ^R)1TfS z<51sQeWU)oz7?^J=5DJSG^KIv=^&b<)3GjbGP6I1sFX;aGn=)CcCIXhaP1iyDyh-N zM)!Wx8%Qxn?WYI1C(G^imHw|isPTgkR2T}~A<;pih zhjcxq*?*=tHrn=cY4FxL@E-5N?%ke-Sw8F3X zJk?l%!ycgV8!_+3aT_zloK_ry86wwuXpEVi568LuoDi{hu0P@7lW-S#)Qnw&m8JC}U6 z+<#tQ%<0D=xg;1+&~LJjJ0@?#bGP(yy;U$Ol{fZN_S@6o1UY{=X1<_S2*c*mqV(+N z%(!|AlT6wTvxxKMR|tBVvZN;ope*~b>|&qu@}KsnbXl0Tg5C|J0b1v@;uz36vSZpY z=!!EvmsOuBI!~S#81G@za#LWf7n3P(Bv-lH;@c!+&K?c{8H2*%-&)X)wn6M@^T-wz-@Mah;-+m%f(WZ4o0k~ko7Kth&>{~YAur4^DWa zoIZU2{h;WEq)#R3qBRGnl(3)<-+vr_eU(yMI*xRplmK)%`tIp$-oAnIR6@}erQUzO zIaFN!J>7S2%D$%ZCps&>$Im#vYNry8zfY3Qn}gRXT{|l29I^yOwX65H-@gC+B2zb{ z2$sL{ssHu){pHV>zEc*JP*xrO`QwFeASeM|AHb6y@bK5a55K?sy_edm%qvovwAPrJ z%9Na*w>AjiTTx|(I)~H=L!CiQ2gZNz(_!d0sRQY3av3^H>Lgu~hRdgGc%}>I*m2>2 z8m7|6U);*sm0x};eI^M)1=qKV#T%$C;M%xlT+7tTkZQ%$gVf6Dd`{1B5BRr!W2~p2 zI^Fh3G(S#QV^V@NGvsn3K@%{rXk+dzQmOJW^>%ip=`Da20KS)`Fjh}3nZAE3SZ{`L zg3O|C#%U_NfZ2EfWE&Y~ofPUCh4T3$^&GFjdZ7k%0>R}PCTTXp!{@APlc8!2Of|n( zp`0MgP;E49eJCh8tLD5q)Jy(=v7FAPqWBhf0KuQ z(aoQ!Fa&@2?^N_hsYV|DIQ)Nu$MS|?PXbvm-EnwLusmoHd`M!e2Lds)p_o~yGeMlYk`2@b&XCSsA8+GU->nGR-Gj=_BK8>~ zi*?t!rx|jixn-(Ia;c6y_=p{lTO;E#)>}H; zAa!(wt9M$LNMy%{(CdGaITy1zJ}dSX?5ED_ZqbsROI)Bqebas4Y(oulUr%q2%c+kw zXR^)KkW9!1-MbJaQCR8krfbwpvbEAF6`{70nhX+dW*`c*AfxZZYS}T?8w4T=0@Dec zSd3kTOJNWS`;HBeDaCY%97I<$M1z^mhFig;f4wDH#WD!%>(qaxZf}YrN@k&#bdOq@ za?-5RNmOQBVn%*05!JeGn5j~!uC!6BR1kwFSEEa*1y>ue(^!8exzlL1DWplHFAQsx z@z~BSw>Qg!P;OC^x}ZeQ40)j**x=$kD-~*MU5uHOkg096E59twnf#e>wh$%_iGyPk z&|wOfs-L|yOgn#RS3*CUlvMIi@Oist1Mvs%`}!1)8+j z#BJk(JXBggIBIfQIiV>e=vvX4T-B!%XhUC`D4V3nsn6lO5SJpfI@@rrC!1b{6y({9jq^6pdruU%OZyP z820_0q)VPE`Sq?ee6rrhz2sb)x}VPV67j0vofjT3oZ@Zfk}i>xJbiTa9^-)n^*g$v z>_TE#uit-p3fRrE{&7BWRoz2=w3B$|+G>Adu$?`1nmW2$rC- z_iX3fEMjNN$bBQa=WMcpr%?zs1eT9FrhVMUiTnSE+_%Fx4$ubhj`+Fv4+h@RprjcB zoDBrphF@A~^A(|rMYn}^YUNJW0cr1NFKWZu-9XJyMD?t>(ineo zvi@tXyl1W)#b*O{RK&v7lW?CFyDF(l>1kyNJm;0kDct#{w1n5Kt(UkNpH{I|d@zls zV;V`PII^1Pa#t9TC9Bukq(*Wct6?Wz!;0Mi4CEA-JO?l!zFanjTeU^SC#BdaO@O&@ z)zNzHVGW9!`A`?VmTx>u8{a;q^KySvPK)uSrp7)>lcGG_iOsMMH?UDb*nkhl#_%eT zJAh^eTz8?*x#uPC?^L0R`q`ne*0Oizg^l-eLwhnZ>gQOt(n2=-?M)8voO87rnkD+! znv97nmREBqN?t0&a+5YWwD#np-1nWh594zkcMgARnNUAx z)JR1)>y(!BAR(n=;i`sw)J(HqYEx<$RzI|k*h0HFvjA)uDfBzPH5K?;UHi})*XjmZ zJ`(V!prwNps_qnLKQg88>B^#8X5FC&%cDV2HA!r;OCtPeHJ#-(&zck+=!DX7w*~BE z4C9*JK+Hw<{T##`Z$sMI__BZX^?=2z1KHj)t;n&fPMZBpTn}S9yN#EYAU6}?NRa(Bz~cz%DGqM1{j33CW# z=lafchabVLTQg5UQnKbrWBP5fyE^CdPEC($WJA#yDe!X!0$QP)9RQV%kGRUjud(sw zem6CkbR5&M^f!$RfL4ZnycO7Z*gK;;) zNE%5R1=JT?=B%x_kn?|Xs&?G4&yFK`RzVLUc)R*_IYXM8J8D$`#B{GI_m4A6DpRfxR&vA_doU6EBu zEfAo6fy9&$w`_Sep^*H{!EhNtYY|f^2DR9Rw7jX7mVH$^A6I_`!e*>q>&+W@@7>GB zuz#y&9D@yPeWdJ<#a45!o}IEG(am18&Z=rK4vnr&r=2=WPRhHXn2kplJTFYatw7>$ z2KaiheE<&wu>r7)r2i?iHu*VWl>M5u@0hj60onlG#u(%|z}qk-VKz(PWm7wmsrmn!F_tiQ?;498}C=`jA=92w(a&GvNV6&;_80CarsYK;>u+C zi^lg&(SZTFVRscmv;4$Y;nU+_z>CZ(3}eQoLAuzmBC2AtS|*Nox^rAXAcY1eWfF30(;?U~`cT1f5#s7GAjZ+_G`t zQXhY?;iv}ROF!iKEC=u$Pz}>Vmt-tZW|1xr=RSE&_{>_MxK)F89wFs~)nkCP5$q2I zpdz4O28vH3{yZbmkWgTP$S+@I^Cx$H=E25O^KTsbqkD{O{%(E`E3hD#cnyMJ5T4Y-hJY)Y*EIWUV$FbapUZ#Xb!@`}=1jWmcmmk>|Ft`Ba z(>_YWL_r+pM%p1i(R}3C%DRBe66WpG!S#P& zVqT1MooQ+iy)dYLeiuR)Ub_(=(g;>p#~xN)eV7Ye%K;s&5-9aS0UfOq&iM{0pUf(& z(M95jU^W0)MEB?C_hxkGw@-97QK8u{JvdePq033ekH-eKeMR z#O@#U(HLPIJriR#i&&|d)&i72ChC8qM&URv7B9h&Z1H7s;^p#ZpA#iczm(0NY0%m< zH@GfO=X>iIqu#a!%#;`G2T!f$RuL;5n8oVHVs~T=AjcZoF5AB3h~DN<=}XAuHG7$` zNXHi))08N6?KuPNF{}cH(~*eVyQ`s1TwJ%fSOLEPC=d{HE&qXF{ zyW>RZ%?Fb7ZOEPB5R&h{7UY%Eh4YzI&=Lx>>|J%`|yFE6_11m-ZY=Y=3{M9k5??pO5LSPvN4# zy;jDzM?N!}?s+nnHn_DijMACIq2sV}HzsrtlDU}QXNfRmv*OA$I$i$0D)S2?CKu)J&dts^G_61C> z6Z^k`$&fmBZ=in(q?oVEeK?hta4ep+b}zsg$X2R@@U)zvke@3ZMK`6inX6p19mu&R zS(_oPwtWFp2vv7|5T?xf#!Mh}y^H3`+}rH>YSR}WCq_AWXFrpr-F4+l)h-d~Fk^<<$t}`Iy^F1*U)1wl83+Qet!rrhIq-obG*} zF?Gq$sxUPpe|Hs_R@=USsZ5E^F_=me;9=HJ=}AoY@Y8DBA7iR~%5)CFRCy3+>|Ks> zIS$su)ABm>lG}DWruDWjU`i?5IR;ZQ0-c-XD0&i8%rdCws?C^I+rEIQjoHpIkUA}_ zqFFaBsgQrKg!IzSSJw(SYt3Fj6H}sd44hU8i_>I3C;9O*Z^uscwl81`DbYCwQovM|f^<+pXUNxmKUdRzA! zyn5RoW9n0Wa|om!g_k%>O|{3SojkPK>c?PG%5Dw;lR$W|vtVBOv(8(&XSL;z0d*m@ z*%wY5ewy4kBRo<6@-*VI%F;@e7XEj_#b1g&^RE*dC9M3<2`BJz_O|wiKjZd42d?k3 z3T2nXdsGm&W9S412a~fyCV%Z*OOGSD4ZioU@E;gOFX{m_8nE5d1MDry+!lLEvbkgq zyO;g@p(ILTJzP~TyA}!12Y1;e6-DtQDUwpPJpKD5Pv2fH-(UXnVeH9^0Ltsr_g_y6 z8zlZ!5^p*h%4`>E~A|wZqQ^KUPX(@Z<4&z$?6cF)CmWg@1RHdi&z7O8w8& z?%$MqrT$mEs??UA@#(J1J$(9}DZ`sLubsN~*wcHPC@6ednYUlQ|MVhh8Vaw9UB7;R z`R!#q5eH5fX;1(7@sb*>QNjd$(njDEPrv``^y|xC8-+?)ijcnH-*0myy%RzEMDpif zYlMT4nXo~j$0fq@q(uyo$aWH7qL4P;Phuly zP74>7sVXTVjLBwI3kp?DItMUNHB>PT25EzcNSss+HAE_#l!>mWZVKr8m9C!dIr@F3 zdye{~&*d#?q76hc6y0Id9Oz3E;NF?82oR!hQ9T6hy(BhjGk=n`QSZ^_vDs|!D^4d( zXkY^ZXVI@%1kAehz4``3S6YM?d~HcszI{oUf@{5eZz+BVVtLMf;P=2=(iosxzsZv} z7H!F+I^qfF`a#d*Q*doG;7wN@15{Jc>0arj-bvr0%fiRYx6!Xze+4lJ>-E@QDJP_+QWZbUGjG14^ZlTEXX=A(8t7j7jaFq-U!q}Swl{f662fbe znw*otJ>DAtmm#g5>Ak^gp{#wr_XZcxEx1Qa{B9B(IRh_Z^vAewaCi;S-1k#lceYFQ zdY|jwKg~7qfsish1nj*eHtI515oG+6d^c!~q-=``J%2d{R~$(7kIAE2X-7WRO7lv6 zW%tnbqxCi9j;_2%ZN0}g_py_!%B|$S^3#gelg4Gc>*x8li+txhj>ZdPzVm8yWt`L% zjqas!(`rV&b#|jwRueArIPEDKljc=cH@b&yGV!3@D|6V;C~I0r4dbTEJQ>>rd$b#? z`@-S+oPRRy!JGywZeOcoMS@1Z))q@^HUM9X>*|_m%7qob-KmQhTa`VFEeIK+qo?!F zGm$xunUeuVNy7Q2|K|J#nOEdQXGvREW>z#R)3|9<#v?5^rYT|hDVuz47(S)UCC%ls z{3M_c3HJ_%xs&#jr?^6CU4yl(4&)M&n6=Krfqw#Y>DSub5GHQc*%Z&jS6+H1eBrVq zz^gG|Es{x;Gyx7-1(#-t0u|Q!3AOGPmUuBTd3IRirAAt0UblEL2A7;Tp_YtUTeuN0 z7fGjNI;H8xHB`ts7bo5B`r-fxAMR58(C7+^Ze(=yT$AmLBM1#|=32{h1JuV3F*}HP z(|-#RBfjQ-c7*Dy%R!-(N*Gq>B7`D0m1E!q_roQ?TwH1;)1*kbxWXIBhilHOjDvF0 zugqF}<6zPC?oT|dkwQy14z*DsQ{wPw;$Z=ejISQeJL|3lZ9OA6yFyW3F>y25G|F_n zLADhA`91MCxbwGfZN^AJD2x*aJV{t`Ab-tO_V9^lp?qu@)2cjK?9~2bo(6X~PZkqA z6zYIZijT+ji}Co*3XHQy<6nnHR57p~9i94LLt)6(91h)iuH!JG_5cz?O7~zf;^77w z#v#Xgu&9pXv2=YW$=e0#Umwl019I#pMN*@paB^p!jiIIp{(vee3PQN>P?hv<5`Wt` zGa;h7t7GzP6AfzDuuS@tPtUXek4bK;5bOtN1$ZBX_xj1edyFhyVpG;(t6!|Ek1LTJl`VB`wlU5~N7J6sb#$&t&Xbd>VUo zHbv59WD`0*9SN34c`C#+|2mEE>twp+F5OjrNhv|>Q7hsh^yQU&31Z=lpR{%3MZ#^9Y7>4ay_o@kBcWOqSq~dZioMPcFq+1nZ66iZ~iMk24 zeY2x_E!~YQ+X!tWrXY=_LeFjlXSWbnz|lrT|LmO|Fv4SIX0#XDwVj=04rS)*l?4%s zm11Cn#JFm2+}PPa%N6OV5`R)3quMGRJaKc`_Auz;5>l_rRS2$m6zCb2mu8t(N2Fet zGwFM1={dfxJv`yXxIUAcbk7@c-;K`-?y^MG$5@R7VXWt6XEGRYOVk>FI%2*rG+AY;(v~)}n_#s&7XoU&=G=EAxb8=xC?uViE z2s<5}N9%#bovKjx40mELouAmiC?0pno!SG$ky7yWO_>USvN4;(o z^=^@@h}xF;_ZUk6DFAx;U(x5iRGHFo=yZf`8-GS49n|hL^0Kkjx9pzz zibPF`iH}iUWFDgZtol4q_1O>53h=rF#ZLwv1V}U`9fUJIPaQ;UZ58>L)(r-+*09j? zF|89U_r?f59|1boP`lk?t*sFCK5W(Pkl8Q{?@gV1zCYM16nSURv7Nv*oOk1~g0m_C z^)Uvn%9*K81Al+Oz;^?*0=z7d`E!9cT7XW(o$#uKjcL_`mf*G>FO~|)uQe5J7BrVJ zwQi<&TcK9>)TrvK_<`jKL9?2v_i^j~oiCq3w~c!>`!QI?R>d5&KNnh^&Pq6>4Z=g; z)rMXRxdE}A2xo%br4Si(^NSGAQFE(<8s04p8gJukS${V_>9z^q-8ihk8%ofB48Fl) zxZ5)JitPyBD#KXJ=@xK-S)9Aw?Xn>1Fzx2M{f>ak_(t|VgIl*>H>(EQ@ZAl>3c$Xk z8pi@tk37|Ic`LlwkfuYd=6Mz}u4e90NQk5w#w?@!{Di(J)^J8l4T=S}xl^l@$@udltut$fmQF z{kXyS=;rM9UOkCkg*n=aTl6zL>C|$tRTLO3W>7ccE7RD)0jDUxa*AUlXLy{WXxsZ1 z>zMDxW(9Ly(uF6V2SXdSh`EvZeUFVL($NBVo_~w}`U_jr(<6gZ5W_7)JF}R=gx1V{ z1w%40ZG#alcL$QYCBA~BD%rs?)~gcppXG#yR<_*$tpG1e+Hef;X^`Og$@@~28*Wjs zSCZ;sPuUCU!yF?U_VvE~*Zp%`mR-yN`5}^vUMT%}1pN_<*^AB!=INc1hyJ_By%e^+ z1P_8#9X#cKi;S=T1v5^D)RQ3w6So-p1kv1=U3?ZNm%t2D1b^hV5x&o_P;N1hrCB74 z4`4CCbZ<`p-{Q>8@F|IN$sXcM{(g!ti4UnIwd7t0$U&nXiL7E(eXN(rhkp)y`18x< zn918 zMgTnlc>QD)_AiUc{W*=l(jELeKgal|I*c&>cc6@~Mt+{C3qvDmCEU|j>B85a zKYn=ONfgeU_CNit{qOei^6!^cFoA}lbHm@hzW5hP0+Ut@N(iPv55N9n_~qpO>M)k-(_^?@GXNvf*KY z&1`jzvlOWYWx9|qK^GZ}U*cWfB2{K&TyOXjB&eSJIB^tUm;h`!a*S(LZ}IXR)q7e2 zL|Hh_${^4&gPjIwBIoaEeTs&Tf5Q5zC*}H#U?@aO4b(huqnRVf`j* zPVHZfdZM=j_2cXw5)(+yd5J!n;bG zXvZl`nD@^`+J!K!EbI*%cVc*dd-V_tD#{x*ZGT$j@3(Ht95Irx$mnW?QRT)B3$8e> zc`d1#GBy*#%kCWlCaS6i@dr z6Mz1bXYV8e#c*;UD{2X<`!cCDj1_5fUZ>3%X~fOO1+c@0<1I`4Rz zH5o*yyr8(CC{Mzt3H;hCEAD-Cf@vkYII`~DTSAtyN(xMmr9RE5kIOxqjUbraLKlYN&yn=dBf^cbx6ZI*rzsWr7Vq<=O- zoQ~ASs3#z`k#7f58(AMmsxLZx9=*+&st&wd6%YmO)MHjV<=ftuYky@uuP=u}Gi%)w`f^BGaPmoQxtdu(`n9NI*Sd4% zcr|4hO2qp2_QcLybf1+t$NF*<8<;cWhZ>bTF}S}YlsY2~#ijmS_Ivf{&~>>LVBpCU zjqA$IhPg(Aay}mul@r}+_e;A262JZKFfQrtPdV%= z6%J^?9JIMDHE`IkN~@R>BhruRG*dN_DUIF!QB#mtdeTt8k3ylKqJNZ8+5>rVj89Ti z>BV&==@_FH(zql|J#+p$kVK&L)!dKyQc)^w&-hT>P+Iv=+>U#$_KqxKj(fZ zmXx$=@mqW-ZYZyOC~ig{_)sjt`r`DrO9VTH+%N<1Er3*WUIS9I&V?#>|5st}nnTfa z|EsWYni&+w8*l!+ihsG+OSoHrHnSh`H^~RK>)`p?UH`Z7w_PJ7m8T+bG~3&0orc_| z5r$MO)oMd%hfKhkrJ7D?NgQyM^4vj6pgR=z*^` zzh_Q=N-q<5nm_%_hriRyA84?THvb7jzm9zP@UP*o{wU}QVSg&VJz>(fB#7T3%m=|7 z!99|lNFbG6zJA|LV%y4q$ZG}n$&%OB23or1ap8p~6!@=k1aOEa-T5=6*NLrf`34wr@|nM9K_XQl+2y@#kZbGNOCc$t9lcXTu6nHFN28=T+{!Up4oi7 zJ0--IG$xG?U8-xjn%z`$s(nq*FLP8EWSmhQI10Z)bycJ-O#U{VR4W^QV|2r0H9aLP zAuiz5oPM9s(Vi;B8MtF=GlU!`6;`~G@Lb4eyr(AX(SKvI<^GP)pNIXNJuIaoQ$4o4 zBVgJQ`J?DvU_TA^B|tAr0Nq7ZH~*V>9fG|~TCmdHg%n9*;j~6HQ6pRF|(n zU;WOY--0xG{*$2Zrp+`TM|MCTDdV;Fe+2rC)#Wz3ev>$#V|{J)ISVMte~TW(5kREm zVlyC$E`R2^RzGU;G3!hf`1kMr@DX#yplx$?g|5o^{`jZw(iAm6MbH#oPx-@lTey_z z(MB%Sl#N`9pud$%Ib|c4BIa%7Qcl^(rSRfgxs+2jaw(kHRxag~ja-V2x|K^gC32Z7 zaI029E}ak5xGS}@W*QGw^}9)IYh-w`>OR?}MhiyQF=_7q1tIXjPiA!S9{I_l<=^;n~`SO zTIR-VhzhQ@r@?oQv=JHW^qxsM6H`~9yR|m&4lOvUiF;~)VV7P>vp!(kp1TxfTseR9 zaWSQ_+oeM6@nCp#nENw`g+f`eH${KOv)RL~3$D)KjoW91fbI5?)#N{y_eq|*o>19W zEbWEdNy;q{$M5Xe_MIJH%JLP)_@*6nZ*TdgXgj@^)AzFcu^w7&lr%l8wH_WfZkirm zzB4CQOZN;ii(9O3dA+e5FHNGCuK%Umcf8GWz2BUiXyF#=UpU{xTj9f|{MWu(H9`DM zHurx&=dhQd8fz1`f;9%@2Lm%WG?Q^5C6|D{3j|qL1BRomyV_a@TI;HH)LmDtR$E(Z ztF5gq?$)|zUAPqmCoU?Yf(jz;S<3G~TgBPpz=0xF!97UA9wCr~B>o4ZDaBEg02%N5 z@c7(ZZbI^T_+HLU?!6Blm$6R^CVxQgvU~UL!-o%B*^AOYg#TPqq19>$fjr6677)#; z)9GyORZpHgdBK7OR`#OO($X{<4MW;gBqt{m0(p|BEs&m`o|>A92k{`#GvrC0cn}Zb zL7->IlRWVt9>jw{&yXj1;z2x!2k99?AW!ndgLn`R(lbDw==E*cMJhj#7S)vjH;DdaitzD!+ZK$K0_HqaFWR{+{1ubK2+k2&V5g_t5;%!72UQ9rQk-r&EG%+vU3(~tA{3#{=9Q_hU+ z!sxiTgint4EysuH8n{QEjVzjCC`Cki7J(w<;vegHum@< z^u0+?F+3$f8Rp}IfxH3K;GQ^;$L6)Cju`X_1&yKo3>$BURNePJ-wNxkLKN}t$sKpKRqNQCxeVh9qsL* zqlL7DpIfgcwbh(Lri6ix=4pPYdi`_YB=3dHz|g`OTSnG#@Q< z?ft66pq$BLH~s7V`}b^yO=Y`-=4)lpmUP3r`*qiMmih^r_5crpFH`9P`qMf;xY+W@!}0 z$HJArYpNkxYc}&tyQ!sPY47hB&7JYaaGJm}xz%WdX6Qr4mp|Gi#@E(#3azwi>=Fb$vAavgptEvdl4=Dl?_k#m z9%y$$`08kRsd~N{ z0)gOnTE1;((e(urfdOn-;#mwKLtO83*Tct7T=l5p6=C64w_pfsTXRzpUU7IZ&&==a zTC74A-iSr;sLbo+@P3Hv(Mlnll*eYaCHkjfv(dr+e861>x4l)%vVlZlRPyr>;)qhG z6|?p6SC_9wFskXR7Q1ZdBgLYD(^Dre$-_UW)@yuz{Igg9(Q*~OI#OCFyAc-l;!Uob z&3wcYkwBdyn+a$}yRO>zCOgC>%3|6@iCV5WTx4KXLV|QF>FFB}506@6Jpon?{H|jl zt=iVkki%*DckF{{;QuY3JZv9Mz*^MzG-|L^T^|>D=i7jC zor0=haQHR}hkuiUL0P`xiz+&WF!iDErpqc(7CMydQM(}&ql*8 z!@Gta#}_}J)E-OM5nWJXw&3`mS6rYy9i)iq)=6`TmSGzgme@;F&jNPx!9|~%_j!qE z@|{ML{K3f5qve6zTvt(Ol|kiuQE_pWcKPA%%8<6Uw#)m`>zf{?@=sA;+JsUY8g*7z zT{=Ds%mbya@Hn8B`jlthzq-?}u9c~k<+Z_S6g

NHOcHu0{`f^8-WQ32;Dr*_GQAo{hUIlm^CKm*Xs7UY2o$68K8X~Nm?bx zON1V9I1~a_AjTg^m!p_ERL)Y5thMsJ zc(MBVs=h1@88BoCtZc1p>z%Nxev&ZidUXNFBkr05Yg7eFL9g_c!*bAJv@GbG5k8Z8 zkInZ%@Mq7{gSn4D;2MQiHGVkkLN8dM%b7~wlymg!YRm62YcrCcjHBSShhVw8w6c#a z82ez?u1yGo=)EO$e3#)P-;Q*-4KghR1+yO)-Wgf%c|Ya4l@e+!@awZw3|HVirlvA# zO3G)djC_2D#|K;0I`uoiu?l$|7YWPw*%$e{Ca|dM>L#l0Zfux#eeqY_8iyt}c0}O; zID8KCx*nD7HWgM?3*Bie%gfj*G>ymyJxe?F6stpp)DP9+5b>4j=1X&+gf9o>k>+Hkq=n2wzjuh%4P@i&8we< zhK9CpCWB=6mZ4YyLfv(E#ldWhpE*93;PLuX6zmQBfmPY6Jfy2T zt{^}=++XHuU$Y6kM=clF@9M}w` z)ViF}Hn@Yjf&eA@`B<%v3tcH7%zRVH9xbqpi5lz8P-s{`kktDO)HIlcTUv6==c{<+ zBg^$f7fhgh{2&nj&UpznM>1Ql>#C|ot!KF0&asW*vW#D>0v8@huVi*|xO23(W<6F> z9_2`k1m60|go3Tk#(wnJgX5V97+pk(~g}`fzXUY`{3dFj{g10_0%6M9U^N3HTj;pHGo?vnxe{oV3Pv+sevnQaA|iGT%YAVe-@un-@Ag z9xk>|PELM+M1Iwust;y2YGH|G83z8^Mbt`9X(P(>aJzAnI`whO3!JngE@b;%24%vC z6!{FOwDbsE+;{ErfODZK5GWA|yocpmeRx{A{;(Wp zIs@r0#+MtyMK(Ac5(LYtN9kJ;K6r38eR&gP?@5J?-CZw^_*MCmjZ2QLtdKm2JYu*y zE84GWv?+MbnSFWbywh4~zpw#H0O(KBI}nDzqjOx0bK>P8fH2PMfKh6hO%91X|D2y{ zLMgF_6wXS4=S4$dV>q%EuB9H}(YZeTl;7U7>7tl8e;vDA^!|#Vpx#^na$n75-51FN zl==SqImtM_yC7=lK6PDm$T6R*&2n~qpL_G`BqSW}-qG5c6+`sW+IlSCyx&T>=@X|p zx)!jYZ1>R-_^cw?mp0car|Z&TCMF?~+XSqSXcHr*iQRO}kG5aVO=;906J7M2Ki=m< z;-!IDufgg4vg0IB0bD7U0_n}IFWP)`ah(hThhB&?O%SSHqtDjjtl0kqqCnRgTJ1*< zg3&e95Xf{70!7^<_{xn3d+iT4yMc@_++vW8><>DrpGg?+yujg&*O9sO_la9KwZy|f zV}jZ?s?`*RtuDK@%5gRH}8Tt9_h z+u4ZGdRZ2Wn9n;n)%^E?kQc`ZDm`JWZjPULkwpJim%wjuZk&Vn(Y4M{jSC}hY;(DW z8OJ9fou4fpCvyoldBleqy0S1bwlp-%txwb(8dqi$P3)=!+k497AQXmoURE}oVa zomfGFSop2wNYOGJAC=-F`>hw9z_x7G+F4jwfGn3;ry|xchDss=gdq-oX4u75M5lfC zzbM(T*&61I$Pf_Hc{SE1;YZSh5y;aCn6<%&?lGxnY7{Z|Wm5{ReBU!^989zA-8PORT%nPP;c_y^j~Tw|Gw+hTKz&y>^8mRRlGa*?@OU;C+5}+g)~y**85yW$8|&}pShV?=hD8)(oRlILAjOX zw(SN83To#RiAXLl$)3?suhZiLwSqf%qB1hzF`!6piePH?lG7DJfNMrj1eA=u%`w#Q zP_p@5@bTqyH=M;Ct7N#G@}rM`5zsYo5KgJUwk zk062aSjsBIZoYHp&P;P;0+;0{n^@KLt*si=W3&d(vSw8*Z#I=ROBg*mbR68r{T5C+ zO1z;|Vd`G236^V%7jXBPEh{Ul<>>e!+LB*rHDWgWc-R5V=0|f|Ym15fvPb+?5s4nt zuEAE*(>Bwoz-(zQF2UcmDTXe4xq*nWyt4v#d3oG_>-8ab2Deoc23WtP-ozyCtF5bB0WoT8wpAwn z>L2{%J&meDJe-P$!Dz?9vqVJsHrl+;Wh3To?t@{hnvU_$ml)&55|ui=Q~favvHX2; zi;8M~g|yV^yNJX&h=cZLI-=eSp9q=fRL6=zsFi@DA9e2NbTqxCbCzb+UjJKjtBx{V zuE9k*SYuBAKJMQ$wiCQhRKL5zN@Z2PBlf>#AA2)UH)JK8JxqWe{d)JutK)4l$e=K$ z3K?D3_ub|%;FIgWx6>%*8r}hza0r)<;X|?6&h4J_p$9C#=}@Q_#@Py!vDRK4p&m?*$Eq86_nrmKN%!Y zSIPN5@h-UhSDvR7!ZS}XPurWFs{b7mqMYZWw~Z{6@Va&l_ z9D3$5z4`M1(->E?a32g9%}GvO{a>BRt3vu>7(POU!!4*J|F~<7W`&sBOflU;2jg5} ze>R+#kHo=MBs~cxg#KK=C6kP$#|H~(p*lH;?SJpew}n%=EJGN71ZQgQY9wakBviMd z_2tdQLBUI)NHWYlqCXv$a`?01f(T=`ZO@FYkN}~*_aqmBOUs%$ko6Y&a-1L8@h8Ao zGPOh7>F)Z}QFe!y{3rfMKpklDJ_`4rM6}}~C&hU1(%? z-)77EL^HOjwRwRbgJ9eXdm29lMixBng}(|WShMN}@&d@3S{-Yf(HbU{SgZ2WuO z_MSjtAJo57nXPIyzt^QbS2>V5Oq<%feq9qqei+BpuR4b@!As_@f??w+;RfE|Qy?{M z1lv#?JLd1oaaSk&{~rWGQ!mW>q44GPzc-5AxETR92Vn`x;2W)0F=-ThXygJBumK>T zAUoJ!)7fP(UXxk+9&m#UYin;DR1XZGrg}tzPb>Qni6jN*25G^>!I#)WExu%xC%=h4 z|GE9 za+O66v%_36fTwL_-WxUPb)3DTvY8_b4@dyDo>rDJI$s0wT_*)e+@=Tx?lCgbHIuQ= zQ`_%yu+F#crd}^0h>p(x17kIc-MCG&+$~@40E7rH0J~7(zVOAmE1e*SPK(fMC~|aZ zbVYlHU3Gptb8A;f+(>Ib5?0Qc!p~1C*rF7{_#cWdZZ*GOduwlxd-!;>nHdx^%PT7* z0G+swLp;CZ26Sh^a?>ZXvPY#|gl|_&0BW(xJ%RShsdAs@x~<1-yng-K!0;3i6dZgv zw-S^Q0fwx;%!=t9pg^wO1QkT>AvhIKQna`XW+yi82q5{+r_igU zscC!tx(%=30GW5SbN_cOyynW2-5Avh*R51lD{GUC&yYUh&>7Mh02)*zPLv+Lp;)t?1`Y*@wtPCBnrs-G+(z4kN?mu zgS60@_-_H*POY1~E!;v&XZ=%Cl8hu3?pZ!lA^){3ADlsZ?I$ben47M(?F-qKA=L{awye5yOtUCDc|m z-XKDie4wmPyX(F_Sr-V|=SqD)TkwUwjwfq3#v>&??q1J%;P~?atCyKorBt}BN9|8c zP_UfNZQKcx0btgE_xW2r%tutCTMT8nLP8#1G)sVy^!Xf07xiQmPPPmDX|SMOk{FJ_ zorT{5Ow0IxS}~TJd7Sdn%i(-yi4_ou@I})GI19_bHx18!fxNz6B=n*c102zi9eUg4 z5@Vwsc%e(N>+ z<554!j#ZF@+G!@c9GvOF3Tel}^71l(;V2^j$Zobh4lL7$6x8T{9EI{zGZWeRjXO{R zwG7ha8Fe`3n6ICo(T1+Lc!25yQqtJghC6#`*z)w`D4}uydH@~UF8^i)!57)}v*>BLuuK94T>p9!$KG*?J3s zRQ)0r3JhQh-TPvf>0H8dJ_3U5tbYy!=@AB64o;v}NbB~G{#1oh&r;6JP|o@!NMcPM z2%T*Mm`A(JMUGJ-r3>^x0Pwxm*jkH`3ox)-w{BesO#x=s1JW&#?5Io$2{IYvz9LBc zLsYa~XKLU=q)3-_fbP(7^kk~#0$p7GokPLzJXQ%opnVX`t&wjwGc~m}Z3N(5O+cLYY}TUM$yiu^n0BXzHIyB#mZD)It~G|t{t`#?DJft^ zH1HxG+ex4G%qXMNG}sXU){>sWrl=A$H8m$ECl&8WgEqvIB-z*gZ~gtrFg9CmHT@du z;yrok%&3x*5}HO827W;6<7CB=PwSQ?;r;vfiHY5yv(rE=$Q6`$`nOEV20#HmkZWu_ z`WRUVyta>z&)b=^ZC%hu7%Z^lpI`;$RH3)9FS-J6d4m;vBRF=HedG5du=ipq(8LQS z<_zK%I-IA_t8XDW1}f#`5J3G5i$JRgXb;y>0UFsCu)v+WqDrf!%-4Se56-z!oykd&= z0-wQimRRf@huqNR8UPQPsP?78^_Nv$fWlj!+c-D?bh8g!%P4eq0)Qf7Wj8lBF0&rm z<_OS6M4JO7;!pxmhUuGrW_X`LE7ZunXI>jR*~tdt&w%k8B!DNjCkW|CZU?YYtjytu zFX<__K#jk(ynmxUtruM{M=$Lxy3uRlTr3BET6flx2-G#(UJkw5H3P7x2P z_5pH4EXeG(I?T)N+Iwyb9)fO;>OqnAL34^)pTdwEiI}1vv~@uH764`!!8z?9St=mJ z?mkha;fsm~7mHwlOyXqJeQjm9n4OLejn{x9x84h0hTd89$r#yrU`%y?LYf#G)3{y- zX<--pv?(%P$xH7sIVSb+hN!D)0sGhVsO+<-%zY987cV2??w(>p`2aZW98{ALGC4 zwlIIFf~9o3)3@ITMjl0CF{heZu>Vh|;8O;&Yubo9dMl)i#54G32@ zt{xlHk;L4ZQ9`>}3rbM1D1I1<`puc^kb$-7iT`}IV%*C2N0Y$6>8Yexh@GTBr39ePg_6#~0@<;rz9Vi=$#yJvs8`%-VY$f(US zo(4tcN=Hk^>k1-BxvgTKk!Psp=noZGqN5Wqzeri%H)3&a#+o83*)%dN58!6`gTQ;h z9|&q5^Vqwbt1Lr{LK@y-^KSw-_8?@{Fp@U1xz1o6pf^UFUpFAYn^2BOlMcNNie$Gs z14}!ktG8<#40Ip>nC*LE5!BD`+E(4$^<@)e8bo=w#&C0+^~|@$@&D0Ow(Y~||5mz) z1iHV+Q^>H`!=0A;vOEqpK@Z((xQI0&yz2bYNaM&^jb`#dmp=c6?KI}SiK^Z9OAy)= zfQ!KI-I2}Mg8P?xBIX^?e-zHW0>2{gvdVRF2Lwe>GIc#lAd~s;g22J`G3^l*ozc#= z$==3bt?DL5^X53{Z#w@|Qj5iRj^H#sW0Wd>0aB}6P$rTqke z6G&K>Hjk&Y(T+i)QNe!glZABU{>tj|O+ycmrvP{xWEMwjl^2(__2R<1Qsae0Uj@mS z?~DTrgnVHX~KWbG}WWj(zGYp_)R(x2}CZo`xl;juU;GL&ylKur8;FPj)Gy#iO_U0<{{bJVAO zbY*Ft6R{pCp>pG|ys%g7Eqs8#?PpoBMOG0HSmM6)P)~p*?C2~^PNFMH;0rdMWY`sX6W!Twt83XxwQ-m6awcCi6`i;a+tjg32qpfm1sGvNv|R{z~7)_`byJ@jCD ziJu}!=GRNOICOgRTq7Ao)4Jo3u3i1cQc;nC4$2R9vYHL5_w(rBZ3#lqCWJ2B1zu)p zmN;Y>g)6sK9GdREwTij!WZIJlYLmIQz8j_r2o4#553;+ynvbA&9D5*Ox!}7oa`b4M zc|0YeB_v(7)D}Q`6D)#29f2DS>fJhW%ZA3@K!siPsoC<#)Zd%b&r z&d`mucQ^h^?cZhk-biP>9b0`AGs3*mq-M*`$5#Ss8LH+f=yW6Tx&8oO>*`pgjB?N) z-qlOPFMgzvZSx<;=b{e`lK790oBK`Gf2@f&PE%Yva*u?v2M$|@eg*ug#Edh)icU_m zGNd&U+;U%Z?fU%rvu5O@C0?7_&r}jA@^rSWf6u&=*q?@R?HQkw%wVNlwiJyFRR4$c zm2)2y_;M2U&q_mNBFCs?{=J^0mdGW*YvcaqWk}FBYQr_jr0K?g$9lae8r5QG6BHTF zMdpVjN&qqg{;b}qBPE4$-}RiEwIBY!*HguA@>9hP&{%bo$FW7DUx)sFfV%GHN#pFc ziipp9nyEjK>hIfb&$$Se*C&p`#ee+o^_L3SDvnHw zT+WX(*EHkEL;pVdM_jzCN9TVPeu3A+{_OKcK{q=Q0Z#0wf(y%*$koR1i(A3?wnk*B zZ;{!~c;KD1IHdCH@9QLs(H1%!?=Mz_(Bf+PRb-Ml6qTMb#j(i`q>BMeqRPo_mg*6) z*#CBPA0$Lf3D!j>x*V=-f|r4y!Dc$Yb>li8fe^@mf}=OYID)b(9v&I-+?cH6wiCr)(_D*($G;PWuY#U7;Ju(5vY_O0xouHkoYx4>zpLQ;27OnVHK?|>HZ;pf&Hyw- zUPj=6zD95}a2H=yvJnW3q2=hH!gCTV>qqrLRB9zg9N2 zv~-mD2G_n3Ltpe+ z6v~IxExlZShz1k8?=G`4>Xf_fd{oiCg9|kwl6rc8zs4cv5Ib9@_=4^lU$l^-NU;1( z7)dwwlH@abUirTb49rb5j&bAHT;*dk8`$RnAeVthb>PY2msG$QFofLW{2xi5;CgI# zJ_qa;zZu|>6*E;g8ZCV?e8+1chqZ$Wqe@!ULob?*nE8qPRCUxn>we3{;o{a_R-HP; zX7f?<)IiAd_+^4tiP^TeBhb_*iMUTnS{vK;!(*oDE^7?lO|$$G`?w_}74+2C3Ky-=#+=2P_ zAEzsYW1~4Q->BNy+PcnsRH*=Us1^KR;tgoLs2a8p7kid2rLA0{fgf0YeR^~6wtu0h z$H#rE!x9`4p!S%`%fiA>o_J?xuYsijd(CzR^b!r(qE(9kovTWcl+WP?+ZiDVRq*iBp>g|bp>VV|4WUx6z`dz(!8KP1&DIEzk>D z4=KSx^K~&GV05cT*Ha)lbi{urj=}Mim5O%!wKNG4k=l1J2LDLDT$qGY{13+=r@!x& z5=agX3;-@TZj_zZrc^tb>-z%%*F$J2;h0j5zWx39Vvl~g*4Wv6t_L#HA1$ME2JB1y ztJL+>`>vwWOA$pw&m&Vk>`+cDy!6LtiMo_K*a5mUQ33w{ z2K_HQfMS3sVL~C0tdb&FX5g_0lB2;dJewGxI0LS7P^=vS98x;r%OJng_nb>@5NrJ3 zXDG1Ku?1;kb`y-<*$uiAYk-PeHq||$6LV9Y{H0DKVlouB-H&#pxP0dh(N7S3@wd@nW0I1`6 zRIADp2%o7n`S;$?c-KDv&VT0_5lB{`JhoSlN{b^5M!vq_8Y>U5^BMlEdWGo~U+w4f z0)VvOid;HG-DY)YL?wc#L_x)O9(lPyRE6|8E`CMx4_b1uqipr_20YoNgPhK;cXkf_ z+2Y6eoD{s|zrTJlW_xK)Bbr?Jm$6JJJLch{pLg)oVzJib@75Qhp*TXRGzzN!_c-F> ztOUZ~KX;mFxr_b3RUnfX^kMA&?xz-2P;Y%U)VrF@b+givgzIxnYJz*+XysGtzYnmy zT+Zb=wcN;m2;F7-e$>M|I-}C0bH5^A{lv)O7C-^dW8ji#3}K9|w(Q&k`1aBEn`>tb ziyz51`Uoqq&hk7Wn#svOUmOEMngp{yE~h{C$Xpx#m7z6NSekI;sS?fXM~t&SZ$1$W zubh9P`1jdaW>=y}nW9Pmume4dJNZNAr3e+HCIO&+Y2-(Uoq);lxKl%juS&nG(; zd|RRN7u~Ktae4(&#DT`7bCPDOUzk!;3xct$!L#iNq+<71peCL3UGlYMG8MY%7Nd_@ z@p|YIv?*?mL{xTe^7}81U}L&v+{77Jm#&$`^7Xz1+}ybitM6jinAKy*-t{_tt$lX9 zvUh#iJ-e>K$?=oo*CB_F^bJf*P1*RrvY!Ek?Z+zEOdu4|x)8~FSrMY_Vh5)~n==>d z*BNJ=x!3-?QDL?(-bV6~aS1&Adz5PGR||lNIU%?Zq+N{~ETVPu18ahEsDs+iR??sz zqa){y-j($J)b4-Fv0QE8!4j-*rn58a#}I1YCZs!G4iv;DHwmRt)NuoVRsyXT+wfAN zY2p{A8jtsQ%Cv(clpAo?W02?|tFfLaogquQ6WO}DXL2RIX-8P%AFICgbxWFXGY?ig zVBMUXLEdHfV%LW=J{)y%T=2B3Xmc{TiSX#`PVD@&T=sZFy0*UjmK47_HjLCN9ynA#qT5sD>ni| z)bFZ#XiR3Ydfg>1GFtvX1a^Rfw%f#yF0yF~K=GRJCIcOoA5j7?maafw>pX4edSG;) zO@d{rnIgw1yzl%25c(4$?y_lOk~qAGLetQwL%?j29$rZ{9Bkq+jLFFqUVTL&&lsx=-nsKQr z+1e@R;|(Abv<{;da^&me&Ok^C4X-3P3z&)IpY;r0^AmR*Ei~UP)t`#AonPMSGWH1T58dvj)g_0%h&&%pU90xKsf>z|Mt|312kDEC(%F! zvr-ugPBeaXp_k^niPGPIK#GPMY|5Svr;6w=rb$R78PCHm?kMXwiciFwZC|%OX;p#! zmLs&dacdjWMc|13zWmM&RGE5R*Ct)RRJ);z!!fGpZ-rP9QM) z`tS4yQx6K1#H>5+E@d^&A@7{U-Ws)Zqeo0$!NAkp@)tWdZnX&oWF$mgP4$iINi!#0 zL{Cr9j0-PqCu%1k7|N$BZO2;V=F(1GoU6G(aYFa*gjs+(Y(ffcK35RnTO}9q{h_bx zw}Dha4K7z1R3Vhn>>GN&aC?Qr@^?BjtSx=`a}68?^_k@dS)N?e%oYS2OXyHLW{9XG&e8VZZYJ|0>bG5&H!l9Jvm?qxH1y|8TYHIItjaA5 zY)*Do&h15hojz?KWCLf}a#~9&+k)|6-l4r1q}q>k&T2CIceeTz)4P3g{+yJ98#o1d zkjnau13-rTma)xpyzQgNl&RX*4^ZNz-e8vULtmN4C))?QHE_Z|kE}Z0Nu0u+3^g1U2Oz=(f)w=B z&}H~+0nAa{7i4Hc)+ z^oLPUP*kq5&##n7G4xsv4phwLS6&HjU=}mp<|xbGo8R{((W5RFwUqu%LiY zdyz^S?qVL0E&YAbwlJ|!eG+#xQHej-Qx1&|p+x`&M3ghPPQx2!KDuW|4|ri*L&M5w z{k0!L%`6qLX!MT@yFqBrzn+LG@cS^(nu@*stQqy)*__MLvVa-u@B5|Zt3co6r{kxS zQ)$@s|7UtcxF(EJq0*Av>BjL81?m&415EVWM zS?*~ol$J0N7o099trN;sd~?K_wwb-AR3cO)&bV%WUxq3C%g575PKLCIeM!;|&Vgt>#BpB1R4L1TN^;)oE zmU=#)*D()oQ~-d+K_AeL1(S@742Oh^5~h#?V5ubd78DOgn&{Q@(rvZ-(qs|o#|!?Rn|6Wa^jpc6&|Q@CG;KyJp|fS{Z1>ffPWuqRa(FvN@lo8cXaLNkM6(+k4Wxpy@$6{q z47)jo+uCX{Zy^`aIyzcm)cR>9D-iJVRmTFGo{xeW8@v(x|F4KV^*p<^Bpr;EMX{e|^(kaycxXD3AR<+NYU^`X6v(VjO z!Ux8d=9aYx;Eo+7zX1U|Az@6I<&Js(_mN6Sh&Kw0nVI`PlmYQx=6J+PwZeVxyNw$t&`TW_Hq&I`%9Wj1o_=qSi;L?7x)*@V+0h}}^^1)Dqxf-Z;Mm^QTzh!EgfSs0 zsRtlfGA`9rSNDC_YWDxa7;0U4QUG@9d9-T@pox65UNnkE&1(#{if(Idgg35t#UfpQ zY8Knw=Xb(?nx~d)gb{`Z+NEZFnFj}R3H%Tb513*ytoFe)*!*lUQj%{oQ4QFW8K8?k zyHouNG&CM?S*QY=0Q65`*$9zYlv>69WFVNi3V(6yg`^}tq>fF>a~nQ;J6Kd9-%P2K z<(VGtvoK&T93Hx-Ez#_;`8!mgA$zBC+{?==TEL{}LroQmNF^#bAb?)(^D{^gL3xAs z*>R(Q)3U1FFEY?>+}qfQW_@`b(Lx4f_)RwHiJjeMD8=*NbY@{A_@F_{6+0$xz%a{v z;P{SNf+i3KgsxWNVEQuZKA(e)voj5q#58D@fd;0VnAi=uX`lc8`wwWOzfkc;;)_{k zFdk#llP(8(_qE>pdyNponL5#_B8DqG-2tONm>UK_6|Z9#`JarRlcD6gvjxDze@p(x#oay7wE6uT4%4n@ zj9bQf((8MB&`N%P5O*b*$yzGiHr8eXty@+lR>riH6u_Gak_rA)i_$l;1k)5{bf@)T zu#Jl9COKdYa1`X`vdc}!F7;=xxdfG$dxC}x*o6cm@4-zehkQkP&-HbS1INXl0jSKC zJ*SKVK<6g_<-l&%_tFAXfu9j1Qka9oCar$MQSB`@r}XIMs46NAVO9 zuG5c^Blw%y47Wby!5EmHU}ba%-BtjX-Lh@P{G48QJXlp#)!n@X=EkhLQ>DDL@cKTV z_1zUfs~vEk>WpZTl%MX7K0Vo~w7tFk(Q52_ zz&=UZjW91=(!GO_eDT6{(OHRJ35<{0uOdiDNC*fbrQiWf31=qyC@>s)s&MJj!!dy( zpdMftLmVOh)8Iu?0i)mM`g*#2N`M{;j9L;x-}Ti%Yy*Ue6kuN|57>17yHryT=v-M^ zr3HFZi@o1K_i1FG=jJ`eblIe8Fkp-=^c~#EaoVLzj}h)HbaZqltbT!aT4K1{fk?sN z4(R6>f}i*5z|@2HKJhz$FH!;B`F9V55X8hKwo{_q+=VcB_AkKQ&X*B_PPWIN))rzj z_>zJK5zResZ|{oJ!zDo0AY_)BSzczWU|7uuzD=(NJai-B%B4%L%T+CTmP5OM3bHKo zyUFGxxu^&oQ3i&Fgmx|`3^N~s0h9;^l{TK49up2QLS;ExR@{l2d;^?h#M#YDmwqwB zt-u87(Mu4!^r8KTC~UxiJ_6Gw2sVSaQMLZ9k8~;+`_{mS3FF#OA#)5OQ#Q$a!)^XL zDJdz|Jw_9j5MXt8C`2XWk;Q=huAduDBNJeKu)qJ- zutu=`Y&%grgDu8NM|-QcXlwJ4xQRuCd6Cv`MYKRve7qo- zGy5!}5lGB+yZdPpdrhGaQ6=!-fYPRwxz?HdMsEfvAC5T&mG}qXJ~&SwB5z!}bnsR? zo12tnpYp|v7hoy@usvM*JbeY~zN~?iXn+?pNIZoPIxYJx$jSNfcO>i4EutG1Z_chx zKU`c!e_vFjzQ=XjD=Zt4y&l&&p*imd6e)fC8~Xy|y@En!H}GX7mOn`;h=hoLibsoIZF+t}_!DC;AxUWo?zDn^KTS6&Z@6#o^ zc?o=_L)`L{%DU+3aHM~Y`?R<-m$C3z>~9T4z8g7M+DjfLo)Jk6`Wg0-*sn174%ud; zBgOU6$L388{!_@!Ya_40|Fd^Ark9RR$9a?r1%C(4_@!?cWLP^QzAH0hd~mYR$hXC3jvC{jF&pv_ELNqcjsMgt2XAk>t+&zC9e z&h+RqQ9~}p$Gi6?$MdZzL{}d_d=y(0rXlSKyHaJACozuyv!0rL=}r-npQZX%eJk~i za<{P3c76_lQfV!roR9sOzt?P}O?`6ydnWPOfOT2)3`0+I`q}qA2^G?WJEIkLgj6>C z@l>x=IIXJ@P6ka&r`M>izlP`yB=z)4>3_d3IuUooASJprRk7|S$YVC}?lVfxRRE3% z+Pv(+vck|+ac1NDikOd8}8f z^)7v@;>ppA_~NuX1Nx>PJU?}%)5ZiGH7j=MTOP^B!{Z|b-RSM#?N^WA^vM;KP)~B| zFp`uwvJoYnT}edU?L72D#m&#M{ZcpL>%E@Y_Mb`Z%}Z%x^}65WiG!>&opC;P{;cbJ zJsFmltbILLb$tRW5Sw^E zQ{{NV2jm)^f;xo+vzqR)=J(_vHV-116A<|)t6P;S1A0vlEmU>6g_xmhgaR?YTW$(w z5oys;edro?xwJ)He?nYcq+KawJY}?eq-68D`h?L{R!X>Hm@oyyMUa-sMBpp79&K98 z8d3B$exv`0-oIk5$>kw$FLGM=Vp}oJy?$+YM-{;px4mphs1m`+FIH^6AUadoW+_rA zK|(K{BrBDfm&9TL!>&_?%tBC5qE028OiS>LQ3YWzZ|*XY;u7tji0Sny^kbB5o@oeVn2BxYUJ5| z{`{aKvz9sYLGbO{Y@1sKqoX}TEhLts7KBu6&8yR>Mc&pH1(B(|0oKTCyVaz@dy z!5b+g$S-f_f|l#XsSzYn%dOh6RZ68fZJ0{_@??{nE5Ec^W@}_3f4;sh4JD|-e$Tr< z{NgA2Q>4H2+bgx<-m9shHnPz@M0(E#H}!RdOLXQZ<0R+rEA_ws+M1fgl3>4S$``cO zLda^4#YRitch(XM{At@Tv)@;lD_vFwdEyrIv( zv7Z`qor=3O@GR4{%im})M5b*#m*Tc+=O=;4u!hndGuGaO#)PyE?Y&YU&y?i(wx-gz z{)v9=XvaLh{@L{>!`-{dugNaYET=xmXEdL5cY4r7W`0FO!;6DG+jnyvYA`#HTdg-3 zB8gsjh|M;x_&sgL5@%+m`ML=BqPq&M=Wh<#gBUUq3Z2rJIM9y*oy%fOLvpWJ=(Fc8 z`^X7ix}AD5mb3zsGr1PKr9LFXK!!3kD$QMaK7=ZGnAh7XY7gOO1lO9hDhAVZ8S2~| zwf*g_Y$a+-_qpt;)7JqrNysO-;5o(k6A?E(vdmd;=evsV59BP$Z{sBjUggR28CWy- zM!)GJCu^7YF4#K}Mcz?&aX)(Z-=9B_Bt&KdB^b^}baj+PpU<-8}tcX!14~RCNQ|st?cZ{ zL&5x5rGtP_x|P;NpJ_dGF5fJ63_|{vYvX6KZP)8=-roN;de80CSSMErd(jwC#j_`T zp|9P$%PVhRB1psBd8Xnjl(8-1B#(Eb)tvF|s@6n>vBpgsqo)B_eL+=};J^4ZE&Z;4 zgp==P_Bs5KRI&~U%Vj0^yU5DMH5I##D<0GGu^EPoeYUrpzefMm7IlS?n0D1sksY8O6z-)e)UiCZ11`R+{5TU^SDx-%HtkpO0< z$bM_namV?Y=F^)_f*)?~sc|OQLOhoBe0qx3aXHcwDFcF22R{j4RRs@?SlnBCr*udf zb;}>VI2ykh`RG30`r{^@TWqZ2fo5=_JLRZp_BMvQO#>KRJB$0^YhOLhou=u?V==re6%NyIs@`9Q< za;-6LxL83J{Vh){&lB~F?Pi)laesGN3iH``h=%sM3)1HmGBl0tF+EK}yGns`Ip~pt z+Ku*iOjC37lwGk&*GwH?s@}P>`7FNaF#r#&tR6)o-(Tl~@DM(*3E>_h@NpXC4R|#w zo&Az4xs1zg@VcDwCGh@rkjBD4w_Td{N8UwkGkiDYZm&jBkqHV4KK9!HRrTqy>nrcD zsHnGms1ls_#>F*m%Qe3_xoLti;SoMyAExH!&R0H413V8f?0qlZbP$GT6JoW)90Nta zo%&4mMJ7QIfCx{TGd#ZQR0?|R+w>6iSiV9w-*HlXIAVvzO?Ph$Y;FDFA~yN}*J*ZN zPNu$ym081Lk-mPu(f2f)iflzes)w_Uu4_8-&J)7m1kd7x<9{i*jvIdID3oe;wS8WO zelz;C;4B|8yqxa6g!;?c;boL6=*5xX1ZW{X9RCr1U)fNbpG>=E#%>S6)8oFs-*)mm zO2ewXrNsxvFo*(m0|3=Npinj7YZwTzuYUqmNc7>UUc8S?uye2ay>h`X1HQeSOuAm#tCMb-d?FW7<%pW36$8Z|6Q1 zT-gT}Eorn=uww2+^jy%+1IOdJiDleqy;jNG%*@A)6$kJo1OO4M^%MGC-`w0>U!Up# zwaX-T{({lC+Um|PhL;O#%;ZDzqf9$D!+8r1uao(g@@Q`L}81`$h?6y_oIr7i#g5vQvfo?Wiw$JYRsS% z{Ie_)3`;TUR2&2N8lXOS*&Zi{jsW-Q>FEJZ${x+P<#IfRuuO zs0>J_N=ghM($XLTk|H5UDBV{`B_;2{R@nshm&fT|Ugk7!* zT~uRJ6Z@|VjqUAlYg4FIfYJmXJYsqVhQ^zef#0FV!dS*KerjsUcE<1HdRZy3PJVPCYDZQ*eVhI)Yf)8@tyQsaYL)k41HdxOEx&&IHELe}>bVzyDJR0}s-}YUg(qy8A$1DFuV}eB1%Sl| z>%X3EX>Dce1$8WM2Z{xtoi7ZEYH4ZZ zJkt(drS#_mKuKvHFcuG>w3)om$gl==8dlOU#S-U*`N>IHw+NVJeke5+utE_co9T*Q z+l10(5B9vTjZ_6}(2XSjetkZFx_e4As9?%l_4!JB_cZ2%Q#l@#WN*_8oc`Xh< z8H;=V9G`=Opr9ZKdHFp5 zaNXf+EhKCpWs(oL8Qc?%aS3r722`fmD~ti`QqbuTb7=;nN#=g8))MUggFRW7EOm@F zop6WkJhJO+dB-g%zOb9`szJGvzLgbcAJ-pSwk3zNWwrEs)m4U`bQo<5^a)tQ0@o8M z%p@eH8xvCN3n>=2{(6UG8wM3qhMJkHDnNxA{`)jrGf5+r^ryIb}-_beb_8lY_pehLFx(2oRiKe!;4;}Z_R|5A1<*$7Htd(a4LoB~9>Yo$O|3GH{ z1fa=MqiRG)ryJ$OOG>zbq>&c=#CSSxXh+ZvF)+ViIf33p~b zSJwJqDp5)8DmQPEwO4X&*+z2RX!0@9@ko{G>`_owj`HXRGX(BxySxXyE4hj~dn42` z!P2PIH_SC_HNMge{?g|7m=0%gl~;9aR}6uvE18R`muL~xXlCCFeC4w+Humnr2N|}` z2Bbl*tO6$R{{Ftn2tbi0$M4;{*GZ#WZ1=v1xFu1v6tXxaB_)j1*(mq5X;T{;0BJK{ zzm{MN<~(=)JXya%sZ&t;BWGt@P(b?h$r5l;r}?u6{BHrI?>?CTSrov>yFVyh5EU&4 z;W@c^M(hzw3k#6b@xxex(gY*Y3Do=0HNbE)ZfBhDjY;2FS@A)^LRsGBo?X1=AKy~6 z6l&^$cFE#IkJb8)bM6Pt_dC85kL~e>nM=p2lzbg9)Rd)>}{UMm3LCrN_^w zvZQlNes!~xwnXF#=NCulbE`pn=`=YLGqYE_kKW}C(2s%y>ML}x{LgZ&x9CcPgY}MlG>i0Th=-<@l~ae#zPzmnwlob!TN)N5|{0=49ls z%t3lB&SB{Jr#L=~8?GT`zL2&Rb6GS3jF_FBJpv^uDe14$7#N*FY-h=y5zb#}8r^S+8ZrQI<021+;4c zv;c*NcSl#3H@4+ihYrR3{5&XKc0U~fjVZGB2Bq|yiS}Ta)D4X(pJ%R1D{UyvO}>`& zrF#6K3yUJT2oXt5eK0MAo)Fc(pVt4>|1wXbl(5MOiQ>b2G(tz1Y%Pz&G%(H94%pc6 zhMs?tGs$-PUD8my!yUtt*sfs-rX@P;g%2qyh`Toi7pay6Va5|$(rg-cq6mIc7<0H} z@rcUNyaAs8(ow%bV`r(7=y3XMX=tlt@}!%u=ukNFKXl2m!-1XiuN;w~AjxYt=ya^J&%g+jJ% z2IY{3xLPz)Y>+J)F}Yk76RXe(oX9}kUlkTeZ;w^$&M55~j!MvdfVGT#FY4~<%5OV3 zP+M!#62l!A7Y8ZUW{9GYts0O%gsw3Z=3blXI1V8hx$AA#*(|z|77PC*_EpW{s+)_$ zwTO!fo|7_7ruBS+^|sfH zgdMMTzvlbMo7llRsP$x4j8UECu!Jql*$zllgoK>7+=KpTaFdj*0fP#1T5-!p2N3D5 z&6rzR4Ztu%hFL=wBm%yE`I4-WqHJktIi~rsi&gG(l$8uRGbQDk^Ss_+w5{{R#+VuT zR;bwOzLCRYK!{E^A_eis@1JzjvV*mJr;tAMq__+bS!4?+GGoF|k#0Lfmq$>%AQV>n?u>uPFzb_3jY>fAy& zZGUD}H8eE*`jvo*jEtn<_j)#Ep!z?hju%M=<#tskD4Q@ix3)YVTuydf+|CAK+ z`$l1$LB)uDCp3dBBN;+t_c zCQ!c?`En1zSj$Zymm7Dq@C98XD{H{nxMW>-7_9ox8eh6T+h?Ga>ujh2KE?7I^JAQ0 zr62Dde8)0}uh8Vvib7iGl9DQSoIFIso!TcSZ?(pQL1^_kf(sU#Ld*|3%<`;l-|hIw zz;SSm;*;M+w|`ia5t(VuUHt==^n*(#*PSv3^pzCok2`}j-Qw@HWQ z#x40rnng8>$-8b>!LgKVmX5{wph$05D}a9)Y-&Q9s;lYw`5j?kDfaAe@pZ^&jB_u| z{mh>Hg5LRQ-h}w|y}}0vck7(+ggR)+t|^U5X)V<`4@+#VB|m%iY*Pv^fJG&dQ?DqC ztWU8yiVKQ4Kp{FJCPon4uB9iWv7vnKIO#D!JO~_wf7R5~ECC?eo`U5)JQ za>in5OpbTXSba-Ay2TY(M}J{#Y%FB0x3?D}8VH7&W_qmz{;Y(fWiQTd7gz{gS!k+m z`{ENYCP7O}tD(_#tb-A;;5%;(n`jVmP}9)3z;Ai>{f*^HUYh|yYwNkea`*70?)=9P z#`;$`9EVBuDK(X?U=YXDF{%RgnGYoQ0}SbznV+R!s+{gl?SlNPze(x}IqZJ*Ad&-F zf}F%S1dextVWK1y7YWRMaCv6Ll)9G|7tprg-$S@}yVxhc1~l(!lB(whhoOyuwy?Li z*T}=&14J!W7LZHNfqjR`6NjOXVl;P$Dm*nlD4uc8`nj3AxADCe_W@bM?_5mWMY!r;zAG2M2h%eRB|5|yhI2Y;Rx(G%Q zXj!5zi^Ci1v8$l?t=Av`e@5kBbF}$rHmis>jN7HI0TDs;(dY>sRW&tW_oR+p>@&Hr z%m`S)ATl@zL>utGEW+gQQd_jcIH<`ym6KIYq?ltZMsvLV)rYI-f$V!IY};u9aCs39 zx&hYbzJ3Lg7EajtirVW4ki5;g3N%32pel%xVhLbN5qW2@(AF?j^yBBx2dh|(KMs$R zIy#t#riY;DqE0`z>k?hBygFiQSaH@MKBm;jo|)YviFQ@s$&-Udb3YHguX{z2L?+Y5hM8w3JE~I4n zbJ1UhhLW_gQ2pI4dvY1C&RoXD)%7F_rO^y^s09TDu+SKes;BIP-h$gz0@(v3H9+hW z0%A)AFg2hmN>4k@!&94ZlYRhdv{aj2U0oSHI^RA$44%SFcJ$3>V;Y-pMkB4i!l_8z z+}$5oSokko*2#I=ZJla;Ucl;OTAG3v4y}VKI3I_X6&qGS&zSFg-~8%IOOkj}mC@K9 zQRnySGE2>45Ex=7H7~!r@(Klhhm$w-SrVsW1yF?>}_mptgRh$Zx;Y&BxnSpx4Z)b39*}tUU(B!88=8t zV2`0y9Aa~Y6i`AP0lOM+vTL!~_i9XBSzwW?-EAzSx;1a=T?g?P4ubP=ECY^NUvICx z_1lybXVBQSjKxm_hZW$dcPkYGh_B#F)YxSeWxXOq)%%RCsfYOZcoC~w77kUS2pf-x zhyY5Z$L?k*yo};B(IanP-#XwfrJBNy)3O#HhezAIwP9#y4>6jR9a(+-y4^%vQApT! z6aX^7A(Mc?Q&6z(eUk8FBrMBa(8f(22kQiGJQ#e**B8`a+>FI>m@hIdFfFj0K9Fd1 z?w6gNO#^Q+zD7mcTT((oduL~4dCcEM>CT-#pnlak=jP@f>@0`_W2)19w`%1J4vrQ8 z?2dw|O69dbCHeRp7S>=i=apfAo*gf^(zgdZrlGhogo&l0WR<;J?Nd2c1xz<#pPM*l z#jx({?FnT?m+BnpDgF=V{^5rOu&u zMdPDG--JMiz)Jrmli08#`+3~`Nwz)76<$rX|GHvwgK4VqC%@JcCR~2w$l=&5ggXA_ zyVrw33~t96`w{&6xiKT0iWW9!?Bx_y{oltbY&@S!nC3K35&ZkCT>N7aU&k35ofNi& znwD97{^|EgEdn%7|g@ir z+Nj_8w{7laMhUx(i!&7;NiL+>9!tAwQ@bh zrpSG!wvkhm(DqrYSp7TEO&%`oq)?lrY zoas_tU>jZuz4UiXQ*XJR5_D~moWM@b5uP}9;-B7U*G$|kn;qNZ=n}n%(BTp_xQV6F zyL?vuq4c(|PY5pIbnH*VmhE+5gKO?0BI*543v$LA+wU^8NoDsc;#Xr%h4jUUryJqxF^k=g3L876%L9Mqz@b?hL_1S&@$-?zRv~;I3u4 z#ujC>R{1Kr0{_JSTx&;8kBw)UJTV}79@j81h&TZD_itUuA`BF&oPkXUOzOjaHInsZ zwBczcc74WbGUNk*`hz>hkgLEAo+EO>)tfeaW&3ET(XPe|l1Nh0lH%e$C<{(gxDFKP z>gsA-Q((z>)1E#U@-I~Ii*=g&(3y=WaJ|)c+Hu98jYA)i!hSx=q!~PP%^#z9V#v4s zUeSW*RrfDR56U4$Ro#E)cDdS&8JB^-l}WD;q>BKaW$NvO_(M!olm^~Q4OYn}~EV`Cz7@$ua7e4zUm?USenVA@|`v}`#Fjf zx!o}v5+3f84qfUY24VL0;GnNo-Fab$`v3_69xw24_&Nk{Pp%*NGY;f(VSBU8o+~C! zw?3K_&v%=v?h)M1LykA{QIWJxuhD+p3oc2Nx@|X7)!luob7u#VggR|aO`p`>euXW6 zqus4rXLTTKCjEQ2v-GC{D2FH_vR!erz<5FQVMDU{!4Eg)z4{mc@lIJZ20}8Bc}ZVN z>VyuQb-<&uzltT-nRqB@QoMW+@yBBFOe0@BZ2D658%feOdvzK#LNTnT@gb_69Ui_O zg=37TrpjjozkJDzPH%}df!Gi{jw$7+*u<0XfVrO3BU!$6m6QxXhuiQ>*ruLYqJiYY z9qh!!4 zw<8ZS!F@p%*7Q_ciZkq#3*!iGYY~ms|_L-J(>*jE3vR_E| z8-!I>Oc2_jaY=LvixmR6Aj~TD)2Ew3biRL=7w4iYmWqVAmvhYY9i58w8eQhKqoi+; zL!7=kH8d;~fZatyzQw#t$ZDE-vCf zb0npjLC6uzs|#rpC-f^Moi$ew_E*C0>dM2CV>m;77%AKm$l0^~#>HYU=KD{6y)YC> zv6E0ruom6vPtE-&0S~sYil$-wUBW=*Y}R(YhB?FEbUe)GQ8htF&|el$5We7wyYFH5 zQe=GDZ|d%aR5xz;czAjL=@@}ZVO+!TNE5}83V=}{{@8~E$47p^F5y6x$EXqH(DWF2 z#0u|FK#$f5iip4xfFPRlPM+Ls6)1V~J^1mWo&)>h6sTZACTQA(yiV8~wD2YZd({VHC z&{A)$5ZZ2SZ^P*oNu#9*K+nQZuTU6o4W#kT&Sj8f`+FC8xJx4HrYNoltw_n>Pzl_j zE@DXsU^<$7FzDcPH7zZw2qUQ_z~KPtzg!^#3QYjw%3Dir`@`N`3MIZa40s15Wu~`$ zq3kMjpV_btLT$Cj&X+_?%*^Odj3GKVem*(_lb6@_l}zF?zF$paTifNWb??r^llG8w z9`f4BkPSuyI=%zke>vxL$kYIIT?)q+$fM_HXCdclyQI&{%ge!$MlU6#5pM{!hccOlN*NMX7Mx8zw#-Qoi`edxU5hs@b9;;#k4R5X zhm3ldt;%-r`+2hM?QN&&ZvS;(2%E!SY7@}9LxLA})Jwmh`)NhpZrS-j0=vNGms>eL zy+mj008~G`3_Nzx`9>ne&4MAvlJ5tC*>@Yr>!lS)!W)T5NSOCN8@iqKsrsmyM!ClN z<~OLI`65rB%GoSJ#z@rgoTwXLXnH~d4Onh-$XH&A6Be=9DBI0rgf(=V1aL5HZ*B@4 zaR4AIu7D;3&eh3+BRIOF&aoWF{en$SNeNfIBkvR$Cmip3UsOCA=4DkFIW6tN=qTWy zQESp{BQ^4&;to^app*nM7PQIReQ0Yd!5YkKn7{R8FF;UR9$t{8gsL?8lBYR~f9+r0MMoin zeyc)l@9qqXN(6DR?$iwu{8`B9ahHbyhi{ z9P+{fNBx3exOj3rw(QOaeaOs&+BoEI7?krBq($m?MS6EMf6y@u#JSgoD_?HzZ^GorQMmDpVY=^}VFxlI7vLH0qm~IS+jf zi1**PsEOXg>simpyI(7i3c+==^PRl=5<4Wgw}$RYyJ%p>-u1}3=}h3KIN=L(8Y7~> z3n`iuIov)HEhFi7eva5q-9AWL){*QGqv-eHfyfOvn=g5Ybo=g7$=PpuWc z7hz||#m;KbCJ>U;W=#slNHDo)fvE=`nK}o6WsjiJ0r#>T?`c^#>TkenboxMk96}e| z9^*|LU3-8d9S6hsbKf#rT$40N&CJYX{O|ur@5SYR-!kG866(SsSkIpQd%fh{m%eX2 zn^IA8b8{9$Dc~v~qviLv-IwrBBzcNrqrz9jPSB~SYNEloI8k zNE|rI++DdfaPRf~q*KFHu=j5Vst7>z#{-Yy0s`<=dc(OqzV$a~df3LYRr6F_H-;hh zwcxu0GDX{~*yDe%8c^HB-NSB90v)UchZI1Mg+_<_Iupa@hT6ADLkM0G@odURL83v< z{3_k`+i|RiO=eaZ7s54pVXq2~uK+gA-^s!$8!@fT+Lxl|9`X<{F9wFUFyMcOd;Ib8 z;cz>Xg0EGRmVOUh5CG}GG#(B>PV%e6f%)Qdyz=eiCm%0`D-6b4)Mr5VNB)_*yWE1%$kZcftByBy8<`a+{=D`|=`gO1 zZ(Oc2Gs`T~mjQ;~2TlrtVma|Mf9Fv)ey}h4SFM9yAo91DjfGs7-xU-HRCba&9FD;H zN-eHy0VqjOPU*N02?pF28)oem#goTiqilpu9=_0^4`e`?(L}g-C%9V%OiQFL zy@5>zIOcu8e>62UAL*SvTo`9(8;rm=@syEJExIE3#B&-|80}e?4hZ1^;nUhbv<@#? z#@WOuxA!SVZ|vNXBfS|!6$DYRW9g?qv&w{B1=xeQDau}ks@zB!0HwggUS+jU9KHAY zn1Pr#{O%U%^42btwF$&?8PphOgKY4xbRFJTvZOF1thR}`?n6>f;9z&a6Vo(ONS5>= zEt)!*6dbGq{ndagjRHo%A1Y?VRh5qHZ>=pphrK?G#@LPFFC}DWFF}L>FR2{mPno8f zCKHub`xs~aLVYoha8ue9BM65N;z%9_cb_bter^PHg;Ka+gsE9`GZW&!$HE$>uA{gi z3v*R9G(-SU9W8~>p8>6?kT$9y2h1_Y4>y+&M}uiK8Mb~|EFF3!|!?S z^27pD!@SJxDX#aMuvGwJe?Y3fe~)yzT7KvPgx`K-WM*Ec5vquk7hgG0BDuq7(ouwj zW@l$VKRKt-i;>%*J~WzdKaNYM-6O5}Zf;|xZP#Y(*~}oHw?^83-YFF0dny^%e{Eu>zhRcv_2I-ykB25b{k2r1Ma~YlD?E>7gYh=)=^O!=DSy+ z*+3}MN*s-;Iv!^kS2a)44DE z`$XuN^8Vq)o(&sFu6Jl=tCn~@JMi=8PuQm3m$k2O`zG``wqpp&?eR~|{ll!4=3q{J z5y3zyUl1smOt?x?dgi;@cIkC*DtjKE&BvR?=f6 zA}awLSUj^G{VSWjFRB{I|80`5rR{~DB-xrHOd9|5$Se)TKG_C)A zdyhjB-WZcpej4qw}k| zbn>A7!tO29BAsf1aClN!113+*Vu8%Y!Qg4OSw-(tJ0>w<+qW{$j}6jlF%`kuA55|_K1+w{!Lfe{?5 zwE&y_YM<*CGeqK7L?HZnpFsHpcK9PzHy=L_b|6R{A08eC^5(A5Z%}e*kK>RMtJP7&pvXP{n^pg6@G_=hzK&364~*tE-t&U^}|uEsx(HBB39Ke?fqdX(qs0x zF;XqtAFe#uSJ;*20=i2XY`unT;N-4xz&5}+9Bih-3mkELwp)kG`QQ8bu=tG2G&FYa}e)uDr5#N7%NmU)slJu2-()DQ+lOvrq)JoDK*^ z14H9SYCVjEt&ObW_t#e?BCA#^&WB8sUKT8^ zvP9t~FU}&J{oMADnj0`9?Ck@bK^k7cwEU5g$&SNFVO`>4*_-%Dk+H6I{78o}{Z?bU=_QrN z0AawFx59*L+S|y^Kdf=-Bp>qx)z2e;fR>Mpjxt}`C=9rIjNg2F9GluePWR_#k?-2@ z1+9Ka+Lnxub(8;qyvG0g%4G{cEUfN_4@FiZ%w9MCy&b2c3|#{;;@0w$I~<$$gq-Rn z=I9?xOI2r@$n;BseHhK{Tn6t@mg|2?FxXWR?)sf%p3@Jrs-%Y%vO)7F9M(-O#v!@HT#v)E|9YI=fyV(N zLb!C=-{5fq#kxE86Cmino-lTlSlh(TN_h0fKR;rZM-tAcyyW6Dvcq`)_o+g{>koLp zF2A}Me}VSNb6oxeCPlSRz)fZ4mq|&6kmNpd{7yTi@=F@(7asq8eJZ}yAj??a-a6du zxOu@8_nqc-`3k<7B2&KgSZA;xm5;EBxXDN%=k9>RiNQuV4Kv!g8OH@8p&e?F_Ys z_wD$E{=B=J6@Hb)S@NGl%&2-yzu-T`(e?h!FYV3UvTx>!Da4N^eqa261bugSK{l=8 z(ZBBWrHBom;GdEE=(5P8A-?0*nX#`_pc^;moKWAkqfp4uDkjnCLoAby@m#-{^Iw;d z96Kt)d3Eh6KR?s?Xf)S;tNxHXdmr<6D#PU7y3TZiYiJCzsLfkJW++be?;})cz98v* zcTo@f`92+I9nPx!^-MYCicV?AyM?S!4Kw|c*`RO#b#K?v0YQnMM-`vnNRWU5#2JXl zx5s0Yg&)6|<2@zvn5jbG@-)#u!>^ioSJoFkovFvU#X5)NkG%i(mFv@_X8OGf*fUcj zr4ylvbmA!y(a&TLZ+keIny6kCEjqLx_rFjdZe!Ftc})6$zLP~=y`uZ`=s@n{Z2Om4 z$72$3HAO)foZ(=6jJbBDr8 z|Cp6bHn}C0z*ZQ{eGHL!_%O@QuO4=oS2Z~LQf9BadCSC~Vv_q+B0~IQ?jwq{iN;F6 zJ-t^jDDjT4{fm5a>a_U#E&3Rh!L%T{B!zU@0WBC41(}3UjRsWiOHswVZ7ep1+Jg8S z?^Nd{KEAWr$(~Ketk?Lqi-N;e>55aSElkYKYkZdL!Za1u%n+xDT@lM5?yUSFjucxK zaUlcfSw5@+D#TBip>k||JfHXekVVhX=-1xff~1m6yui8}g7=enMyhx_(YLPIq%iif zhoN*Iq^>`rW!rL|9T(Q?*OqM)eq6R&O_Dr*cC>2u7T)xWW5aWE8KQ%#pW3DrxrOZ~ zh^i%a((PnaE+Y4=zANNBS{KAf^~=f14^~vWgw%|Dq%PQ7X9$Wj(Cr-eENaE-L}11GWV3yeDEc`S}Uv-|J-Shw$N*~&LVzoz+J;25A|>xp?7)H|+Iv#UpAl5+gH zu*N*X$i$T2p~*zsQsE^h!u=+w;trHx;2uNs5M5pt9v;qXRQqLp&%q%&X6iCe$5bl6 zMI7~3ZqpBCueS5w({_H$DTAj!r7dFG{E}gg)bq`p$B_M$b~kn1*S&Q23!?nL>VTu@ zxfUwSMspIbUBj-utp`zc~ z(Z_9JHzoHuq$G9PStdcv1>(1YxqzUa|0ZX;M) zBfCjt<_Bx%_;UKTQDJDSt9JR}&5!=61Vn=hRZX+P_!x7p&Qh^Xk{wUAc50Oln?x+p z0pE6b-lluYPu<22t#JA)%rY*_9)i>xZT!q5LOAE6@M~>nb|!W<>(0R1Z_^KyrPdxE zWoGs0wR*(rT}H8zu1BgxJHp%&f_1e8?2TnP{oTCw<>2NfmWd{LvN#T2`uG@*aV6%J z{BL^x!Rr3SAjEjaURqBMf?%GW?3fUS4%>_LKI_sIIVA4IbH8~5H@s$UB&DBP8d`kG z86J7Gw7SuD2>pUyx57D)DVUx#xGX|0(a$9WgRtyboOktFzR@UwjU{^jAZgJkb~ZXe zy2J~ch?zZAlw3rN+OWafv`W=OwO?a*SK$sNwaNx-CvVEhl3% zx0Z|`$DYqOy~fWx&vnSqA5J$*87gd#)zD27h+I&)cy^kekLrxZ@E|^YD%EY;=NXBa z2t`~VCuWF~uV+T|hW$y}ZK;CYhdk?VOTX!Ps91fe%}vu5DyS>d{2 zFRDXx!^UK!E{fE|G}-z@?_(>y<^{VvGn$ylyPavCq{1~Dk`?N$rf38X;_Pqh+zHobq)U8;*+ihW?j#4jdtE^ zQ28Obz+OCh96W0T!_yjGJ6BhWS9)e0Bh*@DVtJOPN z`gDT6U>W9KOtWpmH@z!`o{StY0R{0}*XCos>5WX1KSfcvje3*NPtoE17uZsuKA?FfDVo$rO8M}NX?^t}1+|pgBGe+Uh-IzAXOxPNk zRKp;)7i#T_LCN~HebDDy?I+zacY%}*(SC-=Iv*B`xn(IPno;34GBN@ogti3Gy{vwj z_S;VtRmv(2IDf-NTg4>ZWcelfs3+Lrxaq@BDiGtbZ6oQ-+*u)sS|&z!uRn7!y1SbH zZi=INgnDF>tb(NdCoQ!J%lX9YwckA>)E9=t$%)(Xe{ykSeoM{zX^_?M+7PzZEpiBB z7)quViIkZf?Vq1;U!O_k?JcVBxa2t?8>hXY2E#eQY|ldLIAta!{8$~`J^vZ%1>9k) zk&bU{j2Pcq6ZsxDFV{~l(ZBV2{$0Wy8u#a)CsaLzM(lpxeL`*EhwcBsU7*CGFFxXn z{&};9Xt*li!$YIHQLxNMQmdc%-jzmCik&9rJWJ9Za!z~dB8}Z<{1e{?6-1nQXT2KN z`eaNlvsfD49guY%iPlpaq__WN`gMrht1)s_-6Runrnj$~$bpIUlbYUsoN$c0ojgTZ zPQU)shX0w2{Jw@e#D-;d{`&!!hh|egDJrfWC1rnuIzV$L7VN(s+rn0IVXk?OEE|`4 zfxXwzD_~5&5Du}D!=B)yk(0+Hjy^_JUO#c^Vq)l$smrtbMwit5AG&-c99blKbB_Kz z{136U#C<*zdjAb$$Cn!&i$u+&Fh_oP&?KHQB4<9YeNJC6Ymt*bD?}pkrXc3`llv}T z)2`I;R%^o``I8+d+=}c_6}qUbr*{$S)Hq>i-ZGXQM#X=*%&Yz*2_VB!seA9bu$Cp( zLDx3U8g{FcYwa9YMwu4$LIkwus!NC5&$M6^HH;^**KBn8*`#543TvpEyyVP-svKc9Gsug6d0(SpkJXXb*ZS}C%0 zVOn>&9|R2%wPyvoVM%Y%VD|a%gm%%myl>Jhrtw982?n;x)m{k z%CUfQ9h1S7jZB2zp5`=h`%mh1OTULkuZP@1i(xJp*c{0HAVg6HJTos7K}!<1KZk3c z7t0g3%e{YQ{!X=q_e~DGM#IGTldro+Cbjo*${`-=_H;RjbJLAneo$rh5^taEI zI!(2OS7c^?dhKSHGfOfVmH%J}2;h?vHy-Gd_q`?>MJnPh3zc6qur6?_sB|)G7`yKzdqy65&P%waogCrD%NR}%Z&@ga)p7y zcjT0kC6xB03Q}HDsx$C?%=R6NO?~UzjZbW8b*a~{33KP;BHBU3^@h70imfv5KzDKt znd#xlPr_oc(MwNdQi2T9`~PLyO*|Q1y$ePPpZiEZ%<&U%vHK zpLp|<@@8z{>~$uj{Uqr=*-A9mR2Gt&vbyMTHz5sd1^}+*_4Ygh)k6JQ-g3Un*E8QpCuJWd!3M(HaBwRX{D>2bp28v$mV7S%|MD!3IvCMlu<1!HU{vstNBf05(A(Quek?c@nk(VsiWpzrev_d$H zj8Bw5C#d3l0>Cji>n?=vvZW`ZX!Gqi6n_F@d9L4_Ig>Wps*rE)#hkfeJ8ZDa(({tU z8dWC4&yaGqnBFAfB)Tk|rD`|Gvh?MKCGNk~#*?0XR}j&K@YOHXJ&a z$?w<8gLfL}R~%mm6uB(XPdj0+#tRhh8I@oeTrQh?r}{zXLyA* zc9u5Dg^P7!tQ_C3nYJJaU+4F^9AuEmq*UeOoR8{`)+N-C@5Pt&d#T2kS&Nrwu!#Sp zr`rtcE79M3(XL7Kx!d;d^w;WN*qr}_~d9-e1G7cx8a z!=KAI-$L>KDi{22IAdiY-{pdtqj2vFP*eyxEK1VOJO@JOdiJUS((Ht%zw> ztxYMMw6M*=RA(Gy9etKoK@vNK<;e?raz{??x#FCOgF{}4|FhL1l3bEZmI2km5s4!> zeGKp|^ALZOoh5D$DM~i6LF{alrB=-=-KoWF3@iF}{I)Gs1e2LKLpFrU?FJ)e-M{_z z_A^6S^D_{GjqZ~0GEo~=m?i!BV5(4q zUsbD1GpW?YKt={{8hDSxRd%a%TlYm>2FAp<75D73`#Z;@>dk`Og%SL0^u3;eTi0fw zD8gIiD3$%Kb(>^Cgpp=~UMa`DA zW35|q22eO&Dy}g9;a(JtBl7}mZk+@-+p7DaDUxW!KSlr1VG)+ps>0Z zx2ULku1|sDT*`I2ZvvgzoX-unzRqnwfNEoeBLCPS9@R7Mtn=PcorLtRngIqX-O!ZiWy{(S3=bwVx9 z8?SLh@Wo^@w=7qYy*NwDXETH;$=3>|^%csM!kuWI+YDE!CtG~{{>vik9cqor88OJV zc~3NN>Eu-KHvIQkti}(W7}SXq$u|!ZD5_4My5RH~Vdr^_Sxd}9&^>2+`qUl}{Es;>4AXoMp6(lAi|jX)ABcjpeiK}}INH5UC``@^WxH?Nl7VUn zER+yf#iZ0cV?ZK=LJ|bZ`F5QOL2Ekm&70-nDj!JYf=u@+?yQ?7BVJ94)ZZ>+Kcq5Z zTMW|fthdJl>i>I6{$Ae&%W20>!`!M+3{QPG5xO$2y8Pfo)g{1zVAlo&;`Mo=4xy#$7@50d9gzu>5IP=e93jE9O; zGFP=`=lOw4-aCW289KRN2L>?Hguqj*v!T3ralkz!^;2R=oJ7BJc`0VioxPcs;u~%4 zB(B)t$*~Qb#5A&l%oPINc6uIahJfbAlCK2xXvp5kbBPEE?d@$0nF?KIm!Uh|F#GeI zyg{WG4I2HDS>FK8Zq@%PyWBtp8mHIs$2VX1)YqegBBGzvUr>6- z9rek`7%~pp9@!mmhB@f^R*gKAW8j7w^hb}_5Gv9pLXO+%S^4?W;g_$ttA9;% zgdzyR{lg>{vtzyD;NSpqxSzvpaVi(*l0HB=qJvg8)M!I8vV^dS0K{|w?WFfxt_IDI z^Oqv13T=mgz9a}g1?CQv?rSa2na&*>#fc45B1})(Co5f+MnM~+=d)pZbF(DfcpXSD zNZz;+BH7#6&;Sm46jF_##~vy}eK)svOgv$?5^DA7gVfD8m&X+l1W8>3!nuu&jo>3~ zG&Qf;i;9YU&}e{>d7qi7+*)?3>3MK)J4hspfgrM!noOdo`wvi&hT5x8W~2|4%ulFO z0&|j&pC80D@+`lzYifQ6CM|uq;W+3@fHaL&UtVfrV&a&a@pTG{NT3~n#0Hl^**S?u zsxX#ZB5EEJ5G`tW_W~%NVZoF@WPE~Z#*c2+)X-p{z*CDLWNd`GI{XvIa(1V`bF_47 zoC00!2Jxck=;(I{N?y|X`={^Fy^SF4UghMEgdled?PZ`X9;vcJu$6fadfK3hxTWOzrj@oO|sO?Ut$tTw|FM z_HH`^0|Q|BUbW2A!^pY)0JV|RLrh8BaPW9Y*u~JqL}m5@D2{%^Dgs>{_v<|6J8yM3y&zvJj~j=T(vA_Q3qZ0CDIizuML0gX|xE}t{x zhSGKqq=bdxaya?U+S2l7Q0&plRh{VWMr%+7;kW2~$~g-{7cq+Dj$k|nbW2lH)4?%E zZg1cpp&`W&&K9^rz;!Ngv2D;lfxfTnkxbEs z^8w&Ucs5>jbi{Vp8C<_Al6vjz(Q)_SEE(Jln3Z6Wy?`BJ0`oR8)DY}MnCW!PBoqak z~eIO^UHY)*Dk2xNo z{~hL{N_QH3Q}`+?Qz7@YYb2^!Jx5(O5au?gf70(wB{LvmIEc>Hb; zfxynOPJkohwTmCfWpeZLgY^SpLSx?Pz~p(T%7cft`uO|%zavMkL7f1Ufac}pfrKHS z)lbz~iE2=@LU!f~VWLA|lcSvu!g7g1_RqGzLymHIhTC;a-YT zJS7#CY@#bv36IUgnP$Th@Pr(!L^V{mPXEYI2%_WX;Sqi``t%)YWo4zcwH2zUm8`Fq z_(_?ocYl6P?MFo2`B9A_XAsQZ9qjC^V#cNJLk_L-?u|t{5I<*^qC2h1Lgb}z`}Pl5 z?NFgzxuI>W(us9nnNX5vegd8dr1njA1_tzMNpR~5jd~19u}N@OU5`-sPFPeq#{MEP7-+Elc_hbN^=+D~*g^Ntxj z&HdJLr)Tt4$7-F$;$Ax@0xqXH-I}i9D99lwggK56uTPMFBxx=Q z2)dD(!+CSAPgfo{i6a?KFU%sgPXG$aLnVr(XjT=CjPsYpStN6w(*OAhRw zy()>0so7Q)RY_>=y*pLOIg*iByC+nvL`Uu@w26nJb+NS?-M^+4UNur?qhG|Ub_`T$K4$;9%Ioemt?^3k zZ*9x^wwt<}#5Tw5$!cw%mc*l-EJJ6sTuS1l?-HomB{&{J`dzl=a_Qz)RZPzP ze9i(}wlc!UN`o_`K38R*D6S~X&Ls5Qmv5?kx+$x0 zKF7;zl#g(vsm3godBW;-9iUOAHe@+`WkxJmlHhn#l$7IYBjf{;hXygL186Q@s zB7(!yI@JvK^kv z>YGG*b~K?wUN^;dPBXmCcm%!13nxF?qYld&U@UW@BsU|*NgrqB|Ju=r)^?&Ce=*m~ zi{3sxA|fZF1?QVf{6ly zP{>@}{_P04;*;<0nxG7UbD$2Nf3vchQ^k=5BQR3!p4{q(XdnR1ILmTszfCl$!!n|B zNeDc!R_B|dGerCunjmmdJxMG%wiWyWn4%>NRK1fSFS96bsVFll>0t4u?a8|bPAW}Fv*ZLN?dYB?A?W)Nb<0@DoMJUw z7g!zhs07If2P!wUU{MacI>5OfKk~q@Dy{I_Lw2@aghi7A?I_nPgXZs@rsO+iu8l=v_sdDYV?%g>v|Y9f}xnPemldz?)pJd zB~CD71*;kiT-<&eZ z?k~8 zVJQ*s$v*Y4Ay7^L+bJH%#&Vj{k^8(E7~7!;H;$u>_sjR&{{WANd>og-SqBui(t!ty z3YP+?UM7F78o7=vw=v(Z=x|@K6j@~P@LLQpGrJ=|fCJkb2#^&RvfoRzfdv@$=eu}z zk$ueU5%e5vRhN(rmg^zu6W z@+c)(dQS8hDYd4@(Qi-RczDpt(+m~pQHKX-RGfc*q32BRRi2mN+T4Tz=>d9kOmB2} zEVCp%mS$R)@zR*0)s#N``tsAAEG&%lT4w}N)##-)4M7^B+nnmUhG;~{k8ug#4;Kql z5W#{qog7RM;6jJ@{@a%fvLQNj!hsn{F{exlMy8aDBc>5#3qkRln3R`YqCkSM-uFcP zR)~MHda@!o?Xd@;!4UZXfkxlL2PhEAF8CnY8vT`<$ODoBO%(SfK8>?(&df1sy(tFq z0MS?w4i8z^^b+Xmf_RdefgS|D?5+~DKvX@* zpLb=3(g-bKlo`d82(|E+DUJs!e~S3y@AM7%eZq6e51!k)$ljPT(-zuY!!Ma-T(avK zwd4W|BsxBlD3EoYtN6}kwR8TT=$DPIN=r{e96fEqT;?}b0?FmGw79M3`Ms^LYSlzb z3stN8X3j%Wl1rg<@TDrT9Ecpl07Yy2F@vIu&>dy>zwd`!Whr$;5b`v{f8N73LM~XL zwH^6qTG^%0XklYi<23$fpGHb=TDmvUSOejpqY{Np@wgb7t0y*}2y==cU!YjB?M8>d?4Gc=saf8u6Ra!Dud0EF=T{S(= zZM1RIh5jv9U8xy3ek@6_f4U40M_baCUVt}M+WJ`dt^qB%k?m`i3v+kZ(r$h0DH&Ji zLhhz3lCBz2ivo=_TLTw*7B1aFC%&fB=H5kmNrK(mS~REvn=Io}X334}W}%@?7j`BqQG>D6jd22BZ2!GzX}Fc<2H)`+b_e_Ou_jVOThkIoB< z&e{Ke-VYg6J83^5CEiejOs#^fU55yQRMLaM{vy^0LkxEym)%kWsGtFS}D0_N%}8!=X+py?ADDO4+NqHn8`@`@jCl8Hb)2#3Fx ztjG{-APDU#5!hSGe?hQTNa%>X|2y?=Uv>@7kr05)hZ2viP(NSS5>?y?p864glf{vi zK=lw;49?Rc)aP{|R}3zYBhV1%f4_%-KuqgF#$WdhPAemT42`d{Z*N)=8o+*;Z@a40 z5RGtKmFtudeogfa2imVTG?fg}*$pGx=+wyHOfTfG`@B%-f6%Un@cV068kC`f*f)Jm z_GO@FeZLXXK?<*XkIa40=(1F18p3f)U_nnok~me07Ie2LI{K_OwqJ!bjRlG#+p5!A zsuBj;1eD6xuQGosT0K>ScY;cFWqi_J zt7Xrn*6}b_e->Up@~V?ncfQpJq0Mu1vy&>7hOaeCz#1mjMCuTD6_&A;+NJH^By4=^ zq17(6`pPqS%a|$PHE8J8Sf}_}J(kz$qy|ri2UYrkv{k4JXB#xt>Qv2@eXbon?H-2y~Sos}D9Dvwv7P#B8S161?POzUyj zc51STf7|prJ|U0rjnT@jt=vMzH_IR0EXO2gU_A+zjjUOJ=OISeUVeEtR=qNvk$129 zgmP4bL9@Rn=4~aCCGCPv(X?nMw0^MmyK}Er{W|nLYKZ~O3Ru6~IykqGUf0Pk*Rm_| zVeWHJEIRc&14D;7tg7aYu<5YDB^}P)B(NCbf0|VKd3^t5-czVhcD8|J^>fD|DL=-u zm-zML@bCHM?%xY##_S2y{`~fO7hf2ysC|Sh0(6l-Ae!T}@5_46ibyD4vsvy*zBmku=3 ze??06TzE3#Bu_f5(?TG1?sqW5Z;dBM#?Bx zQuVu!mP{?+hA0a_ zO3K*9fozdz+BvmF3!(fEtUp?0wAQze;}IVKx4!hJ#>TrXxs7L$Ou(S1sRP9OsdnL>MufToH0ww)_T6ygstvD4#6#`YB~p+-U-6oy)RUi8|^bDM3*1&qorW zU*cU_s0isxE5)^tpN{kQAl6!F1b#}*OLTczyVx@yceO(!9#?HLy*Moge^q`wJ^Oh= z6J}pe^DVRVb2}~kD31V?OZDOslPtF*%8{oz&c~mT7=_vG(~Yfj8FS?pmu@_!X^#C4 z<@Yg{KEq|N_s~zZSPZk3emmR`cxEAk(|sD~j^n!g&pJ|-Rl{DH@|-_~c1cOYA(wqN zhQouEsyT3$ep^0L?-@zHf85E_jKjvsz{V-R`#9;!2Z5^3ubr6>1aooQnUE^}JU5H| z%=kEd3a!oy#J+_y{Av)p%yS;hL=SW~;bvORhMAl{%e<9!0>d0-^?Vy4-AFKloX=bI zmN|Z%_EVkuVS3RDs{=pL=Ej+T8k(u$GkM3SWz|1G9GiyC-gX1!|kS$8bot_)v?x%XNP_croOukcCB=)NL)M> zc3T|}6&`QyV9FL)O^-(GA(sc7CYRDB zU?zXPo5^nEHV}sIehR(7Fl4c~0Y(Gu9^1g&GVv|QDcdD;$XxRJDee@dmelIj03*w8 zu_^LXv6i12KKwoK;r;35hwtpOD%+>L!3St6uy7`8yy$AE@Hdzz0x-Hpy&X)at>Fddrqx5 z9hzEd6Z@slgz?Aew~sGRJWWB+Sv2R@kEeg1`bnUXOuFIsZ%_Vnl!8eM18~hWsNwsc z!(UH7mmYG@oLT=H{d^yFX&I+3wbpbtzRzEODrr&&X&YW_?Kf`}7 z)IV>bTS3sd)=G__3&)HG>fABuFGc7c5fVH_@D-hrpel3vq`60o{!@rol!#Xl1bSwl zeIp3;BDH2tBT`B_#?jp|trc8KG5Y-=T*^{Uy5KSi7h$7+94`?JqKA|I_P|6&7{Hp^ zBB0cTU7_ghv{?Nm+Nifxc-u&KH-&!{x`<4mJBThChSC(eyfH={nc>-gRt(Z5_MS1% z>;m7H+zv8zNapP7Gb7&HXzrf%3QZ}QaN;1EQZqC*)AR<4uhFM^y9^{>A{$RS@JaUU zImvlT70Ec2Y)qV|hx6w9*@$%a)K`!KFp%)De#>|t+;15#MLjU`(I!BhDoH4vBU8m& z@#0+|t)}3s(nG}NS=SXdS~+&ktNH%;OI%OaLkHI}uJX&53BU(p0i2g?zy}-{FR^=0 zAxg;YY2MUFviI5VJbm!QB0Lo8QZMqdg&+?;pwS>Y~2vi0c1^TFMg(Spxa z#4&lN0?n*-)5KGrlm80E$aR+w!3QXR5|)qCo3L6$I{OuLPQRzsLzm*}*_zVq=CQ(= z$E@QR&K#LDq6M9C`Z_iQ1#fRJ#Ud|bE1U{C^RkU_8!7Id?J`AlF|jy=B06MTl=22L z7gfug$m?#38zboc*{)DDF?TqIqLqxRnqG@mdRbCh6$&@T#J2~%{Zm>)rI|5*E4d*s zXLGl6L%XqywUK2dUNg0vUS)ZncOCco{D#d7M9EZB`kznAC*}T$N@228*=6o=Ya$9U z`7d=@P;)Qef+h#01C!I_jBRrm2XKV?1Vs&GRk<- zW)@+NNqUU_pnTfMwp&=(4f0ffB7BK0i`+}~qBk5my?1}jZt6%cI5_BcbtI+2w2;%L zPSO%)Ha!;T{Ndwk7Q@#-v6&R99UO&^+j=b-fhj{G70? z5B2Ie5gDz|ewbl9WZMvxVVW|>zK2{}=pAiS6XyoQQ zOgk+>3LLbwU2B=ikGJE0n)d>mwvK_80QNq{S5*FdtT3$&21i?8 z(l99;o~Lg9WWbb*dj=ID3b`LWSJ676(ak(uXlu!dFS9 zbyLKrk{mA&K(u=<%Z$M3kS89(2plC5*k*_!JNz6E#QU-AAN~p!tEfW3gRof2e5|OI zUCsHz**t*D?(wgGa4|7rAH#(*cMdRGQkTT#b%u#cOfD&m%NxS}CAG5~dG4O~3QrxQ z^D#WNzld%17~IoX6;rh;tgn1El(XJ#6SYhj)8A&pao$LIH;pyQRMgqKM75i{*j7>a zZk7E}q8d=?uBzZH%}6#{5~Tzcu8PXRu7?#V%S#2?>i%1QRm$=qAW2GZHSelo6}s|Q z=L}k@ZzTRTMxH(iMt%bE+!}f;y7MUdUW!Z3BF3d{ug()uP2_gvuIEl73`=!FNJ_=X z<8^>)QL~8G*CW=M3El#(Lp)nvB{j2_SPrT>Ffkxb`KxgYs;uty*P>?VsHi4rHtU%4 zYGqM)vnrr}Ct76mC_t+RyyoGTm{du@nSA>7{puqCkjw)1a|7M%sigOw%InBwFEu`= zRz)jqRo(~d^tvn0QfMaRgm8G%3JMV$73n}&*98&H&b0d+V*Fz6qAJ`hj{arC)N7;Z z)n`~O3))v5{Y%yEWZ=2kqe`0FUcFdo#|%vW7XV#Zv{#{{3uUtxU%sn}lHclKe>zjNI02;_xiG^0jsU9+&4bhG99@#5qz*A`XU|L9v! zJk``o?O0VbBPJ*kcXzv{v8R269b*eCYi`9|<~-|4%qi}ba$JjIk``Was%Be()^$tvoK@fKXX&L`=A8P;Sh?}0YsgObr~+RMBn8u!9Ci0! zbXm7AW^l}z$z3`oH}xnjLpvqii8{TTP`-@szZ7FAY_RV|pU|Jl(*FmoKe^uuWo~4b zHb_ejmpI1<7?+Y@1Sq$7#|P~RL3%8s;kd^K{ce)D`FJ17r{P#f*+fe56qJo+G=*xE zGnQc=V%|u5FTwa|190v|+uTad-u!dg*2!Cf?)!gix(}Bjk!=&VyU_>oCYL}pDkguu zT04*9I1_6G7p zB1^@O^)AZc_dyQdUQQn`f4cwDwG$L3tXX0$u9x>QH~h@fW(z^jzg}XXjlJvpW)5Z-u{q|4Gs z>oQ%sr-*`r!>=Ddzerw!qHooFzkj^^_hq^WW0jCr4gdb}5+5Ka0bUPEc@Yc_fBrUn zfB8oxQAkVS<1hOB*3tAt%M8|9`gW1#FTcv+KlJct8Vtb?|4T!E#Nm=&5Qcw0hJO)# z*`n?hp)Rd8rbAr?;jAX&K|p+zQIGf_;e=o5A`Fmr!4UFD$eIxE9bT=Bc&C4a6cX;n z=O=__0`O}bqzjaax9Suj9j{1UzVm;Zp>A;K;5870#Bc``Hy}1f(C;TfY&=o2pNBY( zGCIR+2t{;%1;o3dxB)SuP(*+KIS`{02(ChG7}`sg(JSyC`6(P;Q7i0W1%?&oR|hL> zgmw4wZ@>y5R8UWX6|6w#t4VgO>PhXZA=o6(`ijY5w4W!=yYab!yVgR3ei+@#?}O=9 ze#yIP2alE$B5Ht$qcGLL$-0?vWCIq(^uD#Ik8G7ho+3V@lF9SomEsh;tUoke8P+40f5(aRDC>{g2=s11)`2!Y z#~n`r+5{~uLJM?((*V1LC~&7LlILCwJEx&pOzncT+9q3#4Nj$t7RH26{sxEGXYWI?E zL4^YGMs%n}@P+IWYo8=>i?fn>q0s9AR>{WXgzz*S+mNgpB4xuEaK=#bR3tua(NzlC z3k)*~^0+<=q_C7gPG&`I0_BR!IAxj2DQ}V|m^c%T+<1iLIcI+!DOq>fDQnHbMmiUP zr>}35e~U>l$+l2AOKX#048kiYIq-z)7KNg%j}S<*rK1xq_QqD^r9hfdKmPoEnB4j2 zw~=K{EECi{QKh=fpP+X%lX$1(o(Xn$T7sa3(sn{nLt_~mPOAX&WaDU;VKO;wPuwca zle?IKO^IgVQ_X+>@*H{o`B1XT;sH}gAzO=-pHXO$k(3cK6F|*+YD<@zGDnilVvdFeJsb9{5#1{UTYvdr|T+MD5j4H=#oeUXwU;w%?{lO#w%35A^r1 z{05?mq|fUoAxb90lgZeLXbfaZ$d=~4=ebKI$&D!PUhNGONgb_zQYi`JM5T74sMwSp zbG`)UwgPn*n!8uMjwU6v!diR|nh*j_>?%$rN{oN#Xg8+uS$pr&_D>?Zf8{q2^+q^p zo`k6PA_TY>(GA+Z({}D({S8zpUUO)lgervv67X(Rw`>1iba$h03tc6gareX^pC+*_ z=!#^G@eix35UC(gYYGAv>M8(00#Ti4Zt=%<{NXijXi4}>p#wdql*uA-C0PS)F2y$_YoKm$6Ptxgyy*P~HXC zB^x(Mb{^GAHr6s_8GCHxmJ{T(OI4F=p_~g5b*35LUiBf*$d-V2#4W8;2bYdKOxAxH zi*_;cN$)r|5zu99gruU`c@;&7Wg@b66Y3TFb*rMC5gs36RWSAoyP`2kDpSy38;f{u zpH!5wG;kKqRiqth3(pwFlUE1Cx2APeHBD6wOGQD}tVB!RZvzNzAR92jPoG=a8Q)kv zf?Zlwu?sQo$p5PCQ%!!-oHjeC*p`2dZ_wop#|B5qWu4JRx0b)y)KhzU&74Qu#GEZ^ zy4QlVeY$RzwwZJp3O~$Ty5dfrPwjAneCE019BA;)6iRWr z6swCQcGBruzA8?~IYnswq%ZGCQD&h--#Q#z+P!AiasfZi&~I(Uy}q?6qSt?>%X#E2 z`3@f4TJ6kBEc$7`OnJh6v-VbQJ0CUf(YfFG9uy!U68(a!HB3^*z-*=3C)?Ka;N z&wfbrkchU$sN=i2f2En}nzm7m2z0YM{hoE}&UUz8d&&cMH8xX+MA>Og+e!+_^m=1+ zOUXVb%Bxj-<(vp(0Cz3ezts=o-q(a$2?ElAXn0tsL0L;!gsyKT8+U(VX8q9X9XE3H zV5SsfkQPe@5FW>~u|ldxvfL4zyP8Ee^RU&RAvdodxtyM&X0s5F*2mxQK;8jUy7WNa zdx~Hi1I>mRpfNM9*^4FBzGc2cY;;yDN>K&MChtj$@mFK&Eq2;jLCN$|5C`7mR|fUA zQY7(Mif-46B(0fEG-H2=>!u-YbFzR!c&1w%U%GrBMrB&bkXLRwl&&F6rV;}N^|o-L zC4PTh;?T@+$erwl-?gAW&nT%3ucY!=4z_A`x%uuqjVUv)l&EqrQ`54%*;WsMBurau zH`~OjV!(E@fBOD~XPCtqnl#9F6ZDtWSCBtL)6ckk*&=}!1?W#&zD=tOEm79jib6Sj8{)@fCCv*74Kmgn`h_`1>k;G5^wG z0^juX5r0!e@_+XCz$B9)1`~&;0tmOK0tt1~mzA1UCbvS?2|xsY6ZkhyeB}2t|9`r< zCk};i&<5cpbxUl$_W^k#>~d<#Yy!8QGi0(%cP_p31AE=g9T$h=EUB=N0LYuvO=zM@ zzTNQRbpf&0J-!%ZJKA)fKF@2|YIHHqdsh4Ot;u9lzvI>2v6Q$dY>jIzOEiOR&(gl> z3vf5)=$Af~m9!^+S0NvRAbRRs+{1D1`?jL;(Nnx_g3wSVXdg8}ODd7YGAp+!I=}@N z%Ggi@=VCV5yHLQ;*~NeS^Lriw%R_YHzZ>%1_nT&EG=1wV?U0SLG!naYmUhU-S(V1<&mIV*ZU<=Kgz}F>j`vd77Apf-8nY*VRG!A<8w%B+Ko~vRxZ^>0 zZu}I>ZI;WAx$ssCuc~pN*p#u7YSuDcDJ4Vq^_Ww$ks`nt>?P`BUp5cP4vk-B4X-lC ziJF_vsJa4sjIG9gt)=F2DD%TcD1AM$LGmrN60MaY>*tpwV-?v+H%-EfPdVSsilh`W zR^c%IkzAaA>%RO_atn8>YH0#xpK`3wh6;GAzE?98&U`0S%IFO&Uggh_^`%Lt{AEYC zi8rp8PAH^P4`}P#`|7a{gmp9iuGBk~^CFM}&TwM1k68iaX{~PDWd7FWLWHW=c3&3i z6BM~fHQ8KdtQ(^aXtqv}kW0wh2a9@r1yIKx`#7QyI|B-&O8cwroHc~UtR9zk#Z}6!OVDkTjbFI2oE!?Q^0z@f9_aE zp2KsQ9ckP})X5Y~O{tDvVR2#Jkk-r=Ru}bv5i3U426Fb$9dl$q*ROQR&i`%Rn!wOx(=}A0)>u|DCq;O8j(M*Jc(_ebwONR53)3T^0>}#+1`|3H_ zq*b0uw)D2>+5I#MXwAu9kE<<(x1?!1Jnn`wKb(g0xBs$to2x`+5*6ekEhr&lo{os;L*Gf(iZa&E_zOsat^*uD@ zwv>wJ(pBU3?}gqv;q2(VZ)#e@updtXO6@P{O*eaHu4mwZ>b{KuKg^E09fh0V_f_|` zA^Y#)^Q-%sMp;_o13B8=BsOxU-F0IOhi(3` zvUB@6UO~b~6<42)L`ddRQO={Fo?MpNUonmO=%bzA@45w6|KT7k>i zl*K&J#sP55xLR*TC5R_niiRSZP^BJHvh;elpbb&^%c9M0!qhb|cQ1McOoWtqJO@mS1%KV%cZkQd z#V-NhQ;gV{g)r-iB~&b%v%s12j&hx171G^HUx5^|-~Mbj_t|tSzsAHZe2$xcOJzEQ zxtr5=5|W?!7shMFjlH^_v6kyRCoa-lbsh0^D4lhkH_FFuTvqVb+4Da~*ak!1Hi?PX*QW~!W zVwh$$-5s(yv`20=OBoH{R9m`u)In;tLArbKw=uO&81*EPbyBR^+f8B?tgo1fY5Mco zQoI|RSru;b`+t~#_5PPZ$q5v+HIdjQF9i5o~t$)u7eAt{lea3%g{ zY%t+;%a}clq}qvMx3moueJnHTBoqZOEb-AN!{GO(_W5O0{Cr0cZi#cuZF^XEWIq){c^BahCHuacJ=o*_`|NjPN}B?D2El_iM zf}#IIXMg=M%&z>BP2a4WK4}SIK!4Pv#}bMGQ~tVSTqfn*rXxubhtz;T<&iAmXo+w_ z(EG_XAx191nMi+v7?Uf%d>=v6f;n#HZ{Zj`(Z{e__&l3;naq9&1~*pG*^_Qx>1ygBf2Chc#-m-AnD{v?TuM8Q%aJrnsD*m>F5v*RAjuM zeSimw@lN8Lsu1fuSgP>MLVtGe?CRU->^Z}GkV}-JaGaD*uM0d)t~|5=!=za7D95a` z&kh`OW`Xt?!omy%#th}nBZRRmot#?s_EOdP=q9~dqD7BCn)${y$ z7l5TL?)OTChH0^6?QzBk5Z@0QIdGsW3$qn=)yRQzoz`k$D7V!pAb-dsQ0~ju#fA>& zZ6}zf8e{f0jwS7FrEL-%#p1a!ZJWL{oMY-5KjHyD$}%96+U94ij7Sw#nb<-!3b2O_ zK{^}C^V$11qMhQBDXtdWUSq82z^(Z861Tk0p%&mB5m13+g3I{}ywyoDqk4dCNFCrC4^n&;)P`(*^O|jM8%Q~X9{S)X+GBg ziUX1+Z7s@c)16%l$>Wc*CY&%9TygEGUT_H|`n_J2szYg9%YWLp;?gfy124avY4tga z_dv`WQ=G={!^B-0I&K*&>Eaa$pYL=xY{+0J5lUoEYs^B8m!MqQ2Vb|C4fy;TrZgwP zCoQv7eLsdTZoHu)Nv2Vp1DA40IodYh(rNGd zJ~|{8aLOe;#A zc+IAnrhmUA>lX1bbkc=V;1uMfGmOyN7s_UJMm9D*=Fw%Ty9>E)2^+xKSQ(syoYhQ0 zsbzhuX^34WX3Xtnji(}7zeo+JOsojbfyy9JY9Lir8yTs~askK|&vZvn>z1y8nvR9Q zIjCu1Fm^_7z_z}Ek@4vdX8ocyAj4P)oC6su27g99hHS0M*bHBXEv;L;25c%81?Rv9 zlA(YGY%41oE9QkuBoD06_KVqoPsRe_9Qc%Ah`2Ko*iA>ZPc3fui`alp#0udY=p<)2 zHugV`alZU`u$BhhHE+L&E$DzzHUG>8*POY>su0>$McQ8VJ8H9!JkkiB`cv*>$CxKq+MIbhawBx=8^>FuAk^ia zMqUcdy8i{MKK|Ge)@s-lh|G-3Dn+VW-1{3_b8`dkq=_%IK9$zqOWGYQ&xIyGTOm{T zzT4au9Nv)n>Pk;t>d9nugJyQ5XVg}Q27fRry2Hlz>YciA0|c`|&n5Jpx!I3zqndq7 z3EbD)Q4AS5S?-K#aoZ>O^$X2p;B$U6=9h#_vVhdQm$Bb$p2qkkg3PMWNtht^2c#_R{4RPl?t?CI&vfDNM~Oi>tGSDJrG6#IofzJTlT7SiF#= z3N;26s5U(#WyCoI*4Mys_nYb7(I59jVgNJU!ynt7k(j_W3jzae6_ z@<`H33U=GNEnX`SqaZ-9}|WMZ`4%9{}kg}83ryi^j!rwjK@){K9XK%~mzwvB23 zY>@H+K;S@DNs`mDvBAY7pev1<%MoEL0eO_;j(m-&0;d^|H%@9(MO)1uJH6UeNn~J} zR7h)k=j`qdGnKY_JKCaRNJgz~T|&fjn~>qhR^6rRW)wwJBweJ%CCC2Uy7J|A9PYP! z#xh3>)DGyKTCp&{tdf744zJ)qaK#it&%wg>C6Cuo$kvU18y`SO%ak=8anWD(yMmz7 z%(qq`&569&7OqKfv=wN@To#tAAh5^+TT!i#B30a*_uX?0U2!F&(I&vE~b}k zT!L@{ab6H5$2bM-9o4M*U&F6e%z>EjYbvh>MnMhOoAuNH#>AS)$)Pcw(5;n9@)F#a ziM&Wl^LBDN?*^?UX;U1-{rsjkd2Av(7qeLVBNrp=0@iE z*?dW_{=R>cKr?(z@0!uv9kIY1ms$Vd1I_5tuG)_%}}__4TjRKlk#l{;A({Q|k5SaQHkNJ|+lN;Ysu3NKewC=OUt&DdeKUT35b+LpN6{8RHO!w2b6I7!^(~A)y-)9>0HjN&VU%Ok_F_ zASC(cdU$Z8wRFhyhtO<6W2Dxpajh_d@lBpUo7}CpR@^!i z>fnD0620mi5ik_P$Gq#MbaZN+8fVj^imAxQuc9&9t0pG2cTF;&c4x-yw4O;AyxO2j z$vC&&r1Fi`65KvzW~X;q$q{?o_#~;N&=nj{)!mx#K5NUQH012{%ybdsj7*KoHz!l0 zd_ud;zBS#8{BS#B|BS#E}BS#H~BS#L0 zBS#OnBS#Rx(3g`hWhb`^7!fK43G77SZu33I##pyH9uW@$11@~(699-=7ZY0C@Pq-fNoP~D& zce$;npy1;0;3_e-$`Stzn-*4?CloP}W zJN*5}8$OVN5n=gYHKE1~fBtj${q3)rLZVEG#c%NUr;4N{6i8|fKY!K+N&fm99sU6i ze}=}w+2KFF=?`p9iBoR)*YG!>PfO4(1JJ3~N>!jUM~vn`+!29~0_X^ng6T^D5yS02F1yUHnuQ?;&uEBW|DA5WjI(@IVK?a20t3_a%=U;Umw431}BsR0u2K z2$k*x92+nzMd163V1HH?DCsQQ5xjlyO3QQwuZN3A7Ob0-_}N_81^pWT zr_W>UCEdxIZU{G6BLrcNy@)kJ6KU*m)?h2eqvQjU(p<$F_p+BsBAmwCT2QvWvJB~3hPSKDKsGX9Fe* zM3{V$)=@zKn5=aX2XE$T1852dZxfpI9z0OeQ2MyNGfQjF!(`MU{QQWY@xmW^JwqMZ z3v@Ri>p&}Kh=1T}oh~QNCbH9^9VW3gvJ@a1!nj@|n}SB#5T1sO5K&-H@X`J^(=ouv ztZE}uO^JbcJVvGs$=nfzpAdzA;M<>n49%Til7O0d0R=FW96-7VciCf0m(;fkvlqpj z!#rT5EtN-!~->^j5IqUH9I{38$vBJq4!L`Q`6w_DBzqs;vjHs`e1B+ zL_+#tsvXfiX@W~e2;4}}g!0acMdCnF+R0pb=6}pCi^&znPb+|J#^q6cCJED=4rCPx zYQQg40}Gzmu?ZRrYTy)cZQGy)@j5Qcl7Z7UGqRj#`rMFSi5x}i-%wc4O!$<1O)))` ztPr*%iWv=N)d_M_-FIsvvzUF$mdGeu(9Ic8mghKD z2yGz`&YJU6dU%w?PSXQq4HsAB>0U^b9V~(5UyHf5FA0&p(lWb>=VN`xvrc@|MA2FJsqb~qo7h9*8BljM29~A^_>n2q8V!5sJGv+Ktw=mlH1XrDw`$5XNJdEmbPj`I+ zv`AIhF~aevBc_?+m|CVg!rYj4aoE_{gJQ#wP(y{W$uK|SWpdOCPhDh!~-8zeJ{`Jq^^!>&df zA;>S*@^J%2sxBU>DslmAvVRq&`OJk0?n~L_{(-OK{l)5QL511=ny8cnJbg**e1Wy3 zX8Nhcyt}0Ku^@4wbXKDW>dsn|(m zIpe697Y#mEE=p?m6VyTl^BR#&b;xCExuxX9$kV`vie*Ve_YYn2e#_ zQB1C5AK1x#oCiC)kblc`G`o@Oph>ReGF{2;WL3l_E~Re0OytlVDiEQx*Jn+!~Urh|jWmcil3|7C7RZL&G^~v!Y-RkTHM_^ndI=MlaaJ! z7BA|3Cq#~8iAtJE%-B%e7CS+UnLNu?owPXZYsUBPI!|)B&B(9>P8YbK z6j5}7j=GN(>VLQ%H8;ZJsfeJQ2r3SYP%wq1v854uSvesU2K=_I_o?Zz{G5(&c%vlC z?Ha55@fxZ-B;%{t^>`%u4e@L{3wlC_y-{cgUSJejit9$9X+1RxtvITC0Ixs#F+!KF_rE#mZyIQeosyh|y zvtO~AS)5m_n&1_R)ll3}th)7H#X1h4#$7&Q@91Lo)Ur2wAMc@0s#nX(Yt(C%pA+?J z<~JXva|M}!S&Y)xR#4MY=%!v2SwfE#S0hB<&6l?D;f{-TO8#&zo^R}kaAFCf839|Z zKs3GY1dzwg4Y+?Kir=|tqlH;R&EX$Hqkma%^Vamr+O_6x1XaUUn*7!QE z?d4|_sCt-7{7fdVZq4JKR9T)KOS=&6qbVB$+OvbU3cRG+J8B4Ar=0McS45q3C+Em_ zIm)cWY{ira^kZYeWkZ;}ja|?7Cp~aMq?4t9<1od%@ww$QnMt1G2F-r84btZq_Z2wNtevWTQk`C3ct4~BZ5nQ;Cpk%c#Hyy7m z3Xap=m0Ry9iP(*T$cwl3Jc7wY^T(e%(d|ZI16_Yy6rnGAnGS;tMmSZbE?F3Ly=gZJ zq$`dsjvM=n{ia1hb>h&*6nPWP?pbf3iHk(?MeodE4B}Ct%L8i5?=;A&UG0k<6BEYD zcN4Ym7|EJHhxbfmn%nr95#1MS5 z>ef_ABaN%Pi=&;(D<}3QcM)&$`vIR#qTf9|H;a}=-DnWR!Gi=b;+H=!{PNSw``63g z?owSWa~iC;eEo3&e8BN1aJ*^s#R4!R;qvwU^6NLwg~96`FU7f(cv<}H@VCCcN^nR4 z9xu4QS_OfB{*KoTpF^UH?^W8!LE|Ox$yBPk-2HIc#`q$-;m%mpIg)?U^e8QhUbu1m@ zfu%9{+Xj}u{>Cr=#D_m4vGnfp-$?pBkaOm7fPY_q{(<~?t8@pbbZ(5+ozlTGYfv!b znGBDT(t~;wPG5cCg-TSY291hWs95d8z3Z#tLEZ5$RGvb$YnPs&GNb-J0+9&pJ_|~C z$?+A2;Ge_a{GPQR=lFJFrH2CUrSr0MB_0g|59xr!;Hu-zd&)}Z? zc6|lMP3L&kiG03H6VLEPe3bs)s_4TCSy429>O?5H%vUh)3fl?M_Oe)$tmN3hUM;aL zd6yH$dNx${dgP&;j) zs0^(x+6jinR}577;=bKVW!B6E&I2W-TyELY)=$-?Fm=2{eOz<39 za%c_j@PY%bR5$~9fr>+Sr}%3XW^|(SjHbw`0h@NE-qWaj7ABXOZg-!s%93PR7pg7a(bw2%*l4d z?_S>1drz zIxL_T6t=o3&+aqYElv4Ab&=!-;zT!a7ULX@v@zobUNcW=lNaP`zbz}U4D5t0*O}f| ztXBm@L-Z#cW;`?G3b*8#QI*gb+aAZv0kaz8Rkam#qI*5D`1729w#M~{-P$sa;k8j)RxmBZNL#@Ko|(sb9WJM_j<)mP z6IOg>MT)qf<`4!KeA)m z&0?Em%A;%BClwczSIp|cU)0*_q?Dcp=Z!T#8;eGxY%mp3BL`XER`t_=a8I^bw7oy| zR!6HA-&*I}jIg~7b{wG<&$ z??>pX6I{R3{0~5X)dDwvqkkBs74(&5M(QV_ukl48EBbCT`s2VapBVU04d#2SYBTzW zQCdM?8fL6{68b2-H$&w2o6y&z$p7|4zkd|@!%K%4SC6ovyW^*cC*;F=L&3< zb7vgcL?gxRMhKnO$f-^e>1{lBD!b%d_yNA9V0V3$Djb!^%Jutya6DQMLE{^hs#My; z)A#mnDc{7=a@kua16k{Yk+{8es-7=Mnii6CE!__dzl4%qwhp1 zRXpmIs_xdqQ(jJ!^i@DEY@)RJz0gmCt|@tW2dP9pD6Xdjb<7ax;|XWHBN{EKw?bEU zeIbC{s(kVEpga$MqecYu73{b4c9hHJ%KAM}h9{vv0ie7WiZGFPX-{ye>JccE*O|UM zskvoKC?&$?z&k!ug?H$}i0HNlz~T2tV+Xe^CzLTwIZP&H$fS>SFV|E@wqOi%9y(ht zlHCVRaU7vqYjLIbshmOOA~W6%I@53Egr?G|Orx4Py3{{^k}0MvBw?enB_%qS5Sz8l z^iFd+$Pf!|v&3HpQeE9d`?l?{L3--o3b# zNR>mW6w|hUMrp}+7ezzchQt&=IFYL8E{^&1fN+e9Tsd9EFS7}W6I9#1Sk9$)jUTwU z5x40&FG#^a7)mWaCr?DA5X>~Keh2iOPx%Qau*da{dd8&$W$0#(-_v3Jcp_z`*nXN+ zL1-~;TIwkM5z%{=pdaoKB3l!P5Q^a%{8TUQS)S0$MmgGt10v=4cmi4GI8r;vu#S9E0wLT_ zNVt^a+hPJ4&u-H6IQlBLrk8T>v!i7=#Ao%-F-e_Z=-??e6L>>lJIiO?7) zbXU&EO<6-7tu1BDC?)lH6K=Ee-s|DRdtJEff($*}I7i2OBnkMmn4%m%7JG6Db!<$3 zydP-z6QK@s-egJ#;l|127Q%_iAo2}ZqA7wtVsfCElBP4c^#cD=k|P|~%}(-WCinKt zs&xE?_iGf~UlI~ZFspz{77FZq1_iB|<|FOs_u9N$PTQs=+`s3Ln8YQQJ0z5#2;CDrzS1TTK+gK*stkcf5<2B_+R{rEE(uzDbo_I|jL zpN{*n*vL<)J0$nmJnoo793x2bhl;yGduFxYs!4-86d2=v+%COf8r;cd*)#p&R@o1~ zk`{=pLmYyKErsaz977?KTecH2x#MQyfNAYdHj|#|hP3wCd@pc^<~Rm)4Rj8F4?vL? zG(Eou>JP|Ni<%ymA?R^H6?0OAlwo5g-8L0S#hLaaH?8of+i{JA9W?lnOFrb5u|vg; z)I5DeDxJi5XX)go_p`WzH?x~q*`?--(nhfw+M3Pufk@QK7Z$i;?#ook<6H9he`dn} zpEAKN-i0#66rEQ>~=o0ki65dGnEw$owX=#T&$EpU_GVWB?wM?RFv<>}P`aPq*fTVrG)BN=}KKzGX{!ERfv%}w^>5tM6AO1J| z%PaE+VH!;!Om7UX5#|Fak9CP`C84Ba9Npt2_Ki$A#~i8QDp~5YbcBJmL)oBs9%Lx>uKKnGqg;*ck;d zJK;J!tqr)8X55~HmZHEy7Y{5=)%#)#ph{2m#>Iln%U6c3%Asgt>|3;$-uj9APH>Nc zuz@Wq1_Dk37cB*Uwt&kUQPjyYU;MKojxIs(A?6vn>l>g4)S~!%%Io zK*SK}geX*tG!#;$A$&!aC}r-6m_TnxP;Cz}rIK)sIULC86_!uF>i?XG!EJy0y{Xu7 z2sc=xW1w>mYYZ@5m!bB5vj)}FwZDcn<^h>{~nbWaWB*xU_bEJYA$-E;~&-7RE9o zChOorGeus1wdTYb_XQE<|L{~N>7M+O1=Ot7rKF=Uvo3aFPT~4u+M<{Xng>l_OeF{A z+e2I&pVWi}Oeu#{p)d4p7mOCiPi72of&$>fJrs&c2Duqi{G2UG0hxYH=5*A0KK)6R z!WmP#Q7Yn$;uOw*Kn_s&&^>9#pE+tNF0M;|LZ;|fH?>O@lCs%(X<&|n_+#$NX>V>Q9PXbVXHCrs}W?apeR5|tF%!J;( zEcZ;~#)pf%!ZAmo#;A{_BCkXyx`O&la-}&PC@K=wK)g^5tRXuG6Eqgoz$xa&ZKD>H?EsI;GJ;`XW@Nd{^u8gz zJ~%^f{YMmk7BrJ=n&CB+yFQFr@o7D!1=+yz2t|;xnagRPx6-#bCIp6+^W(-lM zD5W`|KgcLSo{R?PN0POzZ(Z$;yiTW{Ihn zk9W_kTz^f4hOkQd<^K=-+dA(?l$etauG`&v%_WU|Zmnz%GX0l|pAkEMJer~3w^Yt& z%#6vy8&;|B3+qfITO=?esyR7)X1qRX1u+?K#{80yNe4Ot_NHLpYyeJ(wgolyA@Y8O z*usA^;uR)&33hBEFVfPyot)0QLu*OekSmg6=)VSe6}i$izmQECjuCbN>!3Mnk}V|V z3wlwqahGJrR;^^mCvDpTOTU*!pb&Q^ zZmap;#?wmS#L~U)?#6IpSGJlHzR4%8iVVc3WrUdJMzp=;krf>)?JD&!H#3qN)6xZ; z?*VS*dD>MxL8_I26wM|nin}@axJ{vPX(Te8{gOguxi4qgN>9zs`AQ`q=KA%2!6Y$G zGJsn9?M#(fgCrTIq)yq0<$bIssR+?%Ov!!hTJnSg%fkdDK_YWiQe}CGc64Jece1U# zdMssHi`$)o(E*W2_qJ@Q^U`~<8=^rz`oi3UYP2BrzqAE|tRGOwrIA^Y!~N@0u|fJE zL-dV%&4^=P(6zXkIJXKiT;m2XQBKO=*6|D2$)ruT(es9lwJ+r;DKJ4Lwv2MCPkmyth96Nkg05r@N}61T&l6AW0FMXOgPf4y7Da_zPe-Rmp( z0}sa37^+^WO1hF<BjQT#5kl3Y6=w}2A3Ufvnwkl01 zl)_qR{4GfIe|!@Wq5iPDW9EWL4yhMERvP9haRcox6xW;=qWIEjjg%AeR~CM2{$%tAZKf9A=!BEZ$YeFocOdt3l8=s&aP z^E_~)*BQewYU${e{&?2So*?U5J8UF#I%8B}kR&*fO=Gbb20nP*F^Vq?&tkwcrtJ|! z+UoEu5G%!Ed^}FLF6QI!Z;{;Y!6S}MX&eL-6UzoWds2@rO^U=BbIgy>xt?qyTorU6 zlG1EIe`^WC+e&jd!WzCvbVWUVU&m2xM$Q%!{}rj6N+N-^QkhuQms3MDRSSJj%mY%H z;rAEK!(7_VJbW2_BM8&B?V-VGXg(W>ADf1p=W6~7czjtKj===oSikEp3FSaEUrYj1 z>&kFTtX`;phDz8!19=sd=F$$B^xL>e&-*$%e-DW!ja0dB(v7|+=7C8}c40OTJmMam zx684!W4GIL0fGo?T8aI+5VYhG1IC^)nfHsSSi5#A2BisS(Eeh;&1WlWbbcS_17_=7 z@P#(8?dCBd!o}x8n*m1yjPM04Y{S2SB^vCa+qZLcqyp8~H6165+e5xi-9g5a&H z=Ly~_vJ*IjA=2oDHX|fg#4d3;P4eKA99K2kCb{Ogbmj|WPmtW;qMX^QNj{f)kmM>o z;g<>i6DWU)$aOF1lm)2VnZ^_JLo<++&FCj1?Nlj9Y|$-LU>YHzD28_)1;sLTNQmRm zdF+T)pKVnfQ_n1lD(jjq0t@XVIw6^t^RvO23hQWWdB7(2Ldz-(9&PVofN=oqJujDR zfz1sacrNM>d%n3E3r>%hbu(idprXfdKr~C3t)hQm_Kb5$nVM@gMuvA*-B*j4xRgXs zvDjh|s9!E&CIJN!<9jps|4Lbu`As1w^4H(!^e_DK7i{bnWdHL`f8=iH^q=V;u14As zY!DD97;pydo?tp*j7O6RVv7h6mY@NAUBtnW`K9x|RJ0ijt=Qc%uv-FQtU*|{D6#M@ zMG$|nV*9S>9qfeVcAJ&iqS1^Q8LLsH_OTLH5NX+Ea?^0HmYc_G(DE?)-7>kt05N=H zZmX>tsJCT0^EN)<4iK6V(Bf(!Fi%wIa5RQGRjT+!jA>5st5XH>$*Rk)b|8Cb4r|>( z6IYXJKV+XkQ!)&wr9$jX`@MuEkK}8>W^HqE!xgfvy}r0POyMA;!>V^6Dd43788#`#Kr#=qyV;GkX-qc6_ zdn}Gxg8gLwCCW}#F_B&*5Q@!1fjcUa50a@64miYvW+p7}e5l~%;F-_|Q65EOA7pMr zR&fi;+#159txwi~If||{O#Nl(j>CV@f!BmAty5AISBQ4V_?NG!S;+tH=ZxLzH+c*vEm#fuv>`-uyVg6dNp zOIpcDE7LLOgVl_2bviJyknG$7liN?NwrUBgEL8S@^A;6m@#gHCv7SEMe$D1+we~A znA}&q)3`<*q;$v!Zb3?GqN?3je_Z8+BR^<+<0^HaQXz!j0+mukmCea;=wSt_i&NNf zl{!#C2;Wzi@UE7d$16h|y`_Zb&LX(uB+IR;m+GCn_w6m3YKP+BM%I70J{_Dyh@|(# zA0hA#^;?hgihqtlb0`FO(*-oBaCfqikB{aOa-cXJ6;XHLVuak|OCG z?>NK%2lcet)R#fY2@|&-0~9$3mlUmKCx2T@Z!M`2-uqW{b{Q#`p?D)%md>%SuQa<% zyc^9b$;>8qk=f+$r+|V6n$yjBI8qkvW79>wD5^e+W4`>p@a5an`Qz!wcc~W3oCYhF zkKY!+7aV^A$3deP3&4zo<>UME%QNS~;B&@DaV{l37Jqm6sb9WGa7Y0jA9(p<6@LW! zcYI#)JtVp~uh2#g8XtjgPVtTO&qT%XF-U1_;)`^E9KgK%`tj2fClm5#(OXCc+Aqc` zhT4(dXRe!Bg<1+`(eRc!TBXoR<$|UbN3?kP66{f^g?bBb@IhbbK#BHgUsK07B8|W^ z$g@ggfile05N58tanxs@M9!K1oPS3ne;n1CxG2))Juu)aCN0mtj6NfeM=vPyJfyKB4@kwd^RpgksCVK)%PIyq zY4u*HikA*^d7F4dpr*$~A%sCwsYZJ<*R!koTung6KEv@Djt(Her3q5yAkv zZ=(>rk;&c!2I1pd_t)2tr++_fR@HFE(Z0Wbe+n;@1SZirV3?O?`Qx9ixz-gZ zdW{>Sb>lTa&uWF-4MR40v4#OidMm!HKY!vfH6uS)8(ncMYr11D_&6&l&p`E>e9H1+ z44+f3h&$d=Rzy+!b+kA|)8A3g^>esP$^GvXrFaKKp7UJN5vBO9RjFAi2J;rQv_2h1$EF@<18nd_Hg4iqAPzhoqkD{$3=@q3&%OL!j*-~PW3lF zWA~Y@`$kTy+{Bv&opsTvm`c(wNA*yaIgq19a`tymv9n(KgV64F=wR8DLuh9TV2_Hq zYCkkfFpNHVOOhxKpu=gD)0jKTrSjk~_vi!)*Cfz?*MlW*v&?8ItYZ$!86&1HxIOvg z@oovv2WrX(BneYXEPHAjPH%UGj;zAwmCi2;VGQ#K&0UWU6rN@4;_~Oe{6JIGc#6O& zrk(PqAEu;KnQ&H0J!MWxy>Ta{G*c#}R53X#rJjFz+q zSF@OZI|u}}Qr>hB=uaFIO-Y5u7+FLL0_SC^dRk>bEQ|+d@Y}+?8Vp) zrnVlf5U0i_#TbpQZPf-xP?SjTnU_bw+;rcQ!iIXYu>-%;eUH?o2dzx25{;Dpb50?D zbzp^e@+AvP&D_=_B;+8DS5c`c+>F!>^;1KyQ|5^KS#* zbM=M37+if34@x^kvyoA!9n;mgly)xX9O2v*k()HAbI+>5 zDEAP3m3xHOgWN-QcDd)Gy@RYmwEJ15^5;S3=uxD^^QuCGmvew7E|zkq_rraENEt7_ zO*uX57e-y51>V=!Me&{R{`g6{=C+Y;nko^7x2b7LZErqCwV2a z=lleXHATi$!S%km?%pZ3zKZ(2Os15=0}Ax3vmTfCbBI9{qijFBxoRa_FR$>femY!B zxlQzJ8V`dGV~#sOv@YzZK~frj02j_b!eE9{J%U2`=IFmiQIvK?bxMQ8FuJ@cy zDqPDW2JbnK^Oo?ASv>9Kyyah{F6gbCZ7b9sZR2eYyY;SDSkAZ*pLExMD{Lsee*dx; zliF7@jNf}FDuiHuYYt*c3vk<=s8EtA^$B;PLWQ2hU3a2avzXLOcw9EO&lZ>1>z?n# zU8q1-Mqxvg6@Wt%211=m5d?{?#loNAcl{;uV|mc?X*BU{`Z|C?SPc-&65 zWV?cMt9zA#o-#JGYIN#Ts1~Md_Y~}76Fy})+S)g>(*awZAGov=a zGR_kR?J!^-w@$w-xws~cUe}}i{knUIMZeeGOaWev*D7C-!+1Veb;CXb=_|CfipSo1Gwvo^=cNA zk&PPqeYOvTUEv^R*Br{L0+;Vlr5FJYDSMQaMkafvMBV?pK$4ZOYI+&FI782;?S}FL^Lw`wpz$q5s;N);5nHewnaj~M-cb`Np@d5*?o9;e13R$)!13#2(0R!zjVMCB!7bB zKMi#jKo||(^SAEPdnuLSC9%*cnOIfx)eSZG97PeQ5=0% zoHn@|#~`6CE;`a3Iyx;t+lllD;I{2h938DdmQ*B!Ww_=;a{|0|Os5Z8aSfS5ft+>m@;_u|!<1J$)3Q)Q^^AH$uoS>c=gUt1@f(=B9^Xm`)D zT3$|=EQ;?JCfU1biBURX%tYV3MJ7o?8-dm}qvmrC@EHc@*_=ik{FHA~nz4e=mXuZm z^x(O8H^<*+vZO>|FpB*2S$2Q%#g9BV#LNHU&~NoNvipCh`y=Gc6~T^S3xYwQfhEDR zQ^IqqOJaKwq`lw;x?RLJ&B%JjORtCp;lZ_Xx9|ht^s77aT3A1yTlsj}9<>8+in}xf z%coOGI4L6Z;h;}PL2&w|-lqT`14D^IIS|DEAM>`H{q*e|eLq;QSQDQ_OhEPjANYuJ_+j94I^E4i{eD8pa87 zxGa~0o2PcmEp7=ftWm5q#Pm2w+dyUc80WHN=jwlibs6PTy^3X49C69toQ3g-SU(h( zP28|-2uN`eKHM6H}y|u+6v{$_*Y+0B}p<9 z1Y2asiuRIoT6Ecox{4Er3b|{fEeJj3)QQ{jIx1Ic5~v1FhGst4kHf;Rq7hk}l<69dXW9UWT}ls>sxK$qcTGi!6ET@`6ouTU_N( zLV4BBq5MP?^|nyn__oEMlW(KmwLY(H%LD>nvtsf zF0nOt3PK0rr8)YAt)y~?A$Ai&E5_$7ICu;YA3@nsUuDqGC|6he4}CFJ@{E5f9hH=0 z($x(uh*kQ&f8AF6K_Ulv|JwdQf}~~PHlB+=__U(2fOOKtinIO8J#H*$_G`Y3i1u12 za||HbbF{+RGluiP`czTZ21gGH-2lpN%_LBXYuOMPM zb%44j!rv@nTT%;R1N-T-p!}@XptukAtT7Q%tb;Ha1~9fYDn z;hdemHKTUDH3RE!&1^$*r^PEc@*IN)F(3dfyzxbOXx@Hh5B~)pj;e*Em%%(06t}%q6ew1gSWjOjf7M*MlH|A%_4_OM0|OxwcSJ`= zR9AOT#Clqdx3QL_m7_7Vj(%T>8{ko3v5JNa4!b}wk$6bth2-$*UlX6czr6o=`OBA( zlVMhY!Rf~z6VL-r{{p8*ttJD&w1DZy&*`^U&Qa6#PM73d2)YdYZRxJwz6r3@0~}rO z_RUD}fBnDcy3%uq{la^tZ=j&)LV9uuPlS6-y*OQ(dTJBtszm$x_WO@tUU-_qoL_Au zBd!X+L`l)u(hw!-X)78>TKc89|3y409a;iahRRx;IFoc)p~Unjjk9e1^*bSFVHG*0 znX+?6!gMf#0T3CJU-3c$QBu2f>GDjebf><`e{@scS~3)px#h@;s4L9VFEn+Uym~`; zO^`%@JU6t&QihS6_k4@=V7+JfWaj)5?@fRIOD|z=mx9Iw?Vr9^+F^9UL|uI^zwipv z66$v00)1HU+%K$%SH!dJ8_>O`IYQ$9t9zek1Zr-)Fx*f4ux>xl<4s3Y`A_^Tj`q0+=AGNKc)b z{`}|k$ID;mR9n3frp>ihs$&vphbTE|;h5BB-?Zbil_iT4lYFZGg#FmH{Mu*%5`EGa z^U;y7>kKOx7&q@NKF9p}KK?iVdi$n%f7n1Dbfs|^_pB-Z4^JF-Em3=zHT+NkX`4Aq zUMqxspk|t2eGyPwM%RMM$K&i7&5SV%%5gWgyzN=GP5!N8OBn)r_W*^U6U?|J#gA3F zKxY|2zK~&f7(T(tHYoGp@(L78nWd0iALmba)gn(`ULhs3(mZi}NwYKHxO08Ue}FTg z^m2PNJD8d|12I9tuxn{`PS$v631VAxjz|U#8-tsTiOiTTjC=JW4AbOj%&7ABXqr^k zO*R^?s)ruZw2$a5Mco!CtVqsKY4sGU<8-$*Kuc>yzUz!4!1}JYiqW-L$GaT0xI)pD zsIEnJPr~ZGzXfw~_Y%?T*LuO{f11@Fc!=5bD~F6WVVPo>l6T5Y>mWn%zC@bBHTgyU z{?YZy{#W+;V(W&Wrl-v~Al|WY)O(uQ4-Kt8OlbYqKtK3rng8;RE;A}VZo)XeAD=g zWvZ%K?}cAzy5qCq@2NfmfBv50z3}&M7t54F{Q!N2IC~~D%XI_OyY{n0W+W`;!xypG zT~w2gF~?o5qmtL2bc=PO)q}T`c@b8d(8!4Zui>t9l-{yk>3~|(*g$t^?yD97719PW ziAPrQc19S*O*BN5Sjx%m#>Q!zAF-=oWsTOtG?Pl4w8F{- z-L<~Lrb!FhlCm4Gf81e?2S`Z8q?6A^f)LP1#K|kFiAJ$%PfGr4VNu?`Nd(yme^%8) zxDHQi0GE(V33U=&f)p-_g_EHg4-%^QRHIWu_jLiw*i}Kq=J4ejLu4PO;@3`e52G+Z zH{_+vN$4UOeJ$IxKoLfrQYtB;Oakeul2tro*PaxlmQ}^we?)a7G!M^ufF>YChxQ~i zK{3ZwQF1CG+Pi*5E-y8r-o{Lt7Gr9|cXY<+6#t5cz zQ&KXrJvE9nd7rRvjs_#0*fQpO6$QJttFbu=YsPRj1sHgieQ@K?2f5lQeTSuFAbmXg zIZt;9o=i9Me=8hk<{XDWI6*$BT{;A)XR+%w-Lr_zYBy~h{{@U%pTNYDj=uIZNrv5-jvxzFzC)gPE1(S-kUO||hARmTf z0JDzn*Euj7WV{}bChYd1OEHk{9TJGh1r&8ck&qR(e{oX$GuVmf;h7H*RnbE`2T=_S zniLxaN=$L`4At5VgRv-zS}tv6Z25BWjW@{ZpsF{*+CR*G2gRcJv{vZtSFh2`XpG< zG8A&4e{XlmGj6Did6f8c+z;b3z#XD{^=wb`*>nrPJUS@n_?lcZ0eU6*bjc+mw0fW0 zNtY()uroDvd_K2vLKi%YQ??U2#mIscEwu2$yN0@M_x@w9(-Mrw!g7{F|!+i?!gRuU!Gf8w0c4220f;C?RxdF_R8ne19mY5AZg z0Q~Mj-U;a8nGX;((aSgoQ6pGWd7+xarCgKR9UL46bf;E7KG^|?D*6%UfT)pC5K_bv z+RW9hgtU_2dYDv_JG&FE!_ykUr5SSh$YI*uB=#L2db0esyR~(EI6tS{@wovaao9xv zf94HzDBAV~?7?5(D(11TsUVz}(xdjw``T(O-^=Yd3l2%cP_P7T!BTuT7Y^m(A#U4Z z`$9kRnOnBYm!d%l9Eoa~CYT={FIusF5%erO{wv?7l=_| z{aPz+wXa@q9ODW7>XYWAUP{3<`ChZ-e;lR3>I@a;o~vj3(x>Fig1-OmL?VB!$?Q&A zuut&wufA3!i=f}WMz)_%L{$2ZB}fM~$=&oz`oBaDIQ<%4N=y1+A^y5m#ujPK%imIK z@?+Wrb{)Sx+=%0h5Kp~ NMa>64UfcW>2fD5` z2RF_7mbDZaf0qq#q-$YaJ)y~;7qxymTAr7xS?VqiVdh`3q<4x4MJ0r`tn=1M5F zrcIxIwOgQ3NL%BM3j^OA&zKA+g?dk*iA2b#vEHe=wf$0R zM}=><-iNAOL0RUl{j8=5G;=~fT;&Q{l0R+#uc};UJP)c|XT9&Ja($o>O>1UAEh>`@ zQ_>tOLj$70jd*?;TBydf>JiuZZW22=^D>Snok{|7h9JAp+_qKui85hq;iOui-1EPGFXqUk}6%>~Rw-gnZ@yc)~w?VfQ?FI;)g|q2@+7I)WG`1s#J1f;PZn;IUD{3Tw=FlER|Z4E zRCR!SET^18828dnLOeJ7Y56q9WvpFxe@6kE10;6bocICfXlW!SxH#w_AG9Zm9(3ZM zqxygo2OY&bPaJf;=gVg4RKZM+v~rB#uA_fSgbjdR9=|8UJCyFAipY>pX0zTwD^z!% zH~=mf+R1?f$qc3WyUrT`bp|dUf8M~mdo+24gh&vq11vgDyIl1 z<#=SKB()n$m;1S2Lj_48?YrjdUJ@Hsl*pRfWVZ&f{{9~kAXy@p!8{cdx0=5cdO8H( z(H%Os82S{j0)J@=SC4}XO|7Wm44i2myv7b?nJ^`^#VT|q6Loi;Gn1!M8>Y&9KDkU#G(1uz{HH2cJCs)2N zSOE&MIwr$(CF|nQedH=7f zS3L)P&{ciVz3+RkbuCRuxdgCm@pg@Eo)NMa%TF?$v~$@95E|N6CT2_3?ppMc)VmW| zvgp~!lxqrHqGag8#r47ynKVG@j6&>B+5kV3&+g1KyKg;2SQs zl04JkYXMF5kGwM~`KgR1ODY|kDw3_#Q)#b19$Jhz=pa!Y=Hr8fU$HERgI=Qs4z|;u zhhWB3E}W~;b~N3lKo!Smja$bLOJ!c;p6OoNG~h!&cj!3#!#Eb{>C8KR4R2TZ8m6LJ zD6o8yNWaH~zB%usIZ_r!^?rWtgz%wnC^+xeQ>aaLb$^1wqvkw<_9L2Oj&fc!zl;e=0_)BJaIr5mZ&Q_6W%ZLy=>sr#`rcSmJ) zG_t-#z&JY=1%7n5u3Y_(P+0Sc##jYJzEz|ELRX^0!!Yy{t9$(rA-MqJRiaA+M5ls^ z&cf)vL+Vaguhys0!%#5E9z9`n9K4ti_oRMw$X9y;%bXug!%$zmGcbmehIyg(fgC~X zbB8(^bkcv4;!loqefSr8Z~@+Lr#+~W|4ozhwjq3ohDC`i@PYVUT?FrNWPai_kh$RX zO9+4u%V(Eo1u>(!@0!GjPXHh@w=~K`1ylA8sQYp)>+yo>{9j2Toc8uOkJmHrdjPo_ zi4_)NAlZd)yGRP6Kc|Kpsit_2QzXrkJqnI$5ybo>m-5cUZi-bbHyo*}mgRuVrPvm@ zL|)Vc@(ro$`^$4q>ot=AN+>BocmWLFruZw;hbFzO+^f5|Al6&3Cm=o{IA4YhR>d<_ zqZif>3xqviGuhLy&A2n1Ie##dO_gfMUf*^!j}rarfG!L`10X;Xda5ZT)*e`Q63zcCc=bGpi1mh z^vGUjEX5=Q3EXW5vJ&2n62-Pk;9{Zo>KPWzQ$o6RNu?`4P|gARCLTqc@(kQ(EiU zI-TMbZnJ)4b}@Q|)%{}gBfz@3NOQ?D*8cKxfBhRd zosq@G9(PZwR$`Q?WEfF)>BOafY?bVkUmh#TOB$evLFJXQl^45(Lg&xZojPmps zi#1^=={JLZGarJs@!v1+lgnUz2px36n75wt*i!5zx5X!>_YA2H8!6v2_@Hsm*vEh^ zq!Jf2+@^h1{Vz;@dsobT zzP`v}qJF$P1_DD=ah>*7p=BWd>LQrhR!B=uLaO~K*Ce?1)`XSR=F@-J&hXC{UVfU% zv;q)C3tv{qlZYpfGZE-w=Z+T(?V3}ZyMPb)YLHPZ|Mv;1$q;cX?vz`j!v_wtQ-Gd@ z7wE4?+>0HtV~AzPJ(%*s9@ z3%TzIOvOeLHC(2~PJ$YIw&gUXT>%$j;a|7wyl+Rx%f!$EAo*xs6S>n(7_3u6)^Mpa z#!fwHB`B;ic^rAL*DntmgSeri9?VC@ffHmG&128sM^R3qwKh(k@bgy#L_U)SRq9bm z1{+lOxa4OShcVZXrT7M_=n2dd(Eu+LbraKC6@Gll6^IIo_zFK(Qwdr^H9#WS+l!Y# zSv$TD=M-P-uel1?7IE~xl~l$&o>MV)8w;%2#{2w@bHBfrqBuZNDJiMQjQi%C;dXUhF0xT9CqB4&cJ_*`{{XY?zciEb{si4fK}|7FA8+|7yu-dlQ+2|0>Er9J1gmAkt3$}QQLqb7mqr5s`}6+nxIO5w52J%}0$ zj!|9GB2|9zzUc23;In|xYwI9dgy)fBUOyRQbw6{`sYEO#Ezgy8N4DKr zLNc8plX7QxZ*bN)Z~*KENch|nHx>ICH}bTqSLHBh6@i(TFaL?jG2y zvIz~(adPn0hEM}j(1ubnn}u$V{s7JQ*+V!u(MD`k2=M+B8Kn(*_x0_}6MGqun|{jU z8ym@D>V~w&1mdSs#W6v4S?YP2DQ&@K(rZsjvH@h&fWSe{rRs*Cj3>55OlqZ12LaIw zwE!bDJe&Qo`#|nP?Q)@bF(LTx5Aa!7@-c%aO*&g~e9zwM_EA>)&o^U7Vc_v}A}hk~ zl0l<%MBjzMv-$la;R}DKRg<2Ow+cue8*gPgG*7u{q(gRtxa%*IYwP5*(waYH&SH!` zADtqN7*8@ubl-wIdsywfrH;v)s#qu|%tMDhVzGJ@9;~FEF&|5PAuss(=YBJu#IpoQ z+Jw#zz%OUWwy02$Im-CCsNdEZon`XH0h(w?{8`KYG>m+|r2n}dioB>0dbCxi&tS{5 z7Fcz7>}8{OG>tGa9*+bPWLvfr3zWz+pBq$!E;Zj}C}LxxM9zCKuC7Y8`U&b1W}FUc z_yHH#=uE?ufijGS@s*`-L$ZVhCuWV1Mvfr=mn=-0K=BxMCQ^GfPhg6nR8-~#?2w{9 zw)K2wfNs6Sd8dd;w`^q5O7=A34ASdw{*~1nM*Z}$%mQ}(CqU%iI_Uql`|Qo=6W9qo zPUOv0bLb5afU}HDAWrpl|H+1(=T+&THFq_Iv&u*qR`kCpa2=6xBgOO zq3NeR<|)YG8?`#{iCj%+URiT+S?ap=y|M{o4_!QXN_2bExD8g6(9aJ@OKcaK{HZ$w z;kn|S2ySmUj&s4suRF_$L?69tAf!b5rMI0G;GkcPLC}4S)J)LXWs30q+4&~=XONSQ zpxt{AHcAL)NgVXCN0>Ey*d|tBMptQ*n!;8rdcWY7@gBhb zSa4tih^%P|Vg^(Gf!N;H)&`B!{=+H?=(XZ8rfF=;{FiF^GR5NAA{|CC-sKTkT{lj! zol4^NNINFSZF88!ACzGKbv?{CC!3tR_ZJ$W1v-hhqz<8-9f|T3g2PRLP!88bY*}MQ zfT#V#s0<}XivDG8cG@et(Ng=T`3AvXU)B6v0G3z5s^yC}5qJj5T=Q@k zf18@$1NvSHm(b_4iG4Rnl8@k3>W#*C;A;l7uT#OKJV2cftK#-tcsLi!&=$WuU7G+g(pwl5b9pGRyX=L|0{VDXQKO2moi$|L`%g0TW z^MBcSFC1TdyH~gjoA1u?A4SN)F<1Tc*&G;YRdCwzjzVql-p%)=I$6lSqkL7{b`Dp? za&)1c!mg>dPTPjA9uHUf2u>p%CyT}8gRu6Tz5MB-z9aP5RAkiMKcfQ5yLEg%o?qn# z_LDgr*8mR$7uC%%#ogI!2-M|R7JuF!KSudtq2VhrahYg0ucrz6n~MoF%iL*Y6jN>i zC+mEGpOcx{!~;u616r1a)S-T;mku*)jQ8JsfFpE5K(}h82v0xp^c-WX2yo?KbcxSkYE@&T8!&e-9_G8_}mm^=B`1|?e~vE z^*eb^`e9DRXskmQyP;GU@jwBHvc=5ot_q9jndDj4^{8!_)S&P>Ws9}UuM6psuc_&d zbNcoJfoT58Pp{n!txC3wEN&BWig=2Ij5N=@cF?uQ>Th5CPh=SG^rDRP-6f2LOBoQX0 zuQ44xuKwD^AAc*JeTqD)>vPzDb$?BR@F?JY1HXI3E?ZZJEpN zGM0x%MN}Yf&^{#bvTNCKmaQ|V6|Q^(oIgR=0Bj@APDV*wW}dS0J#-5lsj&aVm`|t` zfR(AkAp3`WsMwqZ`2pI~v(YJX;udLr?uL<00+YCi z3t$O;2n(n8L+{t=hK+PZyDq7O`lQ52;8@G3c2s5k?!kZk~59qWK4x2-;w zTr5AOhEw|5Pj5j%y~R`AVgOZY6Ox=n0k>5TPonlT*tBY5xFCcMEE za%zII$|zHdsWb;~Q$A{7pcVc1hH_j%0ib0QzN%m*nv)q-cD+QLx`a$H&s!%q?n6M@ zy`P>X0GL)-I=i?%Ayuf|o)*CIEHF}Z0CeK( z)svbqQ!Pkx9;${Z+Sgk_({pn5xo9ZQpjtMsv4~MM%v_u_X4(xW+9`v#-E+sLt%-PY zNtW;KdU$yorxc-7X=i(ic6GSi(mX^;pK2!$Z!B+6{9(DJ^bnwO5Q00Y97`L+Q%OXr zHRz0ZAni-LPu?*6s@^RYJeLoh1pH$!u!-}tpA4*&0A%k_{1z_8#{BD#He7?YR19ws zeAtGf#)R&x0OvLSic4E!ex)1`oX>rqqYelmUSPiTRMhUq>(azwVIIOAP*OXlnZqh@ zbPl!0Fvq&$)Vz)nwF_@f%p76!k4ciN=qyVHYF0<@MFa=$xi|-wE(Kt}1G>oFCQh*F zRCKX|lHHlxit)n=1tnoFDMbX5S1${`KE%f8G+{bv4M|uXl?+((Jr7a#w=OmtMCoK= z;SM{LdNQeiDbm@Lzyp@YQL@2k5jxSjRmo=DSzz4Uc?11DQE)^nuIx#4j_pcnC$=z2 z>MxhLgfolTXbGl(vO%{>fFx_Y=AEnSvsqXHLEHVTp>kmaU3Hp=>v#}A(8x%0*pRXQ z(KeT^Rh_3))`G9x&FDzu$%Gv#(=mX-Mok9(NIy70_7CudY?KI@B1j$=~D%;~9Xg;UCa!gMPL!1<7Z;oqkqqusF2 zTO0|Bv9QtI39SQt+p?JTJOtPFscoGjTm>heEy8~1$+S69T_nVSISN)#PIX7?A=Ky; zarX_%n&Bo}p1grXk&p{A{9ZUYkkAfAj!AhlNJ0J1v&C)PIACJ`=i?D|ku3&Nr|^z8 zz`px$YY9?o&U7CUAP|w4lj;F53vW?hAds{rF-)$j(1mFm_3Rj~zvRN*!jm0&^IS%1 z@5qXt{`i9-vlh{bUxbl^urbR%y!*F@jq(>F-}Is04Kdf2 zy3_HX~>-~%i z)8+s@hoEwxmz>!?3-SO@Lm|+K6S2EVbd!dnF^z}9!!X>7Sah}_ zzQIiSDBZ{d^kep}Lsd8AeDS%p>#z8#hHUIJUR!7wS;+6W+_C+=j7Q4jKY_`$I7^(# zu4k%smk!uP`4XH44CVA~zazu6oy(-O@2>c&2TAQSGSGOa-RmVcx?wyUK)kah;4%h% zgT&DFdq1n>xcM(130b`2%gZ!(1gKqCx@%#vPJ1c?4!s>PPZWmiq zkP^g3Br&z*L|82uLwkKM^JenK#fvI1ky%!ebBU%kTI`EfEZLUtHv74$9KiicbSm`# zSni0hPXt?#($sm^2X4fKmF2w$qsfboi-CZ1$ke9!Rm{{WrSwyHPp;a^@#B{%`y2*TY6)Zgv0UhsgK@E&lEzfb=yF-2GU;ejzy)n0GFcbch!FAJXRq%)b!Z zE)On?4-@7-kRKQdaJ>;(Ci`fbCh&5PMeSlGNDxBrMkOUl0IlI@=l;3t1d zj_I$mv)mNIn2SGT0pEXj+u5J)|In3SQyXlaKh_iI|9>puH!J$S{rlqd@_sGE(8NX! z-=f0*@_Ir~WA7%9q(vI~o=UJI{ZOy}e<~41Hk8o-SkQHB1y+#`6i8waRVuZihAX^n zcQp+w9HG2QWbR$5F^?;zbagLmzoJkj2r2&irzBcr>-0`1)_uTMs#jqz!7AaoTWW^- zx_7qr9OXr0?Vg&)6Sgv+R~gCb&k}bC73J))e^rzYwKjwK<7bZ>cG?jF!lV&yqOllQ z#xa))fR^9J_*`+pdCnoO41ONgv-BNT{!XD#JYOiece_sIS%N&?i0RZ+;S;sNY)eT4 znl4p|VblgMzWZwN~!_U)Bp28lA?jI?goxEoIVV>v&abknd>EAU+JL~NuVYAB4&yDZP&zzD1q1rA~^0{Q%0J0#s0OcB|o)k@|@R0;=2YSd0ZgSCh>0p`^H&|%W4z-Z|~z(9-tDT58UHhs((kQHid zC_wq=_;$wc7}p>$V_s8Wmkkv4f+y%qU|8DJO4d&~#8FJ4a%Q2>_K!;qfqyG5{tRB( zn^inglF^imL*UTNbrP8E;H-6j2XJm5bPT#$dz}R`0cJ;K0b{`v=khAgcyaQrN*z zjDufn$-^8q^QsXQe66I2hbbfMtW_*Q=x()S$^v$n;$d+2Ar)T~w~pS90_<7&dYN1x zguBnsAM2f@@&mPNnlVe=vX3Y%D4(vhHl$Ha$Zpe-HTbi%>g!(#4_KM>C9Hxv(n`$D zQJAU>yOyIONC(dbf_Rnzo@y4!|At50kS8ZK=yRyVyBMHyOTh&(pMEN*jUQwGRiAMES@Hmpj?D70eQIvrnA83Hm)I4mmG3@&V&Ma3Gw2%VH0@=A zgWrzrYU)nZ)^)1jwiZL*`#AT$5;+dKg+$_SSP^x}A`k1T?5X4q_@i*~Q~L&~B-ar+ z_0iY~>N7S_Zd7^YfSjQ<%*hvYxh-_k?sw0GVT(Qd#6l|eGo|-!o@sR zVpwzI>H8R2w!AvbsmY?PU^rbcX$Zf>@7@JWJQLAa6in%hK6?~*FtpInl3Qg`lZ z5Q3)yjnSPP*1s9YjUan5w`9+1p1^6jp&Dsk3`0|#GJbuIJR;V*O}ERty|1up^t8J= z72kc&YE3Z`VRdY=b8{H%6(f}`*9rqG>Y_|tc8|fWmfJc_(Lwi{_+d4E6E8~$>-XW< z(f319gvTJn6%e7e$~>70=^iH_=o_$uJ(n7mD{8UyB~bHUWL~bTt5h0Dxh?$T0Q1^O9I7K)tT*a+Gfb zq`>g>=Za1v6?pA$;ULi`99~V253o$^kqmiN2PS-`B7TW(qy${=`6ST+pmow8H2S{p^DhLaUcSGu ze&nAM8c%$}YvcmWNM_AnH{?(YRCu!mT#vBuWz0&aGLHLvsMB36z`xADP(#pzetiq$ zTbSR%`WE)LaK456Exd2xe~X|QJ%}*J5O~gvP6^yRA!G!X%%;2rqMQ=C!zcP`n5})& zPP(&S#eu+6LP-EfA8W6J9Px9Hfhe*F6cOVFox%P{1dyiK^8*>1zjzkC1^Z!i8c3uCMGjZ_mf>ASu^l9te7UnCg;z)^5I~ z)=;@S5%V1RhcZlZGmc>PU915_pJb$cR_!lVp`8j|AX8qf3G%_&$!X!G@gHE$KSE+S zm97Xg`u^rn7c(~C(Q)5UCUqO6Ce}xGW|PDX&0fbra7d zVOs;oEek3>>zv_3H{cVujfT$$52}hb3dv(s!UZ?nGa)HoM%(lc00&Z=!`Q-<1q@r$ z_3auoPTD|k69*(Y1S6CrCo8JDD;q=2;VpR>C+Tli!T{Eem_#AXRx&}TKiU^>J>=k7 z?A73CI+@%QystBh;tW`<>C_LYs)iqlerELkIO?t$GJ2iHb*SC>RQatnK7VJhALrWmw{H%1wd z3d>osTBEk?w)hSjPbBukNdDEQa1Ow$Up*eyDRt#8$D`r&=JVQUc4vhxT$G|_(|YI= zVPh1_>a`zs5SN5s=kaJQQegiLT-|k8`RjDmX1M+oHDK3{_rtg^5S-6`jOz;hpK$aYbW(%^8F+ru?(bJus) zPGET&<+s*s-6ZLX4*V(M1|1_pT!35rQzaImRBEk8WStRFC~bUA`&1_COgBp&L*0?O_x-hVcQ{nrjC6_Gw=$>*T2Pn#rb4UK;7krf5nQi&)c~U*_8T2t zbmZmdKip^!_Jtc~2hK&!AlyZ##hj6Dqf>@ix>e8@nf868;~eFedd^U8fUHMRE7=l! z55}p@1IJBSfQ#%0*fes|IUo46%Z5Zfa@nS$h97Kw zy-$O!XTt`Uj&vo{@H1PK&>jD@cX}NjGM}SnWKuR}X~cQ!h$QYyS$F912%|!EqPsMo z%YL1I^VsEQN@aogT#8=kBGyAmWo(@#G&2#Ol7|LaH(v4 z9XQeGDbnPG!#!3FH5~YZY2>mRQ!5l$HQ+A!fp>CloIBE#wo-WK**CE9CxL(_*F!Gb zU$wNIID>u8V=juTGY<|X5R^mz#5MybT0Puvzymhbs^saSsdP$hCg~_dZc$4`Q#$+} zsC82_l{rkNUg!vf7IHp@u*pK*GZ|z@HIYNnHZ}9mBzb3|pmZIly**^iu3dHULTl=uilao8&1=F}FF0wk@4YnV}}?l9i%QOB@UbicK27U{CxWlMrW` z1}wQu0Xl{N(JCjqtzv(^u_o4;jr&4iFVi4r@i9qK?-}{==|~(1qh$r zGYyBA`Q#`}Zv{$mH9@hi&z_b>3!R<$RFeOAuP0*l(Y`heBFO+2-ObHqgD*fynvw-W6aDKR3(qshK9b ze%f3I*(&x0hOsE4FJ~Y;hm}8PN{U+Czb-Uad%JZ|O3e8u4(-&^hlV?by~ISDr`v}H zv+yGqbjbd~Ela6n*QJwOE@}GPbR$oWa$uJs<}$l@u79y$TQwNjxy9QP_j6Ivij_G*)Zca|UfRg*nxt3}nlpIvC!w!>g)$zrOCC%b{`;7qH zq^!t^m|984$c4kE&L}&%6(O{4nlgQ_f;AplAsOn>Q|+vlV=Fsl6>a z4-O|E?}?n2!7MjpaWWBanO({*D?`JjkzIRFwI!uCHiH9t5&B54e_6`g!vbUp*0mqA z_F9Qqh9&R{4~l+_5uL9*a}Ku0*V!kCx|4$Bc8z5^)7$fiF2mMj6QB3q!tjs>z2w4+ zuFVj^TBRgtw+E>At`EiTl37?(7)mU1;70jGWw?ixEpLR>T0E0LBjw-RLC``Lf|f7~ z%fWw+zh4sy*+V;j-kG=a3G}9IFjZGb6yKfP_0PBg;r>kRL8LoooBUX!H2<9%x&3)hYa^e>{(z=9jft|abud|-n78uf9eFa{b zd#Bd?S5QU>X8mYS(+kQ3WRmFl*X*OoL`6v6=+Sw;Sz9)}HyR}TWW zN$H@RFJox=PB6~MjXpH_I&6#SLiV)Ml7~tafCs%&(JkINuDuaTo&3#l!W7ly%dBkG zONHNoSSE}^(r3!jRLz$@5-)HXhngg3#d)fzmq4lG4zXhosL7UO4c;GzfAs@^R|oS3 zj^K|aLAjI25JY8-Wh|o5i?rm>1Dj?!7``3lGuD)qhPXHoe~tAcwA>hluOak)JHqzqp zMJRw`IX3*D+<(0q@1@eI0^TO-OmHTb)XR+%Zj<5r53pve0CdxYKg#6lfdcZT60eUO z<%IkEj-r&PD)x}}=pj4oA7NE)s{6)i<35Y8!X{>h}J2}{vlH-SlX?4QhrBGkC_OhSJ8{MDjYEzWN| zDu7XzHK$$Gr;i`PR4K{Kq)-w?h59akp*6{HN)WS1YhKa+%`56CX8SnNEZXBq3ji0) zW;3Xv_cs=-HVGo&5t{mbH8f@3Wum9lrB$0{mz)0DN&q{250oZK_y8qR z!q_L+**e*MGgB>vn*=3N65vG#@Ie#};^Kpm%*^5AYXx#8=y>m-#@M9Bu!uDyX^*Mn zf5TD@mnbDZN(UyG^i9vA!dAn-%YBqMyNl4EM4)2wR?^&3&uTdy7Giozi$gg^+lOjI zz5)h(0u64SjJiO+je>+aav&!#1OT}oCoo&$@Dk)wHfmel1Nj6d5~|vY#GM!AD#kyc z55bTK(OTV0{W>M#<-cVsvH--wNYF_~BBu${ErSAyZTd1C zYcIJ@51{FHQ_$+2qpth zfmC}Pmn9I!m-mSxc-R&A!GP5U%?OTsCaDd(vOG3VUS30|cq}UR%fWszrMKf?~)rd6p-S=;+6T&l%WLB@)Hq=#Bxs%Yrru zwClvC19+;lC^{*D1!+AUFb@sej2h*A?e=;!E4J^4;JWn;Sbpk{`X`oqB(;8aKYyg# zejy8Ym+O>g=;8U_loaFy>3EfmOOhQebbr$1Cn(%M-aX!ME}og){u^4+n}wl?rdEIv zT&Cne&fV`HO`lLSG5kH@AMyR!0k~a!o!-137iIP}eaLF8UZ0FV*u_4twNVT!K`4^^VsI?*Oo$6;3s^U)m0~FAq5zM7eI% z-)I#J?gKrdXxD%`@$~(FkXeK5rMk9se7@cf#gE7UAb|dZxBa`*ZrP7Kc&uEqpI`4c zXxRTDR}duNbS|%#yF>W0K6R+j#uQqvBlx=M;~GRbjKM~?eSrPlEjJjK6`eSr810`W z{Uf`4{d{h|w0$xoVrqAg&zgaUIf1Uc33%eMj{iYaH}b62pSrqPQA+QUT|odZ#(CreTN5m!Apukmh$ew)S4l(@l)6%= zQoHJzyk#%;hOVS`-$red*V;dSqTV%iP{yTa%vUP*e9*pE&!ceryOOx}^kJC-Jw~(T zBmy&%>pvHb647Cmcabw)VYKCi^{Y?fTYmuVd~{Gm1Has8!znJA$g{%!;P~v0E2ZTo z=_nmAsb+VR{wn}ml#-3s!ajvqYszI-V4bg3_!?PEF*n7|jY_iIk??JcKQ;C$zQ5%t9vR7{!3n=b2dXRij8*sESX1~Gpl*43Q40lrJbO$=Z5jp_@b+M z#=F{Hb3fL-G*fSJd+EBwML&!Hy^wRWf>$Ch{(7nl+~MQ?2pi*)-2HZF=fVSFomi(! zACvMOB8zr%-&Xp?D0jh=Ua;(UtuLXB)N$teVLbo5aLs?Z_R!(fmy~tD;G{6Mpk)MjSlUND$&;VQb#nZ%-MvI*1EWCPav zWmXrm2BZLi{F~zOVHJ*%0jT!Ehe69G6jfeyM~WBJ{VpP99L#HQK|U_vygR?Bcx&A` z)@dzDKi^R$xj*w|eqT@mOf%HD!f_~)o1Q*V;YOKdf8#+-W&+z21vwX;#40F5dIob| zwmhauAJe^kpJ8DlBocDMuQN51h4xE!IQ@w*DRTobPRT+HD%r1%}lIFznQl(42g ze=}^28jq2@W`=DdHkp#ESuY&g_mU-+(KPx`zm1)Y&bD4u-kt1={(`C#G!<k)jnn)O!S6tlz-c{?LE!v3XeKulZ#P z-k{uXdzGYr>dh#E5&s zgBKoKd#N|TI81&rb=40QzMK7Fxi{WlGrJK~?$o|sLpyW1j;+3gLaZTcO3&S*lj z&4lk{Ij-0{pVDhJpo3teFQ;va1imrW>-0U{;l}+Z z+Gq@5qsW!m3o{HM(At3!KcHqXg`s1zr`=bTrss*5bS1KV8aV!>gSh8|nT@bP#YtkS zc~yV9^pb~qDX$MDEYX8Wm4Pd*D`{^DTV91XN=^}<3AMa`_T4u_A$q`g8%U@JFF4h? zY)&Q4I#hL|Jwa)Fp3773m0~=2SiiGVGSCMI*hu`k0)J&7#NjVL@aKUv!z&9M=Ausv z6dymsl?JcqD%l-kIaWyhl+uQ%uUQ_!*SYx>ui^HrP;zI3@|M?5-F0^Wn8U%z{S9jw z1iYnJ@wV*8VH5*Q=H9+~h@?+b(W?(=H;-eHzx8B9|IJ-I{{#DjcLB?jySSdhJSz|| zyfyabdm|7Pw9>5Wvi2|~AjWGT+XCS+vA9GX@KgvSC3lZb4F3)K9>>lU;T~G9r0F2a zn~rI^D$Dv$5mPt%RPm;Dr_;M6i=bOBFLfN*&+UgMiQB`wMl@UlfX2aEL{#3@)BZ=R z!qAGmjvsu+ubz-2ALC7)SB162Nw5Zhfb2#TnC%x@v=x=J`SV+uf?}qn?9GQsnAEZ+ zK_%fKx1LE$MWi-c*=eS(M+ydx@rdAN-%0Clw_8_PuI`Zqd7XV=-9VG;ELcKapwC{o zn{G*IZ~M`x;&($6fj!!gfULL5t%0+I&2WrZZR_2cKYs(7;dg^9eBS_8B!q#nQ@v10 zacf7vFQ{`=Pmra$`&7drPkZMKimpNNG!`#>UXMbr?v zGoo)1e~aW>q~9X@7Wua*zD3zAcSbdf2CQASq-YeQzJdiz(;aHD-MX+Ns<_ek1AH{6 z#*m5$jR!L<*O#N2nj_3(VA6gjD}t#fSfF*HaVf`ISGh=J$6@PNWja;%g*Y`Ol5QpIqVBbiEq(`%Dh$LyEQU$nz!9m7q zNoU!zx#Ej8|Nk&4O-X z4T9bn@U>d*rDEKtx8vuwucnWCpINW!zN`jppLkTS6-UXs5q-v(^!bRNU1>8m;WZ3- zcyF#e#23=P^KMM|BWqu?>yk5@zkZ$cPQ8Mnie63P;U@(bzqTPOlnuklYS3@9jm!Q! zEK&l*=-A91(W;Iqyh*C&qR`guqgW=rZ8&FaPWCMf;mrlDDXweLgjY@Oy$`p)M8MCwF$i$~41ooVGlB#2fpdwb#=ESw|!EEIxcdsCG8S z;EbC|YkH?Zsi(GFRNaPGI~UxNy-THT!bxqr5)AF_2^~ix&B+%8XoIc~tg(%eqZ6<= zjQD4BF9P)=43Ki~CwcQG2K6(vJ};n3Ch5y;Wr+Mh2efM5LeS>(WC$8OH$YL~?9nCk ztP~HuVS(@xTO>U&ocX=9Vvrs+4a)R+DN%mBKqD zVM}`IJScYbMOWi^R2euMNR0-RA)>Z~42nj9q5B2wCZeVX@QHrLCWgM(zHi{f4wRLk-y!v@u%(RuB6XOoj=#`+a7 zdPR})0pj`rw(r-X_>o%(fZ^Qjemkm;$9{r-dMVu|Uv9mgLPibQAEr6q^v_F(U{M&m zNy%k+CiylC;AQV{Ka?DDCP$!r0ecsd#DL%kc|n@9)XeNj5GkNvL4|NGvf2sJUyQrR zh*}5)e~DJ5$jMkcABap&LKFi_iOv9~aaszCT@(OVGLf!_5&WbAng3%wCPp^i%+D8D zZqVz}#ZRUHpIDlIq7i=EShym23m?-mvd@-!l{^_f5eCli@ivyxF*CqKK?7|a=gwa; z!lj24$Nj(*q9}5n_&yBIm@P8i>`!lepa0o{MGG{?LtS%pmobyi6LmkpvgR&wJ@&Fr zJg`9=AL3LT((pfS4i%p) z0ks-4Mk}JHT^c_~c+wPTos^o@7$d~ya~e^WmJPxk_EP3%Cm3#M9;S7-gDNJT@e=-V!7 z>Q{8Jqy1(#Pvv+M%_lz&HMt44FsJ?MSc7%)1N%qIt2WIyrZRje(a@8SURSCiPt87J5P59%!{=fxNq?TT+Q*+1p2i#XmjTeNzcZ`!}2HKdR;!<)KsSCiPL zwaW23>fh?dDJ^*sHRNFFy`9p|BTMi(?O4XdrS#KIT&$Iyu#y^o#pmrC{7XUWhH3&; zMvb#T>GH{@z4TU|)O1Vb`9i1fSl=r=Q%cD4JE!tXHvK-GGXHa^AZv#*PT|FTEfS?`WnTu zM54!s`E*KhsAlW=w}mR%IJ3IW#7DHoB|CC#8u%gKSZ9@cQ#W{m9h7%nalL&Csb zapMY;H8x^jUujH5gOi)i5bZb%A@b?U`G&IkYIkYH&0hI`v=g5#f5gQV)tF%7N6!=9 zi|@C-#MF7meS}3NR7NNmcO6>3Ow+Y&`LlVCASl1W);rc+hKTeD@L0{Em}ch2l+m{F zcX@|m=2e$GYSyDueG8iNDW~S-zyz6g7o^$s82xnO=Vd%opv@@N1sb?;e&*v?&Q5n@ z>}mw4$Yw2nw*xy~Zw)TRDDX~Lb7ngvYxpG|lUy!od!5N~pf&YSRqbg*H)ECvE7bF7 zZPmhj>*C9()JAOn;7{Y#rUU!Q`tE5elVI$Q`{+hfJgn08xRy98sX?vC5I6=_H zl5%P-%vVoOb?454*2nZA;qfx&k5L;qOGB^nlj30`zotB?78ZP*$8IkvP{U@8s`1X% z>U^Vrf7zccCQij?wtmu|J5d*+P~xZV9XI^eUo(DkZam?s&eP?p4Mo>94rRx$nfsp1 znXeX{tXd{Y`LM%G#M%hbG&vnd4evEJE$qrKAvDIa#mLzDux3}@PiL9z$wQWOPC>^= z+4`hDmgG1xTP=p5V#eC$0464Ass?1+1f(;6=|BNTzReFBL}11g=#mRil45nxF?Bx| zaDeCC@eh?3T4B#z$!pJPz~vm(a2-1n!W~mo0xyg;{S14LbU4c?HT3-_rX4zKw|3@$ z6Lyf3)7sU!Zc1O4I&uZQB>6=E%UM&nO4Y93XHz!p3)+5}XZG2Y10fOm(fjhc1Pq#g z{67TdYTi*>VPGTcXdt1f=-=D3A8(+;TxkZJq2m#9g)qz%0)q`qz6r{$7P3a%ho z5*eS#opuj3GwIoXjR!y!Hl?f?SD7pG+14tB?U;^6Y05;N7ymgS7w9z@<=?*Pr`VUviCA-&p_p6~m#Hc$7?-|03MPN;T+5Q{wh`UWSMUce z0(9e9b!)05-I-hEU6R?kyh>tkau@N&zwgHTK}w`3(b>#`Lx}>L;5q2VK?4{*{WkIG z`^)*`RK@%n$oNRi4T&>`sa#edJ`!rdzV3a4NJ-PdH9)8R`R!O`0!E5gxndi~|& zrx%{8FX$|q^V`SE|6axyK!*(6^sgT;{<=iL(82^(GXrY+{Xf&MFMlrY%Au-cxqzQQl50Yil>_U z|Co#|z9FY;<%RaW{H)Nf1i6WLGVeywMXIx+Gk2MH)G1t$<7@6gQ7*YYAt6*cpZu>7 zAj_Zpor-^AhJ2@kf{Zfp2%qU5S?=-n6{M^5tJIwhh&KFlB?UF5HiEw!r4{rgXGX)5 z(U*#WwPai}t}^)i?7^V(C4&#j1CW65aCtzb|6Cv=xHv^_Fcs7QAzhPXPuX}kfA2sp zcIfQVo&Gr{KN)Q$s8T_PZs@(Vc0=Q!1|X#Wypeyj-Qcc}298;d2Zc&R#+~>Km5+qV z-2|-=FD$cC9z;9<69}1jAMJumcz07N@_9G$IDC8kA|U9d;5{<=*Cl@LikI-`{mtK4 z{i%AFY=Wjr9vm#n8e+q>8n}69O>ZP-H-Ia|c-dyvLB!Bm7|g`9SVe>r5=7wF=4%8U zQ&4|1a|S{dPtXbIS)V^5 z7)oWtp*lm)N$5gE>`nrzJasK5kOCe-SK!z4xU1&hh&KLNc$n=q_o^gM zA+dDc+ydN2#&#pS!k7+{{TRZuVTiVKuiSiXqZm@ZUz&UF>+;YE60mPcX~>}2f|-A} zC61doxaX0L{3vb7)%GwxZzF$uabBTMMe%+Ne@ZhnZl*(c3XzuzXdP*(Q{#%~;vkUj zN#n3+qZKVhQ)ah&Zz#(yIHRoVJjGm%QoXj(vm3`1eq_|xhsYL1!){shdjU$s=o0kY zrN+Um-*u077CZhHnX%2%BPnx{Lv4R56U^t%>OG$~BE1`t6{InW=3_hoC6l_0kwXg> zu}$)nx#pKHG^knE(vRLW@5nIE^?zdb)526A-rkw&Z#o;r<@IZ!PKS3+R^C*Fz zOuQn($!!EMCF?-8Q)s2bc<;upA+6Bqsy?Yu`*xGkf%0}~((C$b${@!g26&95ct z@vZ+AxLg$Y^`~0<96Wg}5U+Z7S1}2?jpyBb+~!%jD4vgTa4wj#^3%Z|aPa*Etq^a$ z2!D3s1j(_%w<^vwlmWCC-|BrfU{*2J6!P|OdEi?-XlZm*ieW8QCTo_h+k28D^wy^W0_XG^wej(c&(2z|5a8Xl5se33`A11n)2v0-PM0t0F@`J&6p*E zG02?eS^KJ1fp-~Y+pvP;yiKsE7ouCIfB9QCyE72EP)8Z-v{1)wl<%fyg>sAoi6^gG zaKWfV#cW-Uww6ap9GsikfXkTEO`3mky0e?Yi?-}7i7~Uakkjm^Sxdd_QoS}Zxf}5n zCLs~w z`yFp%hc0UIW3b~uH+~M@A90%f1g#OTnKtH;#k+T#*tTBTo0Z1yS+6`UjNY(f95pgi zSHz%66ZAH({4R4#s$Bv2Doi_3EOMvm?=m?dSyqp$xmDfFdz62xaq&d8L1NjTUA_`# zz&aaO6m;^;*<1UCo8{qX|^TLj6s_SEweD!@I*vvr*gFH#YK9XjFY*JN)a;| zU-b%k(MgQ71&L5H;q#uP>@a_~$OKs|vwB$q=ckD}RH(4(jTNX2v=$ znoX6KbX)oJ`)|{5-KHBKnk;H-SanHAXf~ycqne)Yhqi?z)1#2<&}TH8K$bAP{497te(!Ruz8bg zNb5)aQW^C|O3c;O9=S}|pF?NO8?RgGiub?Z3UC$~9nS{Ng$3h2;ww|vV3+h|&1mxO z@-`@TS9t{r1LWfJm^ni*_Y*dY$3!xS$z5v^T32xSkC~6$k zYYMHI;NmaGYWF*>V5J177D8SI-gS5k{f5Rclt)NI z>X4K`-X=YwruxxhZFc2c;Cj%~XlD zY<_>=6A~pPS3ruva0C~-tVqgYEPyOeIfGGtZ*wUqmNHDS+`ZYX_`IB#ir;R~pEtM2 zTC@AJRHcmyNpeQ5fxoPfZjvChq*fuuC+y9?khL@fXayA7perBMr4E=9c4-IMHup#} zauK|^-C^*$x@`zXf4sh0{$73T-HVRl?XG{wV?V}H07Kz@(IO>|>h}G6YmSnJKODBz z92GKDdMJ!rYI!Nzeryp|Fr{1<%WfFs@>UC&#V*f#8B=IOuP;b}GM-TBuC(KwR5wFK z%D-R1x*xE#TNT3A;vh&$Mtx>$L0+0&i;IDz?v5;^%3 zY*dKC|1$~Qqr^KjxCfS#^qP19y}Lr@C}fzWkb!n#0b_ z&0*$vrXcwzi$hKdm(heO6qhPBDixQ@(px8g?Oe-l^R^P+=PCRG;o)V57a#}_JMj;6 zciQZVu6o;?e{s6$>vwo3CE1c`3*BU)NS3G(`F)(>a5xM<{CVJqZ%@b1r~jN491OE4 zj68h)aS-%?(_g{qrpAL2f@viVpWhEZzi=)!9Y;EVbEW7obZzO3ug^+YDk12p5UIFFZ1VL z_~AEt_yZMI&K~{_MZcHt@WcNOKhXz&)&yI|gJ4ByyK92^K{97u5?e)}a*Tt!UBt$k zX-Rlpmnt}OI29ZEm=)B=xYmeWAEUk{QITw9j)bQ^MqTAW$E$d#xPM1v?D7pcT{kbZ zkMgrZI|^o`crfn<=_b_~>C9c`UFl>mNb@!KprA{-Pe=$%=QsaU2FUW2e-p`nXuz2c zvNCAm5w7VSDDQarDAQef3c8aaqYVFDAghMB5&U74R?r8|jFt~ZACO6FNjNZ$8GL^9 zV9@!L!I$U(NI-bFJfPsO3uFWrC(|uW1vNlO_kiS~jc@aF2Xc`^XP4ge-!b{i%2t9Z z6?Eu^-cu_#bPnnO0{rzx(uTo*T_H_6X1UtQR4T=|6JMtC9#c6?&7wEy45adj3y=x4icf7 z*l@2JZr(|=8;KbPaD^D}wprYX7&;51GBGVy5#fXc5$J(=Z-L1y1`v6F0`y!!d~Zyj zEMS%^Z;*qDEpLUpu9|JIR!6s;*O z7a4t>2c8v_I)w;IkO!m0Qd1VTAv)gj6+~@xr+4Y@XdRugMKtu$na4FnJCw?Z%W8@y zI79OCR6>=ff!$>Mmt>WH{(inqmRzdWsk$bRw5xB)MY(Sqc^~Fyg?AI(>0LAljb+m5 zV&))u$||~g{`UexHX_q&jyI9{{i)_uWM}9?*8`w&NLADKGHY`ETN~LLMsRVLJVXu)IC#ZB*5PsmgAqajgLue}aiOXe`kYu?2)H;{>cq~qoe;5HIA3hWAB z7(MTO2t&=3ah-PM-fJ6oEjeAKw`WHq&s${z_9MA@5FF+p=3|ND#te>pvhn>&UvjlS zOux60zhR(P2!!ZC??WI>szJ`2K%Ok*sRCN3x%k$o;;|@*Oz)&gaFo${jK!hPYIklZ z%PKgdtQ$MUd@4YH_1Z?yFpMkosOU%UFe zyk91$<--`U)s76eas@peJ>Y#hs*nspeZ_a~i0_OObe(vAaM1;RF!4z0LTbYWLtAF5 zy^B^xjPpEl&^cCpNas9{6kIP&s;FO5{1)P{lWsLnOUUWHe=0dFI{5Wbt-Wbt9wkQM z)g5C9dK1s%e5~+nz4vVPQE-}8GA;2-!S7J;ae`KeH_;1!Eb)pgy7a;w)4EKcz4wjh z*@W4}@i44^ntbGmZ_%Kx*ld1Wi`ixtb(%}d%V*7^+9?WO_^w)=m(QyQG04&fT{dz% z%)tt`IymT$rB;#wG9=nELnb^kYg=}^S?${bF2{;8HpN<$)W}&{G(gonJ~FfM;(pzLLIkpKFrMu=Q7SE9-KDfLS;b$vqo+WrA+)AxWvJw z_2zDW4YlX#Owe`Wm5Z~5 zeTe6hUaYI)WkTPFGV6L;NeScE+{^yhhTnKQSMamZC*K7>~fI(&&v(_agJ9|pl74o+5$9X)g!G}w!y`v z=5E?hAPs3h;1o_k8VKCjegY+cWa!85Cr~~)&Dp!O;Z_kFYvwbvl-tQbbDB)a8j+!Y z!Ogjl>XtK%c{7pA33xvI{6T}9tBdKmObEEqS;xG_Z5D30h1ZdjJ_GCF*f3|IbvEmETNqq zG0F)|Gg@?y9OWd3$B%Giq?r}+uAYCZh;20!Wc4iW6nPU)F#)0-;X>w#?Y9DyB%->v z#`TlDlE?SJk#D@^D~OWyv<~($_`;I@Svec}P8*K5#6bS7QbcLvzK8L4t>C494H-M! z2`_SkrBwe4Uc>EL!wbl>*Z0_xn?-ChonEW~^N3M2P>c3p89JlY(w=X>uE|YtpC!CL zE3hw3VE zrxpqGauKUshf`dZNZ&7eRjYx=lYfe7!VOlaV-qlkQg>+56T|mxUM?xpE7nQkrCmwW zx?%n$imd7O&U}rpA|w`tdZ}rMKkdU!63dp*gcL9D6se`AeLtD@DrcB~k@`Yp;#sM- zIZCz7Nx#zCPEO@5YfM-xok}h=Cq0=pC;oc`F#hW@Wx`|rQnTBYhdR18e_ur6qvS#p z^dZ}teN{^GG^U%T11;9QtjYB_Kr1O4fQ(;|>&o+{Gu1o3b$$ceWkfLhEeo0EVfCjV zrb;(oq}+$@%w}y<;c4nZ0>hRD$)3yUr&WtYX=gSgWp{I9eo|#}>!<$NB$+$@6OGsh zUZr?h+6uaCn7p4u_3W#gUAsIQr85n`{{Y!7myDOugenx5Ha{vBmx8oZCV%Z*xsoKe z5%uRQ+T1k;#F4lnCMII0dzulHC22j97A4Zr8loe8z7qFQ2db;9L(Ukz-BX210PiId z4++%L(;p{#`tj-g+tUwM0Vhq2WSXD8{eEJ2gW|u8;zcD-nlYjTJAM0p`uT-YuJH4Y zAD~nS{Am1b@LRq<3udqc!+*Psy*_JTvAp2;Vfg#({!Zom(=y!UZ{C8iFVQl^k1MGe z70xDFVHQ8<*I&Q=^h9IxDY44^bYJ~nAK#w-{nU3xNjQkDpJD`KTXYYAYn{Li0%oPWA2fBUgCl%WMB zCYET^?_8Q=w~)53wD`EaUcm{X&|6}n!}|t{K+$jH#3I~b(Gmu5q(!NTl44*nmsX5e zswbs)psn!=Q%Ckh8)CUUl0Tyfh$-4~zeOvF1u?LgN@G+Y%pQR@r-o>HB-)&5!kIh} z8_p%s91i4<3m{zZt$%0>gMsl7v_TPT4@Fx_BI%Ky$Q2O8_DGAG;|#(F{FTy*Xgxt2 zLX@A(D$)>vh{jSlWm1Ww190XAoO$88BibvR_gHUvX_f&XIA?Z+#iSW{0jGW%r)Z)y z){7uBLSu89E6t=AI|?r3=-eEvLgJ(kC8qVQ2$WR-Yg@5M8X`;2}+9v1Pe0_aZ z)JYXUk)h$f9w4xw%~3sQt&MviVBh3#QQ{fX*LTl!ltO)H@v?t_rRkuvs23&=ARyTU z!P|!lXWYrac3-kf6~vOIP{aP^S)7>HbN5Yp!75Q2Xmu?azS7938=iM#*+c zSzJIQA>SG~pmizIcZMAxH#^*7>r=dHD!EISN48som-~f&Yf!K2{HAc_JeT`vNpgKe z%Od0{WVda6ubgH_Y;BEw+!3r}_+4{|i9By>Kkp9JM}Ij@j?`;Tb5mGMqnrwYu2hFb z9|m~{Q!<7`uNa_&FS+2Z8n8yzTOEf+7u>~1uwQ$37NWN;H{t@KZ3VFX@B=3rCjGic zq)SHJpz91?7nN^bC$vulnN)-5h?Xzi!M!z_ECw(h_sVl zGrAji;eRFw$`7PcxPU(O`O7?LN)g8FMj9_s4DFCTaePb5i9+>z?D+1iZe0yb#`jJ) zjia$|#k`xwk=7MH)JwUM1V4QpcX%ncf@lj9i+6Y_i<-T&`miiWQo&t)i>ft9+`e_YGYlK6 zjheJ8y(fOgJU~wxokW5?GO+K>LLM|tDjkUXGY(Q(qLn(@1zW3IQ;9oVFgjJ&3w9qT z$$w{Bt4kghvq^oQ6DM<9qd!~~KUutng1HV1Zbk!)gy`WsZXtj9?W?o%!xbAe`vl+| z%$rAEkjB6d)-(SUwwVdlR`d(yGS;Q_>{9{*qipN?!r~+Ao8n+_W~%bMVd4HPK)=Lv z)_Zg=w}}m^%?L4-()iJFe1143!FWkl34bYSdnSV5qwu6{oH`JoZ<~PEwH~?Ew=|Qd z23hOa)3%3xIM@jarSt@WMCz>bxP_5rO~bzY_v@+~ICivZAK_o01vg**vdXJ)X+=Ka zHE;kgq3@0@3>1_8`5tjU>`i97)i5SAP|r zmJq=ZfMQgvAOg8}c#XZ3VCs9|+nh_7P(niV`G|*q!iD2=yYZDqnO4N|Mstn>`4AH( zalXY{o%JNM8PtK?{e_cjTsy_dG5!@NwdIk80hH>#9*>}9(JP`7dq%1IlKdmY2JZvf zd&hMFTdh0PSMW`xH)81SxkEgmr+*^(CQSSu?W%e-K#YW;wpd=qNz%tWQN=pf?zdFh zm*n}`^o(pa2NF_sbkSXOQKBpaCqAVB1BYogQx~J~>oW$SzIQrZ<(KfRKddC&Rd;+z zzQw1L)m+~7+*?o~HpKF=*P)ExbW!2(Q@B!lNq8c&TFU5_ckg4Kxf-WfpMQ!LA{Qx= z1aHV~jeg>zmYKuFR#C2?6nc{TC4=wH*tD$&bU2sRiV_*~)=_FPb)|H~JfQ;bxpmO2 zbS9o4g-`A!PiSlu4y9g?Cc^so*jeit0Uj;Z-k-LnE_pN!XKIwVeY?}BVLGv!W)OeO z&i5;-5jXlBKH<)7iX_#LXMeU(UzEYgd!l8WIo=`GcP?vAXOXcvAvr#}2TTy)ra!vp zQf^k>eR2;3^=W_vYJ|~4u!*`&3)3>VcPe9zg--=CYha7{TEa zs7r9HEhHFzv+8@+6AU8~7bcw}2$#qKkvt(;C<`Xzt26j}YEl^V4S()T{`@OF{R8j) zgk{|pk1D~J)RhUv-45gW}G6A}Z9+ZVXm#Kx9sj&Vz@ zn??4m?Cq|OCYSaVXj~DdSjovA^?7B7n*0BljQ(HPX}mo1zMG%{@osmU!NJ69i5Ica zN)le}uvBU$gg`g%`+vjS%woew7sVbib4#4JkYms51czZ%5ndmd zdOt~|13XD>WmOS0Yn=K_VW@CXsZqa5sqK325Mc$zwz9Sx-G2dVXy01>pkN6C*@Mqu zc~7w1P0)aNj`oFl5b=T&QL^4)sWZ3C@uygx8TYTkj50zp$3HjT+=FpEL7m&+H{}9y z^rnqPSx&76i4w0J_Dc?xWZV(6Lpt@%KU~Z(_q}O3VPd3gz#h7Qi@2;>%6~5>b>%D-L6YI_Qdp4vB=7*r%d;A;V{{&o|Prz z>{)u>?0*4vBV)Uf9WW+?f_)5QQW8~V)KflLmB^O&hi3NAA+7vl`W8N-PKMWXLc?8} zl3WGCJyll1IXjar4$;@Qk-*(R4+w;ya34b;08tVq@;PlhoeQERQP6MY#32$B&Uquj z+o-j6UJ|8&cda-}gK%b3qnbY1bTI`RmpA)y9Dnd5g35i2ZV`egD{Bdzyw?R7ujtMt z6sGm3Y5`Ar$2|fGT-mfQB06mlhD}4i@$`|FLU{nqt$&c_ilyzwbND^7CKoFe!-e_0wR4|!*+}ee z0tUpYpwEvbmb+Ib6&lyXLV48>O725m=kiAWq-Bdv22oYT-nwEXkox~1EERiSE|w}) zhYOAdV{EL+GwjJ_xo%cw{gCkn*rxMEG7;94NUGve8432%Z0}bUM2_w{W-DSGqLUE zXPtH%77LG|opQpAsgF1h{-3IJsE$syYE<{J+m99O?&3OfCaCd;AZPLGQwQENTz0cF zARX`#anIrNTPeTX;w>&j$lN5+~-*Nl;uCgaVsA-(7>1D z{)FS+PtXeSE)^ZmA>JA0dAA|3ZUV@8)vRtDc4KTUulEmS1tNc&%8KVeWHs~9mUqY9 za?>>dUG`nramq-Jeg>9v_$_gjyqjNkgcj8mnpC149V?Z{-@3J)fyqf9)kI?I<2KHB zbF;#^2^GbI_uqJ?0U0;IymMP8RF-Qe!p-oywPxQfLiZWdWfuPyvL@4;!|HzNm!E3J zHXe84y~3hS6~ljXELUR&Bfn-FJ{8q=6SP9SN)^L%hzG^UhMZc{_p_O8Rjux;(t7D)}FCKrTc%5(33y~F*zG2^UzBXT1 z_g0j(Vq5Oe-8ZJu_1bdOg(LdT?y}UrN=OkpTkQf7#SIpmYD8q){z5U|UkLm67s_sb zq3HJ)-eMIjM~|~$weCe;Vt5BxSnj;*o`xwJgvAJNla(9M4znWGF0TF*+V(F-TRP1E z&2kt+cp`t!$oSk_#k1G=wkP~3%MPQ^b4dL-Wd@un^-A6iq00iUt!HO8NHEiv&@$SH zE45F(maTCQHfbzMxC4Jl7s87S=nre_J=c^{arP!9P)C0S@?cJDG?{Tf0XhmHM%Zz8qvioI*T~OE7KHMqTzBKN& zJsW>WH+R7BoDaD}8{^)Q5RJbj35W+uPZV|c$+}HOx_HK@jL>)TsZXr^xzxz9(2MW@ z81FX?$ZEL}H=)kt$)~Y4QNrg%&FZz<(c-hxuhD+e(c;_MRkwVzm|NI15=sj=J~NK* z2^OXReJw2R6yg=gz@;o>Df&Dx_;DNx;}L)L%Uv7*Fq#_i7vP`;FafZ*)1`Q6*Nw8u zTWBN~%(gw0FnRJ$fn9q-xJJ(83#uljD_5*Ix3Z&$%TX* zUVJLY5?^7+d@;@A>{Ks=^UQkJKge{uP6|v(%O{)tFgYr|?Sj5dEHlZJE0pVjEIGve z*1@uQz*1gvw1^Tl*?Jg#uN5?Mnx;X0`-&@#MplebqxPCUvy+cr`n;!b8sm=@G@jg$ zdn-qkR*uo%id)e?p#`;9B%a$E&$oZ#U*?NxuI3p?$;~Xk5e6%N-l~PN9v)VAv9I}W zG2#$4c^FiaEryqBBC6k92p6L2k|uvN0WP2>`kMm)vnfFn%CS~ks&Q_h=FQrX^&6Ud zUrQ#ePm3)6L~tFq7Q1P5ZMv8yl<n{I1xA0oPOp*moXfTLnLPhr>%?+R&Am>vKS>H7YyTt{YRmb* z0+cIHZCt4i=&mcXchea>vEA*A{Uq^)_LtwQwA;8ZC103x&oMefx2iGJBxCIl^*?rQ z&Sq)BjIg6@>3ajzW!2;Uypll6wtOLN<6MA~%r?y~2<6JT+l_8%7^yj{pKtm5sb&FN zf`S32Bs?T25M@n@cH3)}DXCIa*W!gLkXR1!SUp-BW}N)%{&FgRzP-Qv59L%AmqA~0 z6SuioDmEE^Q5K(4(86AfM&h#;=gojLfHv6`*#~H&1#O_JE;C4dmXAnBNv#C-fD7jl z?Q+}-ekF>VciTWwd!g*RQkM^tSeLDhWaWLw?THn$ST%Mbj1m>&64Qe9;o?>*T-5Sa zv2an&&b8I`Qdf&3gCJx4j^*!}M+Gw57tpveml%3Uwm)TKH9SoBcmGT1yR|-)C{Woc z#jPba?}S>&^FQaS)qukE(aORRK3W_CRAgK2gfPHzZ451K1}1}(5OZ*{bQojx0mzB%THGUlO{$o&8Lq)Cx#~|{>v!- zQOQX&MwDRF$M@;CFO+hH#~BZxR0upYemD3j-(CeXID+9>#@=2vusB|DJQ#kzxZi1< zzgmW~{NyDF`z1=Ic({?8QQ>5w6ozBiO4KEqE|e|^4xy!`8B`2b*m2(Z&1 z-(TDb5R3@JCuSv4N=^U%`}F6_FIhwqO^I>e@ZWDUnTAl5i5KFhb~1naolbwllRx8N zVa@a(KlHmBPKlLv`seg3%BMBrh9TlqDJf@&OF^{NDBKd^P6fmfA_|C!L|g%}0z^?F z>VT+AJSiPEe_!8T6?J$s9LdD`pjS77J9)^2f0p+w325P0MFki#2-$BFxEL>}b5o1X^n6ooK&H1DV_6t#v5 zg0FX8pk_W=HW=614EUAjGV`q5XqEp`j5|t_f5!U*yQ7(*$_+ooB~0W$RcF0};V%C= zKg%h^CDZ#5$u^mCs?0vEoiq#xe|6gKE~l4+Ja_Z4&$BeaeIBCU(sH6eJQe&71@9-Q zLA(xL_+yC|oJj88Dhz`SWa33q2#<)4fsgx)s!88t-~(BMw&J5aOst2=5KPa8$!tbx ze=xm%qz(7pxUXo%W!3b~)qTxkm^sL8HwO)FRdCQB%Plu(X>iVzXrAM3pJy=jdgp$5 zVAKYFrvkIA*iftRH^Z#rFxY_kG^1BF-AK8M60J$ zcGsHSO;Ce)2+_tE;=vF@b5t*5h?in(3~9C_#*~e*w*}VykC&9CDjweCcSEec; z1~Ii;MYLv@eWofWe@A#1H~k6)s<0BwB{=8K*;)`P6|~Bjm-%)#J*H(_cfRo$t4(Yj2e;&BS2s$he|I78y71>>R=Sd+t16kE zzfp0Ni1(_B#^{HI#lkADIQa2x@oRfW216G#WcX)0G8DQqc|*oR>XGFgRae3U=*zhR zXBG9O*aG+-tnvI796VLVLqR^`oqSuL`KA#cUHsIX3Ez5>)(RkuCA?&%f+mJHJn)*{ zw#bis4(>3Q2VIDNn-#^O^$$Tw+EFOvYD~$%o3(BRJe$~K;rjO%k^(ZOh~b#taYQi&l*R|Z$=eE zxJB>ie_0H$mSFk;Y!HJUsU1{;;Tk_n3Fgz>x#B5sFSyjnd++kXY`c-2 zZ++~*v-i0ha7x634%#Y;78=ddX81QZ>C3tVf5gI*zk-)neF0rnY+shP==C#Md6((+ zHd%aYUYBC}GU?mZn)P0VW3+ek)8HL~qdsKcDhEr1m~FwoMz1a=s5SsHtLBK+{Lo$ ze{_pWKhO;VS@6xr5Xck(DSm_&mwp@@{LtV+kMUcmBw*qHti`1tl6|O|4PNmORbUo~ z6zZ>Uap`}`26`s=z(ZbCW(1L1KQjn-WDxoZY7noy6Fj8Fg=tO{GtU;6<1H@TbTn9& z!FwK~-ii?=?Nhz)QSWYo8pK0z!iRLYe=tdj{-nPJs;y#T)fuwtFfhSne%1hSsTv^k zTH3G%h`PV!)YsqA&p?A&5xny;DvguZz@937k4kqF)F7S*w|@-r+z@T}|EK|?|4|wc zxt?k*Y*+ikLT~b+kJm@LpK>2O*N;2~IxUDb=BY4uC`>0gjsKfO6V2E?8#iy2 zaBQn8N|lU1qUT}x`CkUc0s;zUmt$Wm5{ELYDz`GLE1lVwu&)y)f4y5vZyPrdzWZ0~ zF*%sw@J*l)Aj?*Pp4!y6w5KM`r9si6K>vP+@5jE^QV(lMyWE-K$9a>c!`Fch-#2R>5+rM z5r9ttPLEnZ9M2hEe}LaF?sppJ-v9qt0xL|o&APb8uzRk%+tf!Br!&CbSf0@{vd<2b>#nOI4z;3EpgQNYW6()b&{ z2-FIxqx?_H^ONf2Ac)f(K_?C2xUxy1MFX2mznJ@_B2dC1lKyz0nmY(o=AwXDsz+RC z14!!Jgpj+? zCi@@dOf?%(_G!_EqwT_TS|#_?jS_ZIS|*7ETRS-ye>Ai>Zj~)XSh31xGzS;PUV>T) zx?cv1fz+7Mte$5qG1_fA+FRn~^azHk3KHSa76;6a5e(BCVM*q9Q&gB{7<$=OR16Sg z*^l-v;F8o&K9{iJ)ldbXTv#cN!vE?bL{vKvM5f0qM5GdSYAdu@Ta6sluE@ec-Y^t?zP{6Rhvru>?)9pBLhv6k6kjkcn>7`UMD@9qd#R+Wr zf778Dz!@h}%Ml{iQL4I&s!M+P2nFDi8p8z|ksYl{$pw5X!ZkK@Xjml8OvNU>+@@%b zEdVJk(Mt6tuh2`)jl6Qp?Hb9PlgaHGem+U#dAPQVj*i=FKE#W8ON&hzZ#fs=j$pZs z5be|1h`b~^^$1^N;qO#{&N$td;m4f$PpuOSA26?k2v~l$$39NXDe|Py?x{rJlE@4Ja^HLf8>v4 zT;HOJV|}QjLiAdRPpyxoWfq>%Nc~#1i7tf_#Jpy2vru4ZqH(FaW+7&8&WKlfh3io= z^a^3oQD6~hjj98uHw#fYb`eeJT6!F#oXHZ*8hUE$0n-~ii-EBkGS9fe=~)b!}WD1Q&&6mseV8DB`2`9xXIEC3E?THXUD@+ z%4$3QJ9@e)eds9oZocdCA4nh2k#ROga5{BO$wseP)#|cpW&2R?lPD3LNwP6hl@gb? z>ASWFnQg3jTL2vEIw#zkp5g{wPsPAf(=**;=hI2abmYpO6z#y$P)fY}f8+fl*mr+^ zT?|85R$|f3n>U@L?6edqfw|hqwERAQ`Dd9GI&{wVa>CJQuPvt^m-!?xP)MswhL&=$ z^Ek@7rNI(AoBl#3#k+`muC`6+@fgUl*mCWw12J$zd=r!rUTS_11FtNA#?NRSR4nLt z*UF0=xJ7|&@kF{Ls40%@e`%$~g0`bNF7LMc2F?gD)l+1=>~__%&cwX#ZI79X-HohB zRs4u{oyvgx+g63Kd;fAudtxEI*bl!!2zlNnXoNB2Of3s+s!BFGVprX^+)wpB=c0cC z{DkUrQq@t-2?9FW8#abeE0eA#5@oTC=V$Qyg!u@k{ld}w^eY`cf8)a+aIo{;|N5cd zG9NnpG5qX|X@xLK;|X)rM7czm4(OVUjbsZ6$*pfk?Iy8NGSp}bdYLS$hm}3uMTg)x^U zPOA!7QyVq2s=8Ele==sWS|Tvibv`Z?E5iPc%k zUaLk+Y;6~PPo>5xT1RKK3>Gs;9_M@)w3x;0p=7@~w#zDWfT@;1uBWEeD?wM(kX2`$ zE+LC{O=EW52JUebR?yW3lLvMubPW&zbqSYMF?J9|?EO@Ge-3H?h30*RDpQSjCOvhP zp{{{>c+x9iDvg;gzZ015M1d^bG&!G`QMnO^!}6}+AVY|~b!56V-7K$=Sc%E|L?$MT z?}m;d6H{IKe2Jg=m|EjxW^>*|&u6xa?%wV2fv6JQHT^h@%L?8+1nc|Q3D-nwQE!o^ zMrW!8#C6Sme{%(`|7JFvQS~QFRXm3(Ltn_w|p z8F{cFLAa$Qsa+NFm$&Y-CR$xZ(e$xkY+##t;SknVz&aAAxg{TmPEFTwY?A57iPLT&3xk0 z*N$-~Uzg5ZzYh|1FctOZyz?>M3mNsN>#^0@g{kcZQT^+HPUl@FPCDfLzdoVB>Ju}p z?L|hB7ezT%m#Zm_? z^K<)bRn%v5gu~My20=EbV`5!@LrbDM5(HB*}u8uwz|;>TS9aH z&k=W`+QBkyV9TH%-Xo9mn%$Dc|A%Oq&FsOanglAVNENMHq{a=TbO|||LP3}Lc2)&mvpIj4% zACD}zACE06o|nmER3?{iEiNm6T1hKQSFE)wQ6Tw%03Lv}?Ec-!?yoPmub01kD&1M( z2rPDAzjeS5B>x4;Hw|?bKo|wx*N^V!H!0EZ=f)o`rBeK{{N3@DF0Tq4w*Y<$aCx;F za(jjR0sejuze~ILHl?R{jS`epy;E=|&-?$qv2EM7ZQHhO-r;7GjdjPiZQFJ>PBz}y z`sefgJtxn>`=G1l>YACJ>YBdv0!$`S07T{BR3Xy;z+Ee}83w+*o=W`P1IXjJ`8YTh13<-GGSppWXnh($&`d%r5*E{~k5*EVok<3ZJ-L?`||%^ABN zU*RZ0MVGSwv<{<^hSc#I@y;J8jHa5EWs@ADMm7`Q?YFa0urQ(5xk)LRX^wc3d->_GY{-R*8L#a|s^rENNO>OlF>uMbpPn%NxML0$}M2 z`QYKqOs!bv;qwbLeKXt&Z3u=^gzACw*-MlBw?*D7HJ1?givse>PUJna=VL+F3oX@P zuT{Gdzv#%CJTP3;lxv;%IZQ7hthZzX*!M%$+L}{mpY-B!fd6r_oD+y?xvt*9zC!L|kBc^{}8 zu(8~D%c0<)r`DI+=wWRd0xQsVmndg0_<`v7)@CPN#N8NjS7A$NgL%ga@-k$IcixWA3ExU_^U}kPNSXW{RGc{nC#5_#cyE&uAn=v-a@g zp21N=neo%-E`1P#g6vdK9 z9aU7nDq(us%ZgB|M)xYBCXfiapP~>#f450lFtH`n4NL^7oL?-8qd&!s9#};LtZgcn(ACNm9Al4wk z^7Qe7wf>Pr^f?q0>hZzE`JwWbum$J%(l<`Q#a&@kH|c{ zH3vpqNETs&Eb60Jxb_YP(L@q1}MoiQ(cHbFS3iWS2tA- z8g0pQ`~P)qw-eE3rpmYDSx)kmZaz0<=V5D?MAX47nq7m6K8pW1{f3x1-9?jkX}LaX zuzSt=LMROChhNB8<4%WO*$v;PrORym8vJ)tvzrG{OBUeeCSYid)#BN^=c$)D7oNRj z=ghY`xf3w@-RMF_br*k!>65U|`08g9!bgO>)qGTsm5R~CB603k71qw2*27uGO8q2= zF_&w%t%rl%>2zI-bEqVA5i+%(dISvk07LS=hv+xx2Ew=afq29->@~KL(_@ zQc_oiM=LkF6h&;uVNMn?%9^u9sjK)wp^t*dgr(}C(WaG#UjLCKlG4V2JZy|a0OKf- z^ouUX)2Fc@&XTG(5FL<=t{+FeYPx>9LoKESq*U(>Yf{5QEw(tT;O#Rox12?Di)_-c z>$@MW3j{y= zI+?T_sW**^YYhTWUhKYQXash5WGU~bAG310OV9&4*3E0jLX#im<_Lv|0E2(Zboo@3 zC794T{6Rlc8Te9+B*O##rcTi33T-;K!1FNE;?|uWd!?+w(QyuFCT8v20ml8570z)G z8=tyV$zJ+%tk)^*b)WD?cedh05cd@;H61cm!CwP5S)_G$T~)iB_$ad+61M%Rtoa$f zX;JQLUQNf>bnu=VPFLaa{{r|`m;OO-ick`*4M@r2AJ`7}AUwPOV~_t;{m}QprZ0lH zj$g$W;gTu4uyw;l@zu&_(&YbO;1lhikp9Z6Fk6X=KF{c zjJP39eddsBAJqR)@{4jh=rze9UaBDy)avDL3Ji0cNauw(`6O9M*t_TLy{|T`RinGp zL@V(jTFGk20+oL4*;|IZGDtgkj$TVH$ih46UF{<7^<{=?Ccb7}0krJ;ah-69Ltg3Bnd?c3P{$)%E8`XM4UlAemH~=IH^RG{)aTt*859-)`t_!%wB*< z{C2>Ix`KS&^LgB*i^qDMI9)+MuVG40S`gAK-ZHJxx&RTMLQ;n!6K(SwIA+{BzY!2uxs_Jp(yeJj)`-Kz-rRklxQs)jDVIP_U(n`R z>KN*a_QP|OIv3HW(DhzK=jd_gRW3Q=PaOzJ_}N|rVJz+sC`GDfT=*Z0s6UTq2brF- z;1p`5d`XT~7bfTYFMR*|>wzM!2mn)9!(!S%56w^7ghk zVN#KZmE4=T`~!Uy?kM2`p^p8X<6F^@N@?J=SyvQz%dIE0_0c}hC$?Qg17(U|0h-c_ zAfY|E^Rk)X`K2G~x z0wVp?Gg@n7lL8{sS$ZVtUG_&j*4VOakE>E4^!(waX1AoVcsTnVj45X6jOaM?vQVDqU+&d5X zhuKnLRa(uRq71BEs!`3|5s;oG?0W2LcSfk4guVHUV9d!**gzcqPDi z>FqNE#zlY$$|T+x(>BnSoOJw_+f(}<3zk&OPc&<4@lZdf!T`IILA6J6dxQF!3Xkgf zp9|^s^KO?1-kMa2{qD7;GFT<40^-Bix+H}f&)$)qk4FulP$>vcRgGDkJ=z$LG(JO;zj!J{p zHm=If3dTg7DmLGbc{?Aex5%up{wLmLx{YDTL$S#nzG~O0LAt&nG%bsJsYr`?{fGuA zAl38q1k?W;f}t#J2a@H8(&#BQOztvdI9vSs2pKikw4PXKXo%f}H^1<&hnh6sKfZ(V zU>zF1n9>p*;XV!^f)$e@o?UM`1#faMjmVb7IJg3wj>?~@Qbn@^OV*8 zTp{T0jfxy-K7(xm1aqKvqS^ac_1Y<+^=^+Up}oW1@#mYJeKP$%HMg3HYDbZ6Me>cK zNsu(>C=v-fcL8)nFlMggvfxnKp_JXEJb#d84;7!wxyP-R*XKQhW`tQ{_i&mAwd3>ICsTWD|!)sHNjM$>~`rB6D)dY8Grs!IsJq%WCEq6>W(ZxKmUDo`YbBF3bwM>Mke@Usd03NXF8=xJ}! zOj?}x;OLn63=DIZ01Omz2k@Z0#UXNmtWU(ZnC#?^t`=ib16 zdP&VdX*=2G4;VZT{hh4eZk9!-^^6|#N~2@kJ)iflw$@r1#T;33K7hiy*z|pzx+jQI zJIpLu_Vb1wotRLY9gKulf_X|yJOgSa>`D6@@pZfMWnx&nW^*viVPhTzsGK%Z8lvWxz(ita!pAP?nt4$_sT@ zFf)J$h!51P-MQGr0O)B&yfz(pZDtFS#H&Q?gs(b;X??G;&i5K8TKMHTqWy?7twYiY zxyR}~j56{2YHJ5n*)KMVokTBeJrWf<)P0c*O_3v#lAtHV#=Rn1uDmX_55@Aq_0 zFQe^@M-4{+J8ucC(4C5eWLe$rCRlS{DhV)NjD^t&-mtp>z+0kX6ZHp7@`XNZhFpTR z9bnVKUJJ(N)1yhMkE-pw^mJG9A%8Dv0I~QW`4ZHskWC}A)C~KbLAOp?x`qEjqeo+1 zz?@f>jHJPz(exrq)jgnI+gnG^C<&n?4%XDI4US2cpZlu>7@tierI#(?BY_txi^9o) zqG$re!v>t8;eW3Ow&2fYCWm}tku0PaNl*aCFv)IbBS*fC)P9a0>rfEe~nNB|A}U=c8Zk8Su}y^D4n!F3l# zpNQxG{s9>4m#Zz75M56aeilRx>-OkU^Sryo556s)k1jqr6+zNvLH-^by#l)i8wZHo z=FNvfApbOee&&3CC#Ass?7mf!kr@)2e2T4oy_ethhP+k_T5QyaKSsMndj3THWV+km zumb_Fe#Oeva(e>=Uje!C?xL(RX7EN1#4mSDuFo+-=I1z`mifcQSa*j^gZYQM(UaZ&pss5V1;X zv!#LcgivagC5&Ba&c2Jq;8Y&Q<%>{CPK8{D*4`(>beN=?C4xbSX3_{LLyDzc5<6?+ zsyJLmSNsG()Eus2PWSpFR6U0cfY=OL(%&MvJT{jP*RQ&&X?}GB23T`bVPF z?2vnn{(V^ORUXgCBB6t$JH2!c5Xk@mqo^Zy|!N6(%F7u4A#o;JWqNZM4PWGJ-sak2pzE_FbF`O3d1-&0)Awt z>Iea0?a82`4a3Iu+*>lU0;|Bfw=xZpOUy~_apO=*$omV{z&!QT1pZ`c_2n}+LYR?~ z$C&)(#aM@hD$O`^l#%c}|Ljq)0WQ2otR+8EM;G8^zJ8S zZ%Ug+HmauJf;^q)tCmm1IvZ8i0I2tyDMoDl{sQxj@^CxlcPz2fge~+#*)n^f3hr%0Zr_tb^_5T zyRlX5pPUpiP}?wFxA2)b$26U~a%!7YFej5g{*YO|bYWsDHXFJ?ABiA`5u(HHXif<< z7bVBDZ!Mq-SJLkGxHYs^f#K>Z7_DP(A&Vz)O8frSOL^_W+Df{00uZSk#MS1ukK0yN<~TQqXZX( zH=$W8zFh5DxU7c!sk5mi!`rf2vXBXG;Z>Cv=opYfg9piVba z^~`V!>ZtbJZKa41Vk+qsgGvoA%DNUJ!XuZO%sDgzJgvJU6%c#6yuPLhN9YnsAAClv zZb$^?E3$^Y#8=(>&HasRsHzs;ViKu(T3(ui{4<48#!!`AtpNoT3X*~TwW7vu@P21& zQz9)MUK8eY@%5dV0h=W)jfL22D|dxFF>RJs24JRacKB^oT6Q`IU9?SSzT2@gLg^zG zxWFjD9t~ZU-H&jbI=K`rUTPy&43E({$0}h-?xrNjoXX3N>U{`vCv&c=GSB^#0qsBx z>mMX+!{cLVr1?MC1tf}6X`+2D(V;hB2Y+pL6IfU#4yN*xYEBF%IC%cu&>#PLOK4CK zfWdC9!x|Do5~&pAD!6V(F${1V(x`%1du>;tgH(_awfVD1*Rw-t^#aX)#&&r#O}^qH zxhE`47^sU%9NmUEm^L`Yr`GQSq;_K>0*4G|Yy--z8X3{|9x-ez1!MX+f)0{oSKPsq?`?qKj@#=u1qa+-zCZ+QPkxThhv-v09 zMTjs7Z1*^`JMyL!RwUap57=mxaeZKHJ-f6_hn}M7^-t~~9q2d|{YKVPbyddas7Wl=ZJ=%dReW|wv z?+H_L@$77xk?%MrhDWOo9bG6~J2z-+M?m@yY|t23bP?JY{~N-jZWz*5065@Hb4j&> zTywHlA9TRA?1wt~Ig$9n8B>rix>X$2~k(l%)<{eIu)S2!yr++o*A?oN?(9 ziFy(KzgSERA$<@t?9Vu-L8jbd@xjpqq(oI3LHaLG|COs;bZ*E0y0?EMQH)(;+=9Hn zq1SxJVp)L%Suss3T9m_@Lx?O4ov@1N(RaZapAM9=WkFYh;xU#+L$W1-jF z?{AxWZA!3VuG~RxqP_y}H#>W+t+^Fpq&l!zfj2v~aHKID1NjK7fENwKue}H%SF@w7 zYb*QL>PNDOF9f0Q=tYPRyGosD-G@NGtMFd-tZ6N26W~@f5uh)AJO&SY@J|lnJIN?2 zhW2lehCFWJgY>X=voc+3b-2}@&hR1dNlDUF8O6|b`b-2%&`+?jz=j|Paydk$v&@>Z zT#79zK~_DwMbQ$13}Jw@OWu*--|uh#Y9ji|uHtW5@}i#l68jnP)2hLY$C}N*Ahkb& z4Y|t=5ddLvp&YXHrR9k1ZCz!fl+yxdEeyO0ItOI5@j1w#F-rtxXf@M|y1{T+&f

  • p~o%SrxCs z81<;MHRe-dSTn+K2nM<<;swo!m{TD-e_ho#4FW=5r!=Ix-sb-BpTAk#I&r^lX3r(7 z*12d>l>%Le@p2ya>H@mxxZBXpj0iFfzkTAXwj{+nRGc>F;J$1~ifInSzG)W*Wj7RB zo!HfldbbiHIsBA#ZI{;;#?ABwIlK>MY>af?nbc&LL%_tME8D$n1uX7Yo zf3L*6*x>1|RSOW``s8%yfJZUnqyXBl67n3PV!!MuCq7g<=t^;-M-lA=VlX<`KM?%e zKLRH}oc3$D_Iq%?-QO%IF+iy+tp7;jIbhY>G`?W43brK8{D;qYnpggO#kQ`I|c0|MTt%50@Skt};H4zP`Dzge&~bumO<1HJUklO?w$ENM6$rza~Wm`^gu;5V^J zHh6Fz#>s>fk^o7m`>}bpM~;vQ-P1#;h)UKnn|4`9`YKt%4}I(vw}9-|mu^CR;WPS#`uSr?U`K?_5$AS(12I+~Kwv9ku1^F6emivl6fL^*jqk z^V&8-9g@bOMq=}Dp|&S}DrNr|xk*)byjpck<@N3{C~pp0PH#ULeW-Rx=sQR!|L?t$ z&a$kI>xZS~iDT3BI$%*JC7PeZ@L#04&o-k9&QA!(SPdaALx*q}Mkm&7rlgqdKO5K} zmYkicx^OIPLyBGOVPvK8!T-!wde!$8Z+Ix-D7w#yxM-=y)^TX-xE&Au|De*xZkA#T z?SoLxh{=3b&&0*Wkns~W*3aLrWnsB#kiU4hPHh$D=D5>gbpkY|aGG*J+dL*<-Rl~3 zc6{5NX5!HY{AYrVxVErAB<^a~}7!u?Knv z8DljP^?)Lz-~EBYQ~#Ey_^XST-Zp4^7+t{eU?yT|ue*&~%RMmj zZm4kb7Vsx~S^;ji#4_OG(d||7Fe+l%|`mZqsYB0uTrK&9aB5-vv|IMs*U}%yY2Z?9=0h;j;G8tUM zoF!xDVMwnc#E)4Dt}T=j7#b1O7_wx4c$@Z?k`G4kIR^N1b)vY*bR0R-UQX^h`Qa*h zZu3(Fq3QhNHfpmNzjmIH zDYnv#Q(V#3^d<0vTXs5poXPunM=}m$ExU?MX#^=qkY{;ve|6F0Hh5=Hus3B~W_!59 znnSMT9U1_@UAQLsxppVD7~#j!D91!YWWnqUT7H9`zUO7!DNZVCjeKy?qpLjLSh#fh zeYV)ssPLwWu1M|?S@n%Na!&c1xZ^CXHK*(3r=g4GiJp+r_z?}-h$tbFLh#JtTj@{x z3jdR~P*p)3o>g9@gi6^TwL2r6N(&K-3Osema5RA0cw1kgL$RZCvn|AorwS@o#iZLp zo5wI}A+71DkdbUt3qEROdd2gX{y`2X2RR#D9ilaZGdqwA4>Y->SGBkCKh~M|-vdE;n>XEa$C4eJtxLQ(-6u~v{dz}K zSpkhzZ*6fZfJJ?tVS^XDz!yZ4PN%_tWx)5l;wY`Zlf;VD^>}`z52-77*`-a-#@8dtCtc zXYlo87*IsPyhUW~B4_FYA_2}CXq_Vs&S07~ckWA(wcB6ETB|khc83))g6%YUx2yG4 z-M#Ek5pwvuMBaLsja6oTNDEsQkhO}`*%`ZWk0WsPu-f@giOWFPc=#;j<#P!m6ssjM z3ue2)^6shB=b|STHk5T;UGlkGAYMK-${hN{ETIcPdp> zmm7-r6Xdg`UruMv_=mk9+aG~j&{v{jzL}>`kI|PX?V0y^mw}aXVSa6*MPw@We z&vOlat71b-&@KV+)UDPsfNtQ=@HgK_UrTNttL!$V393>}o;Zq1m$DaU?Sh~0`5*N8 zlLN;*lh&PvE(OkM!ub?)EfmT!)H}UG(s^yj_v^xz!l99OuKKI%S&-{mC7u;Sf2Mwh z){VWHH4N@aqwN7l$ttW~P&-Z+Cz0&b<&sOOn4vN$;Hj>~U1hFK0QqMzl;n1}vy(3k zF@Fu|HW-l0ZI%uVR=ax2S=J+#?HcvnkyNniFSv_$hxVg9&IF2NUajL+qgpxdz2WJi zJly{Yu=qC&4W#Guj}Ygo{nIdBx~b5sglUy+1lX5qhTq;Tmur@)#&AxzI2<%p;b!;N z@EDq#EqPrYmZQR%A!0T7>U+9yWZZv&kOU+E6Z9O=T0x4$(I|lVhsac|eB#TmLXp&Ir-C(?wLCH>FLdM{qOju+hv>XnB+w1-0&~4QxGYJkJ{&kV#-Pzs z##U9XAxl*2D0t?3i~|&hGpIna#0ZL>VDf?=1z*_Y^Ds*_8zCVvUN4)F%q~=m>UTAplMKGG+8mo|RT>Pc$@_{TfMgOLF8b0<28J~m= zDTo%@D!?qnsqam%lt-u#aCXq&HqPRF7+x-*m@5=ju~{SG3AY42b}+ju>jCV08~587 z()JF&0heWtI>_t+kWdH8)@3Fm=us5dC#rJ9=CjmPaI~Z^nAwLR7k;Mjq_oKHaUlyK zpvB!Pl9Z9GqTa$vtH6?ZMeh42`spolPFKl<3_mX_2vHmb`o#t>4-&;?KxQ@n)HXwT z^EK+fjJR%c&I;m$=5zC%d4RfUdv}XuVyE@fi$+4EAZsHRHDss;3f!glr1cf8cEfQ z%MT&J`z1No9(hUqM_5v3digVuPk*#mH$jb3G*Pz0sBvBCEDt9Ru>lJf_0yg#F=(k% zqEadVdH=@f+iFRDB3zpIb%w73^rTcH!5Cds>$r=6FT@aO+LOn6o3KRcc;83Y95gGp z8s+Vn>IFk$fwOHK4Vht!1_&hyJS;L7$)nG9Elh|@$>U@zw{8o^n%k?fmQEblVUCM$ z`q4=+XyLj(rrP3c7l13IW_@b#;~4^06m*-XH{%jvN|QLSEmKIrkEnXL|E{tbb>V<- zrnaOzVy*x(77o-9ux_asv4 zwxKp(E6J1I>{&#@Vc`oyasYxMr%$1%L_)P2$BR}A9pni4H{~JQoN3rm(9vf@Jm1Lk zqthR2JhbCjdfcOT`3Asln|5XLbZc~ZnoQQV?-hXT_Dn`s^$vVmBc+A9N95Y1rlVjd z{6l67o4)mSh1~2l&}T57`M*!VaRd7!jiJC(#2epXoWcRkOf}y;^r)?c=PK2{0CCY> z{I=3PK)w_}q5@=6(2LaC4J&7)2=fWHSN+4Ar`8Z2uz6ymxS-Cu;v#Iae@}+^ichWK|KEI+Kw2Tw-@ak+DnhlmDi5 z9S7hDL6Rt`Tzb1>qQHJne0mxu=L$!HE^;8im#{_N;?SK|r5ESmnH>`k@`SF)TM3+z zGW*ukAWPoEcgJtY?MmQVR#aJ6T#VAjj#4d}&z|D969^HcxB@OCSdjl9e4d6K zicKQ+lS70r@bi@{F4NKkHk(RWH?Mv$2^1BEth(WE>I|9N(?TacLU)h#-JfJm5gFCR z5009$K$BLwDl%Dme?nZ$q$;JtIzTQL7`QN=M%qo7VjU*@5HYQ^x`$&EZ&t2nP9mcKLRUyjVa zRZ71Mr07wU2l{$^!s8HGGdG0F6&VtFe)&g@0k^-5=&^;m`h!W)v^dZwH-O~Y%0lIZ zr9`|-Nf%C9H0();#)bzyx7{46PkFbl77_mzGA9Prz(l?Z#&4QNQ#R^MbwR{;i{PK@Ke7;dZ7i_+=# z$Btv`5NC$2-@Lp>QZp)5a6NKJULJH3PH5G4X}YoZBWKCs5}q1-iGceg-RpIh(GVhA z`p-ln+yL2Iu`j}sE!VDRcF1TvSbu9XTIT1Ge9gCV1VJmhBV4RWV;r^A!{U28tSp9O z^Bx^k$NdbO~GX^Q4)S_Ug^I(2i#Bdt}VE+!Z}8Lnn$X4;ME^AAi!RGnF2~NMtIj9(V4KKQ=?-- z=p;!@R1iZP9_Q;h){jQwsBG$o9Y{;2O6a#}Yzz%fe;c&7hequkY4@vD z#&0BO7l0Iq2AWoN1JUjC58>@K+ht(|m&eHksh$SiFYjcIbd>($zajCB&Q=&qjob)* z+>gdd`%Y>=vH&^BydLfj);~Gc8Vea1g#vNk6!9Hw88q=7Vq>LziyI0~vuEuJTl;lR z!fVRy$}|WsMF(`0ZSn4G+?|L^vfdceBsNJFQkzzeA>LYfx-AHj{FzHBi(3dks3w4v7Tt3KJkP6fnhhJ=x>wp&k>v(XR*p!%T^7)jceqyQNxZ{apq*>XHR)s zJEnAWKNZXwxlWI~x*qNVe3W5`tzW$k`X%h6U&5|aXo-Z2bS_@caL{z3vQUg|_L+Du z_g>de;cAnwlS7JQJBwk-djQy67?s5WAKC7oU)z*>!oZtdar9P$C2_uFU~rQ<6)Ac1P zQ*9(j06DdW87~4J1XlT4Z51ap0(&oBeH=LCS zrL~3}cf>r+~)F(Auf6QX;E0t%A zw)li3R?3T1cz-C{+l49q3%YF^Ps*8+x$J&`1yk7jxgi14z?8lsxag#*X zwq);gGee|F$ie-DNn+RP(V|S^A#K8@Ua$b01OdGU-#V$&lNs+$JBXco3KRNQB>!ut zpD4}ML0iZyaUfXeyA^u{5rO=${uD$8GH+``^vM9gLVaZaAg~5yITlr*N9mWpT&skg zgatUx*Kg5LZsTKpCU<>T(`vDDF;t4CIuk*-oz_7o2_I0vrxsNW@bZ$;=Pwtuu~AN8TAdWaxr-g zFHuB8Sx4yvsu>qEu)%XJ78p$-M#YACEzi(HLDZod-L%&rsJUsTK?B5 z03vE%)*%p!&!x^bD8s9g{opW);X4IkY36cbJxbhC_c35bg&S^jbAH#0|9v(X-&r&c*$^)u*w=P}f7 zOSEJK<{sWZoZdg)Z%G^+hH*{w-#=~^odg&4$}T9_QI;mx=_)wwl;q|VgUjWj1t`l_ zpB|iamR9<_RHc-noXHbC+^*;Q&X^zUisowJg1O)a2;KRKM@UOMoNgJ5;n$w@+$Ky+ z&N>P4%UG(;Cqrw)ud z-9MefDx6nc?~+dE2Bt1D-CqOW$0dv)4P>CABb9(A6B3*t9Kf^*30eTS$e#Qq#=o%h z>jutURYUI~sD23IC*zBYD-ifu|ega`8rzPdG2cBCm}05P`UVdo&|o` z;Rx<#bvJ)SP7*z6OX)fq)Fd-m23NgnY0Zr<$VM8Bf!6{lF3QSAZ5Lrrg6v4Oubdf_ z+9-|@7hZWZ#l#0yij07aM<8Y@YGP@$f;jKq;48jM$383uUFm#wlpN*^#lkw&=}obd z@R{4%=Lz%EygOa*3^dK4*+7W+KH3onbR&PEBhp+w{@3OEIkOhCAU(R#zB_NovWbMQLntqry>=#*?l(Dd33S-(zK4C zV8l~O?pd>{BwLm5OL~8W*MP703truX@ZP72h(a)P8P}gn#({mq5Ki!{%Y;8BqE9~&iI z`z+jgOj+&%GZ53-nUt+W50~m3xBROE7D<-f7>%o)M1~iTKPjyc<3Q%Q_v$q1m5o`d zUDI1z0Z5_LPhOC5wccPdQ!oQ&@#1v4DyU@Ic4dFga&gu7(mDtXr!i$!v5R*aH{G}* z1Mu_{s(P{o4K{aiy%sz#C`k?S>Hf;8-DF{8?LWo-g9d-fnu1DvKY%{$I?lQhYd5kf zF&Ct`J$SPyVb7fQ1E!s=KRK^%yUZFqQMwYF0o$h~@IjP-E7KChAdbMNX$cXSS(J0> zVf(HXE1<}Xge#=Y6x__iC9r))f(T>>xIQCc3DOD_o|T9MnFLPEO7IA`-96Ph7_7ib zT*I?9k~ZT5rTBbvqg}DHap6ikKw7m^Jd)#A-Mu&terq{i%a}*e@r`=?p5@hrC8-HJ z#F+U96q}Qf2kjICCd^5UfoubH=Ow5x_>Livv=!rU8Kv65&w8HPyMU?l5{>}Q zTb)J=F^Be>S+iMvx^$h^sWOqcyKKWawzc1k*r5hHC--SP*xy>qAEn=R+mnu6HYgcd zk$E&c?`=C(ZKsED3Ec6t`lO9XzO!EodQ@L*SqP94n5foWB|w3l^MIfkwYYc=Tuq+v znrn$QN}+ty4zwz)$MsSnDZ@Az2Q+HIMBqg9oF7+bMrhv53C%dKb0Sq&36mEtXnMC! zVtwZXAjE=F>p`FEftBpwUWZ0;h^#97qO37Rg&(q0EBHgOL(z~TXo?o#B_z=KG6K){9?Q_$5k7MAQG(Yz>WHzB; zFA_C`tf9)df*oW8bgHxW2ao^vZm!4E;##LF?#kW%=*k&K1l_&VmyQ4Y+|MFdg(D)c{voDrfgp9P)D*N)gDKp>+}Bj>Qm?{r84skKMC~Ndhbm4N}&(d;(mW| zLxW309y<@73y~xY{1EWpc^6ElF2Q*Arl`%0wf9vvUDTzs!g2`wDEZl2bls?4vK#R= zQXypK0ns0}m%E2lUyHczi{3J!YZki(tL7jb4V9;zydJe9iH);oqfFx&M^qK1u3eUC zz}q-yP9%2^5UZHY?~=1MhcQEzcy+)A|0~uOF5Y*Df1#{hsEWR-vuZgv2 zoW)3;3Nr0QlJo34)EsSCKZcbf?F-7*PK59b^q|iSsHt1RWj|G&@Sqe#UuzQhm=%MN5@b4J`Kpos%bvdk5O6xj#JG1qFZsEmp6~#z$ zObc6gXWE=^`X)9>wx@#&G|n4U3`Q;gjT8SHgF8P4y2Tld{qHUm|Fd{(_}iVUjs&Ok zpOH+V?P+KtzV~A#+@vOuj@$#CAsbUbQtvv@L$rJA`^M!9zD?MX0oER9N{y2k$+R}9 zg47sd&TSp$>lb$xsrZSOrvr&#p`zU_ZT3&?0}B+>3lYUs%6|hz13KgX_bxcUP3W^B zF{U;wZ#;A9=oL^I0&FBxj$!`{(P z%bcrjJQGs~*jevCVN!^Il~QW7PHueX(*+7n8#*!>{G}A|+1@@!Ij#1r+9HR#f-jT( zHKBlLCjv*9$4UkIi}cmL?1qd-$gK2Kn&)IMo)NG+N2v*4Zo@bIQvIvj2elrf{9RLiiu5*e2XdfQx`*rYiT$lHS=AG4nc z?Go=dR~aVcX`rSN@P+18HXSs)wH)0E3N`>xqWZvY zsZxSa5ATK3t=sEImr{aRhGc)`9-B1CxLG)X0OyaUS(14*H}u=WVwz0C2FT5?=m)|ZM~1v*w@Ihr&ZI}{<7TD(Y&T0EnRSYs z(MT}@iwxDa6462PVVg3pfw=#JK>f0Iyl^ER8dW_FQHKHW&ZDGz8O$}np-p$|z`&&r3_ z8k>?9%;TpYH9e)=uqNZDo%6%wNE=ABa9y9Tk2V&S1uNn}$3=_Rt0RYp9oveQ#(v}7 zf17W#0>+?XARe3}=jMT*ivdO-JQ4&+sKPS!Gm#ewpa9ME{h4-aY604!Ux@>D$QId3}*SN;77MSZ!0R~D4(&j9RAx^>dcAuS3~0(>aVMpRGbl68)+*(fZF zI@*PE?!sO1`oGfDlEj?D7mkLoYtmO}KIXVK3+(F6n}QQ(V^352NT~yO28%HjMJ@4+SHDZJv%WQ5 z>Wc?|Lv;=pVFM5`o;lMm=NW$m77!c9?4(UyCG%2yL|(>m2L`@391fDRfnaS) zUZnKX?6FQOh?481X)m^EzGWoS6=7onb4kP>;C`mBZ(@coZy6d$aZ<7`QH6Zx&hnc= zw-I(jZSEpZP1Q~Rj`^@02_|pNfGqSEV2tuA8d?GH?SR=x_%j`$4O>j%2Y9UW%2EcK zC*RfgwKA!zM&RU!70tR30kp*-=_|dy1-fmir^+V_ zapP*X@0~km%~@G5v3GX7&gk$w7gx@Iu+YlNfZ&5-J?c)vI3%JpD&71LPsa!0DW1|c zpIp}hk#_ChkyDdP_Xi!#K=f1Xj(k)=%NiVEDt$?sP9`sx>nLKx9x&L;Mu%GbM~7PcNQYYdNw-@3O6M+@%C$iz zw`VI$)CYg@BbBu?W(Tv`en1*Pvndz224|)S%O`}mEY389b<=!TcK*AtwJns24ZRmQtL|v?A99mspWQY@dG-T0I0}IAKiIXF%|-vJW2;ViE`| z&c37rKJj$V>2o_wD11LwORmoCq}BkK*4B;1;x)X_6Kk7D?)qb%v8h0>G`<@X14{>k zW_QY0j$nWwELT^!$d#$&Eg;miJ{O0BvPu?pSxB3opDOgqndtpI*p^{ZV-|1DRt`#? zIC_6Yfq-PS)VNlt^yTPx+&ruGeZUTa6Q0X9kJ@1_ZO0C$(Ko2Ew)F@VPF?n_Bz|sA zpk%9g4>_JcaEIXt-A8-qQ$nW-+`FSL={?gco}z!ut! zkMRPp#s4iKiulj+-doH7qxq!Xpaw4barHA7+GYmCJ>>^jF&mQE4MO;tJ!{)V2Sxys zj!Mr5*bwLYT#Ng<7Lhu0H98z!WYnAk55~-Jn7C2}=4G~8C1oZ~SAh1@+FByyvuRX4 z7kZG^@*!H!hh(=sTF=`)Kv;~1d518?D} zm__-_e&lHp$F^X-SdA|^ad6;6I>`mY`9!T>5YOrF`1w=#p2^Lum>996b0y5DRPsZH zlK|z@Y4+-nf>rrTsdN@#ny+JA9LAJve~yUuk56pwj|=ITbhh3f*PI!`;@J}v!Z=n$ z#`*9=I{9$=OoJezD{6BoxH{613j;9X)v~Nwbs`u+wUuA@_s{bb&bdo%sAobAA|IJp zJSjVzkkFO^&cUzRCd;hSoe?=kqpGDXPnHzpn!{>8!Y}9H_CcYwb$cnM%v1G@e?(*s z)Jo##ZizHzCY)JG+(uAxpi-hP4gCD^8X^6Bs1++VPS~6fDv=qvQgDh)>%q|Eb!MfW zXK0Fsfl~{bw$o6XR7EwJ<4R(iswy3ux=&9}tA%`*;ks^DY@3Lr#ARX79c(a63S15M z_B<6TiJ!LzqJT*y>(Ud5PtXB0e?tW&9de*8<`jDhZ_>s*njK0Qa@wkv+NK1=GvPe% zhDzwyP}TYlo(cVBX}q6rH)&=mNlb=f*LV4_UamR|vlCjWN+HE4c~1lz?u^3&;GaHq zr-3QCI&=q;NsxVK?gS@uVlMcYUwHRnpZb{pw1{Ip^B-(nwEy5FL-GIcI4OTGMvsyA z-$z`v2VrR`fq#C-|Jv{PyA{^@k3N_Z7fnG!-uKUM_+R@Cf3Lb$uBf{I7m}<+ub1)Q zL=(5AKTA&se_xL{(jKyLWB1`+oVx*O0F5CkI0k41Oyr0IRJFq)uAk;L+H8^Ptnp&s z#8zEqu@z|_pxqO10jiiq`6E^NyG88Vh~UNQ+Y#8_eK$M)lLrJaRTj+<)4h{>8B3`H zQ7s$~A|}U^iUp!78c+;@#(0UZ!E#Oi(<76llBP~~eI8WYPAb``lQ0V>U8lrj%h}viF6RV!Ib)NGB|NnYb+i-Yat^;CF>e$qyM#*lW%?kl z=?jf!VC_<0{M=|ot8CQER#V2bj6PzdUuN^F0}|L^fbVz3CeE1_a<;k3EQ%6XG~%@{ z!_`VxKl#aom5>)G3=8di26Ea>HKt$LOC~HQySG9GXpQ3&MT^nOtzw)%zwXiyXo?ug zj4q@KG2fXL&t&ZW2f;TOml14T6SqW2OEVppKB{OZe_PFx<2DYy_fzNvhD(qHf2z7% z)%HwJRc@Q@TPmmQCYPPV=91SBD1j77QMM$j_aMurC;$XLfFMZA;g3NM-(RjDFaLPg zW^lqII5m9yJ^($C^a+w0Ee;MqSPjF+kKvbBDV3$`N|%vRYq}hL_jJe07Y&|z06hVE z0&w}_e+;}9ed$u~blsSaxj6gEG^kB0x_~ZAv^;tfsd=X6F28>K^debspgR=zZyzuJ zduc_tN(-ah@Y|1<_`qlo+N%MrK<|e?|1VNGfdfAL5bi4lbuPR4nmr+pTtJVtPomQ;t5;?1VcbT0tb@O4FLyZ8~rxd%NHvnoRDB* zLj0xTJ8$%hK!U(`oZpK*Q7Rj)?kqA z$OZ+zOLmc%Etr^jmV?VaT-iE;C$@a0Cw_*_*pBRkKKD*eYk9))EDujaB^>#U z299V)pgqdI(1AcR$KjDL(X=r)nnu8KjV&f{6y~roax8<)Tkh#E;3AFdMa$PTe|27z zVp)?OC)zscZRXU~S6?z*XzZfk^?}w#p0(C8b)IKfl7|UE>KRi7Fj*oq2i}4%rg3xX z5UNq%vh~UqIpfVNB%SPqU3=j&d_`0&P=JA4#UvCgLK|?<3U+j0x_xhcb@O8dO88*f z{8(!v9Qht6$PL*XEF`@nFn-Xte?R{inwFnaICuSUPH_ee1uZLr%lIDg>kFhLkDl~c zt^igi3KImF1?ADEHfedXuTfjj!~JR`M)=C>^!l7L_L#^U8|SgUR+Xj5UKAgYLaf3{NH|=aFp5vL}7;XiXee`WQ!Bwfy`&qfrsuf0S-V2hgnd zQfDs=X{k|#oCC~kjU%#HO3y%Vl*M{MS5KCxnd`H%1T7qS=Qde_A1D91b9ARsFKpE@ zV5?;SxrgB0a%*RVRjpd&*RI^!YXQ2o=K*bL?f(}uE=UDZJ|g=N`SBCx*Vs~ojC5soM89htQA0OpoZ((;3BjgEPA^l*QC1&MSx8Cjolvr zzzIbecf)Nh0w@s1h9j~?Yrr>_Pho;BvV2ubsXLyQ4CSaw9bf4mr729p#HLzyk* zJguwq#Kn>%)~(Oy`)!YUT)s4v8{11kN@Z`RL5>uwmV2&kK?La*9KxKPC)+?+)HqjN zJw`9TkUN&Oh*%8fhb>9Dla_vI$PFZVZG-4S%`2-V8AL@zEgKU6A?A%&p<@O;Uq-Ve^k#vgpJ$Fwu6X`mHpE0 zv9kZj=1979u3VVZT)O3+{d2*zP-wWFIv3Ca%Y_ApXXgSH%X|&d#?0-CP3s^W%;~^+ zOJc3OaJDKAE*A=`X>zi7O{7>)#!cY; zZO!&jb*&roNvC$ZoLd(%VK;o0nfbne)yeekxxMm+R^O(|--irYv(_ zcj@^E!8p3;V%Pdjwu#l0ciCfm1IzrCiJ}tJrHWwNV^Mi#>lofR=WfJUi@KceG`*vs z`rCfiysT?^o0T1gAcFG?-tsI(AX3mYTQz~Sf9k++mL_;Fx8>d6lTdLPtkk+D)RUUv z-P~=O&{7F4b=w=?PLf7Px7AyP(bUVEo-l2!>D60K0g{e2kd5-D+@O_rQ(YiNxMf&L zQO*Eq!hgcDSZR`3Ke2GAKRE%5(- z-uSoWwi~}&9hL9ndD}7W0OLYa~T0gxZ?QOkuyWxL$1x8F!VRmN)#}c@!&)gw~ua1FbbD~2?i&Z=6FjH z0d|-8cuO8%tEqaw$(GZFwj`AMao$FM?HGPal6y3crx}S4n*6?Btaa4%GDV zWBTQbl-l9-hL@2N056Z91K#b+GpK+o6n>-d8>L>Jy-{DPwRq`wyeE(%CrktC5T8>KWT9c%G^Sw5Te8Kq=G!*PLz6f4(3lc*DXQCgIt@#*aaihN(7 z2!pSeKQjx>lkY1AgdkM(9D@R;fg=!u@X~b9t(NRPnj^H+0 zpy777(PE8TBx_ZxH>;1+<(=@pm$KTXDWIW2Ptz;mSBuu=h3L3$u$^_mY7x8mt$tGmDh5OWZkt8lwdG&Tizl?U+J7tcko`W+Bgw0r!l$?#v$#DzW-%DoXHJmdU%0)-o#75!79ZCbJ7JVp>QCM zV)pCO#~NLU*R*}vJuJk8HFVf}FCBWIG{RWLAq;6f5YI_4Xa!!|N3;VWRrrQOF!8Bkl!>x1nF;S2=W_%mSn;y%OKX~D)sRfx8m@-T>7r={ zWhUFLb;C^Vd#;U$bluj&^Z)sKq5#{#)XCP0zajyD&K+h}8P_2(P)nR(zf~fw>p4xT z2#YGJhWcvNM{mcqN=i`n$sUr9o~giHCH-}mKUdF9wd&l`Knr z+cap2HM>z)+u|eHec9AvkVm4<8R8lpqf`ngle9lwTL+~V3zcNZLz749*EJ{{($pe- zhH8_9cW2>Q$Zj!@m|VIc zws??GxA=3|woBJ+qXLzy?{t~9`+FpRE#@oy^<+MB^PaW=7?x2dxRlYHq&uZT=r3sG(4zVd7?w~g{(b&&`3aNoQS=|s29i8x2H*vzRj(5f| z(jYD<4tZGZ%r?u(sM|~`A$U!k89;aOk!_(-u**TtRekx%0**Awu#K3aU1+v?v)j~F zzm_*)_1a*UX?K&Lmd5G) zTe>)Ps;*!%N<_Q%GC(mqoZdUlJphON^$v)O?+i#izs*~${c)tyD33#QL@VqbFJNzR zJdT3jpbD$YSeGVeq?`!cPDLgEbtNG8&dh_J_Mlfi95KFtx zS!T0^b*6gA+rSkFS3}JP&Fry3j zc>`o{0<(Jp`OB|z`W?Ug2^T|u4AcMSr9TQ9IsIq)Ih~)r0ytp3VCUht@qQ1moG>0^ z2wK3dAS}drf8j8Q8!1cXr@}s1G>m9D+`aSPDwY3$z^w>t-F=UfuA#U-A&=LEKBp_S zt#5R9v@YNCd$B$@wQbI1nXA|u`zs1LEx9WiaS;PTyvtUOg1FH=(ot-GIO84M4R81r zMyh>vwP6uoz-@La;GCz@N?CXP zWHIKV;B9XGGRFP0e}tX#qAhO~eikgA>d#P~Tt9-6@kio8u~joo8QxO(HeBgy?#cXb zU1?&qVU&+L6+NsQJO?0WHzh^Zy2hj%nn)Q*Kn|Bj&B!y?+^j3Md5FZ*b%S+7e$`k99L?4OFm>Fp3R-5jC^ zfnFSpLiB0vbjmvR|KMFml?ku2pLWolwAShA&DXRQJY%gos0?@(utrheCN0UIJ%=l*i4sRe_H%* zlsB3(32@fL1Df~|J3e~yX>!<7H4?Y!yBxD&$r&HO)Tb|P8^Q8FGw@oCQdBLDi7u5* zPe49}BUESSrlbrIN_q`{{qP}QgoN`;6xL*RnAY5B$qPRp93@>}JTEu2ewXtAW7^rXP`9=>-p8>wPoz4$cUNttb^# zlD8f=_(|slN7K6UDm3TN@BkMrBMMXph({#ifCxhptt6(EUQg-gFEFy8CMZ~%6cgtGzBlkL!H5Td0kw?K2S8%q$MnB8SgLTJ@^vKGW zgE>^}o>K#~XY^?sJ+~Pu3;}>m>-Q!@nK49_e|Mea-J-47f9kC_OkjP;H@O8Dex~8U zm)=B?7;?GfBYDzsYRDwu89tL5J}ly7&p=>6l-H#D3=~SrzUxoxE9(6xw^i}+!2XkQ zta~~{yJqTB?0QthNrOW1mg#2{9w%PmakdTzBLc3f*5o+%g4h<#d|75yx_pc3 zUN-hU+4}T{d!n({;{0S!H0B3dH+tgubWP3R*d~t2_K-YBNU>J;PQj3h=hb-UPOh~+ zqp|-NOK~=rffH2|x5@rbdn%WT&vYi2uo`Xzw{9s=p9Oyv5IT-YySV(5fJs{%Vq$yC zJJ-wSlH8TRwDcB@I80)n5ts;=o16Ej@027rV3_nyuN9+>wW*?8bfifPv?*}B!i5%g zr?)8@JTU~yQ14Rt+h`1|vQ{W{N&aS_U3f4Zz<*$_GOQ`@W7ldbjV=9s>EL2$la36z z78EK7t8jm6=4nSV$~|KRT;nRA7RkzHO%;vndChHizgC?!g;p*sbk168jC$d1kRyep zcw|#8fx}eS^0_!8{}$FUfDtz84oq%WkK0hT>E;-@43ztwW7J}|cPUl7eFLP;)yQSw z1fJ&|tHQ)?EI(y4)vo39$4yD9RJ9A^EXp^DhTnfBIc3lWag#@WKUBBf$S)-wYEE&= z9LLeiW%1Mj7`c**`&e)Oo(r)j;|8EIL|6c=Jj@Ut6f z7eWkJESf{*oD(7Q=vochuGTYNFBDn<7{>^1~?si$!CY*WR{!nh=u8>PQRT*w3=4kwQWLXzlDoEsLjXSz#qWB3KBy zVy=1!CVaH!<|DP5o%`& zVdfb{43ucERa1(#zAs!;^_I-eKJlh4{raH@35rnHzy!`M)%99jN+c^wGY6`PNjHC= z=TK(h^4|3`QiWt=|4a}~W%ZezYPz>_Jc>9varFbytsp|t7BkDf^J1L~a7Y1pxf%}2 zT6w)s|P!3i&r}u{PdMLIC<24i3vmeU0Z`7}}a=m1ON+s}?EjM3byAcu;O&Dfbk?6b!1`!jCBX02Y z3cOHYM~a(AGPw*g&cCH?H%Q(?x;5HL-p-OIQ1%{@?`PQ~`F_NDy&|KETXu!ZH^XdO zyTWSUcV39=X$ztu3Kn6$Qu=?6m`2e>wfUMsQ*J%#{1=pU5YfT`Z@=k}8NCb?Z$+vc zF9xcc^$zSsTR5z$xxrL&;B-LqgSBoK&qeF{&Z}DY4hqFJW`)}yqq?Y2S08%PzRCEm z7vLeHD!>o808d`bsGBapA11Mrvw*tgf6SRD1l$W7t~(6)f4l&HwJ?7#?2*U3D%^Br zewf5ggF&*0Fy8He^zGwH3W7?`=<6k4gKK=~_H|iwTL2>k`EX$rohpxmnv+CU==tn2 zDOh)28aDGnKJCBq6cI3K)nKls(hKyU>ae1|2}2c9MlbcgEx^8WDe!+Pox4FjR4Kfgct0g1rSib+Vptaa0mzo)Mc zzZMZ$G-uZTMnB)q$kawND~y-<kv>S$7v<(e3rPP!BHq*~EJHwvrKMKxF{ zU`D{*TPDp9R3MH>0dk@CAUkmlFROtIEVEMXgi8npC<-o<&7UqF&E12^ z>JwgjV2}~2^9q*P&59_hAm#%QkHJd3cG4ZD(4gysja56*CF=x(g)Xm@QAcL-;NL3> z=@NU-m}ho@?=e3oe=_xr%MQHzXb!LXI!)y?bJs)mPtfF?k#QC$=S}-%4oiXLF|zTb z1D~YNp3?Tiq6-6 z>O9QnI(O+}s&((Y^WJjHe67z_%szQ1)n!bJbN!V=fAV0V7`fb6sLJZj?#uXk8k|hb zHg>TmX&lqK@X94MhX$Olrn~ zG(hW+ckIJiTV}YaIcJ)_jtybK>)Wwt#1Uu}b;j0wa(6s2Z!0plx*x%qOf*QzAAB_-b9ZyjGzixg)H z@MlhkZWhsZAm+v5^%U#Uf!O-wt>ZLO(p?I(Xbq<(WITOT7rSQu3G^f((P^a>g@R?8cP8l*5{X?nM0kA zFIQ4~?1Q#a$qB7w))gA#igPi_8Fwoy4L)5|jG=C$T6k zQ_B8~t=%l5b7p9mayzv#kqp_|Vp^dDz?8}O%;uO6;!^;Y>Gx9_!!&+Om+kYI<7;ZM zf0C>fvKpIsql8Yi^?eC|5Av7Dfhi#``^(&y&aJ$XV5sw*=;T9}Uecs-Q~TQNKgqX> zSg`^gMU1ic@sGj?avydl|0u}&I#jH=d#3fMcRXTO(}vwB_Q)%>`hi1I&pn&09b znjdMkIj7aa+2GVxGYDt9p;fS$_a)mvQ2x!86f9Nk`25iK63s>r<5_>-+)#&ef1#xW z@fsNZZ2qDpLm@YwhEgbB@ebuLLMmn@-amiw-*3~c=G*nqce9AjnbCUmP@AnIe-RW| zoh_lRd<_v}1y?%LIrXnfzE}*RTeebj3r)Sm1FT@BVy>=pCggiUz29*dC(s}(I5YQe zG%7M(@^L~kJ~tXemUl`Qq`OT0e=b?|zm6%3ROy+_?AXa_cufsf+%aS9POJcfhs>-@ z(m-4F2TgjN8||`UnEQvA`E{}yUek3}Kw-mz+ldty4CaPmsVWZDVT4SVu9%eyBR!+) z@jhPT>uT__-nqj*ynG%6b6>FNPd+rWxyPIs))idlWD={x4XlRO)L>;Oe<`|u_b;)s zlm%M1VPz7lx_VU=FI#aursspN>tr>&rUonjJ!y$MvC@tS+@Nxm%fd>94oQWu3I(|V zaOijM<4bCwQZWzM2bHo+7_nfbE45OUd&)d&*RCrUZ~EKH<7;ZLk}Dh{1XH#i>e_ah;7^C|>ynF$ppO1Y2b zG`ynLKMIDZx(g`7nf_=@!|U0!+gA7g0b1(Jm!ate6NfW@P=_;rQHL{sQin5tQ-?Eu zREINvRfjWwR<|>MSCtHx$+TZ4m!R5k1wP3Q{_bBfK)+lIWOjx_&P#DHn!7aD6i#cz zDbUvN2ie|Se03y4l8f};_u;HoFHvmEk{mc65_4xc!y$)!w=s-Y`~f%c_WJtl@bDf^ zIIWG?!h+K@KaZ|Q0sI#-wnJT4X2l6j#n#x zJi0h(r>D*FtJlr@_VaY6%lrS`wAj;$Rhja9W{I6|7JQ;%qLxayKWp=Tm(;x*Gn+ zG(U~Tm+iPpac9k6nm5hQr@ni5*IrD2Pd%}9fD`f2dblqIw(viph~aqFyfj$-r1@p^ ze$>1&KTI&^YBcJNDvcjF~@3p`6r zL3$$gMA|A@e|aKQ$U!@2o6$shA(R5>sY9^nd-sFHf4zNstmu1wJvwhh1{cI1O8dcw z%NG5e`;f#9T)BiD2JL{fD@MoMOvV?@r@_T|G->{HF&a*$L{wfJk(52; zKC}h4pbj9HEsk4@_pFaTTaL6AeBv;Q^br`z95q7;OnLWqg%av7M838w+BpQ)!zi^~ z5qD3slvCMVdXQS6%!Q*#E{Qe}9^(r9gokR>uwHpGFh%bTHsEy5>b1(V=-nR;2J5+p zx5_=@7MI|WS3!R+Zd~-Tu|sd^dk*29U|eFfVS(b>FX!N&DT>DzN8Y(TV0cL0IyNkt zvox29)vHt>wJpq>6;Rt)JE1_U&emBwv(_@t)Yv`?QYP_g+anL$Z!I${?ze*FOq+0` z=gs`|(Z3S#J6zX9S&Q))wuWxmpi&t)($A3(>`}tEjmFY-*SjYNxV8}^ZHVQd&L8}tkM$rSEueGU~*Sne@+X4<`3;jS?4 zg>&|3g5oB^-5!JkegVC`aEZ{IX%pdLAK$b(zl(ZR3U4dc>j!2uX)$bObOr2`A4vF1 z4D&RO$kMOe8*rlD)Qj|oIcvAcaTCr=Hm3O96cK-A{VQ3aZSqO?!LZ9GslVpQ{l!n7 zkM!Rya_)&f`IJ8S6u*a75ze0hteW51Y3ODAg+FF3zMneoL-4gR)tna5Br#>{oQD|& zHF$nv>0VIC>YYdmR<9xH_>gRjTw*EvZhz;I z>-9dem!6zW@(92$;aOeC+<~V52dBI|myth96SsMkR~u`WRSp&=mktVC50}aRR~CP5 z`Oc{$8L}Lt|Gv*qk|jlcktL_L3nVg^J3BKRKJ&)ioI-HHBHh=_mWs8&;v3e;;d@DoXm3z){JjSFMcq(Rr1NNj{B zB-vwPqo!%BE^2Iaf>92T!B}`P!z8RcR%)EVuO_llavU__CBa|V*GC-lqri)<9YHF*5C)R&ts}#6Pg?V3n z_g(k?KNtP(ZSS{!_v3Id?hnS7=4S+lf7iY1Uk6c8)Whkh~r$mT8zoC2|^T?;$xJfeu;>|&xg!XscKmPeIXI=yk9$cNDAKpknA$!A~#NZV>y9Q-Y zFS^Ln0cPjJ(f)r$@3`-{0Rre5kNcy6i<8U0d>;R_KkkkDjwTbk048MYB9fBD1e3B0 zhbE3Zy~vgg;^aasafCVnUiWr1Jl^k*54yK+cDwie&*Q^|E%*}mw1WE-Ho`rnYusCw zYq+;8_kWE0;n4?Zd-kc{5U)FX!jAxWBq?7k&joMM9JPOij|jWS+@5F!?w9?x=05^_ zv;=cn#HQl5-h_2p8|!on){&>a2G$qhy#)L%upYw-)~RfQ^%&<^N9LSho$?J>f8gGu zMDiI?3FVXLV&zQnzyOnals&g^zKULN{w9v5?4#9^Q$N${Gv%jtv%&erul>&#(|i&* z?CharUdVqb4VLxxX#UL6m{-skWfL@Vn4@u`*QBQ38ja`g{l(Q0onNe5m-Gd_Z_1LHNSLP{;a!UVs$ph^~l70|t%JOEKzy6-K4I6cMAY6A_oF zCUFjBw733a4N4Rz5yi<%!626v46<&5!L)!uo?(BG(`+D*5E{usp;|A6%|Jek$y;wK zC3z`##6~n}+hdVS_0|=MR76U2mzsg{gdVT@puAdzvP6-nf`*6DgICVs5wt*hKxRh% z@$fL0TCHi_FRCKC%N;2%c>?GELC{=)#CI!Jwn;aRXi#c#czoY0l^bs##ubmos~=6s&YX^ z;5DUdQxjEBNuH&x(U$J)@nVx;&Y1E#X=#aSl57%eU1%*z7>Bg3L0M7x)w~8F5RLHm zV%l6;jT^E~+^}Q4rMRIBZLZAXhRouIJVJk>BPAdksYOyVag5^auvwGmyLy1Ebt_Ne zij*dEPeM5b?|gDknm+l>UJhwzFLSslR;|Cvh%!R+JT#kiDc7f70|m z$O|R0ZdXra#-Dk6UV;z#d9~-5-r1}93$*HesqO1PVY%|$yx7dV0)M(o(PpTn&rZGl=f5};W*U_F+hGMozYOVqpW+SbK0u0umig?53PTNJbdWc zp<1b8qczp#@LK9Usk^MkOI27@(>jz%d@gGc3ZXG)S%)%+XL-68(A{n_pPn8u?zW?u z$uaW-!?>(|l9AT>B;(64E(@Pz*mot9SUvkT!@eq+&Xh-ZWrBUO<~<6bA&>T@lMiGc z@F0a!`pPbz5Mb;~e1Z_b_TsO5Y}5<(iH5zXsrJc6st}(aEdBvqePl?G zc~{?Fmg}<%GFi|jQ3=a6oP>4W)yoZEn?wrO=)49cReOh*UrG%pBwsqe5O3oAaoUFe z7bnx}mvMq(6SqAGSc*rN64p{Cm+enj5d-f?-j@MTSTldr%)texIjGBGzr}HlCRCR> zL7?CyRTIdmwma-fZFj^`VACdr)H)*)&kZ_wHB<7iNhY+l4H)%NkKE_O4c7cj?t_!1{2l#i;!$cniJXz zWxJOkCF_4VX2+%2(}kfm**NeZ)~IHqx)j9TGzXWcy-OySBDEImQfjk-DNb4J?J?*i!CK%l zX?v<@QIb8y#HLc(Q*v0a3>(5&(QJA!gc)giw(NgcGAS4!db0VG0;$@ZR!AC~9=t)- zMuY+8g5`!aw5{1}U}+`f3L9!tZBNkwH{XEINXqSAc7nzxRVNy(XH24KYP}Go_Es7Z7Wf+5EMwOvN8WINJN_tM1LeFGt<;i;MBpbzhGsC!@(*Qx8YoU%T(RZ*YNs*F5T8kA~B? zcr9=1j)?XtTP(A$Se_iK$0Qx?b%)o-Q|s{H?Bdt%`Azr3>Dl5``h*Rulz6P-SPSOxXXDk1^qUH0);(;uEa+rz&H4wh^12@ci| zmaF($<6{r@a&mStZ3BgO>>sG++lIOFj<=7QW*2SDoWvW_kYo=eVo@&$A=2!D+eh7V zhu#mnZ^v)O-3#~S)u@g2k6zg(c}wHbCKmWYiF`oLNI84J66N53OUWNLE=9IC&MEi+ zXd$jXsI7AGC0Gh89*g~HjT7QWkx2?{1E*~EBS0UoAhFyr>tSL01t0);fvE2O{*Qk; zBnkyQUREE7$CJa$!Eoea zgRAbX& zfu%eH$7j#FSCjGZa5R0}y?XJodoy}JJz84KSA(BMc%h5w=wf}Q2&dmm2;OO346ThDkKr1yJ`?z^-hptv zHpK+;1gf2XKuRbA@i^wRf@WNo;6mUlavP+rXw5(+2DZF$zamNkj|lq&;IjlVzXP8o zSo&!2scYa9^&#MsbOAoG$DG(>PL!>Djxp|BNO-f;NpN zr&!?@05yUpSgtd_-?4F+Plha)X1+%TW2KB5}jK(oZg;O^JttX`>ZqM1-^ zrA@2@e|%KgL=zARQ2lIpSI%qDm*YdAFE2q~>I>!67s|OWlyhGwXWpK75x{^jf-E2% zrDExS6Mn&jw1OM(9pr<{4hoydUTb#AtYeY5f(j9;D_D>9F6vWvP}3z#{^}BV7Q)pT z2`mBE87~p;C@7^-l5Go0NuCOZ&aevnN}+h$FG|s>+fQt~r<@6)7Az%z!+`3zM3|Ah z;m|F7bGnBI?JjgbKvcF0U6HlWo!h%RbhCzk)zDR1gs${~Dt({|_d?umYYRm;Nc)1m zgapr(r;_9PEv{Ks50=$sC*<7MQWjHoXGoG$HlnvW`)dsHT#${V6qsB4r0? z(Jw+$5DV0ZgtyRy04~|fokgP5t;#gZi^#|eW<$|yE|0zH!@>Fa@nHDtY(tX>rCMEo zr8AQ6p)*Sg3zCA_jd2rA6z8FCqFIv{%^N5d_|?iL($hvSEo>z?l_U}pOrTfiCMD=&TJWKth;eqs|{foF-*DlI7W ze;!&;)^|hUPrjs06u}W!H#wg6=0RQGH?8`BkhXIKHz8g7j9vTKuK$<&ri0VdA4l&m zC$mrL%KHag>UP_Rkw6nPFMSgMP0&Xl>A$WACySwy#TC<*L$!UjfC#*)D?-72ep*9i zZs#O;6+&wHpKUvQf}j^#%i|IrlE>}Xe@`Fu66VC+&i%}V)C;*6q!)JZ$(9T1s!A?{ z?%6?%n2M)p2f2bzcOJ+nWf%Krwo4~B){}kAta`uolIsqv0~SI_?XZ#BQ8}a^^O>9& zz_?CwDNt0-DT-BFrNpE=*v8|Uy`4JDOpS0Su9you0tL_t>xVOlV=jSFN(D)hZ$nfK zJN$kfq7QaBk~4lA4J=ykqCng2ivSgT3Jade@V`n=^;@2Bw*9cU0%Q{I;X=y_J;f2! zRdsFS<5o>2FKgd%Zqu|g2eNj4=2lH3nt?wXtYuomTB;Ah+Svh^8P?MLJfj_6H5~mf zUd_1kmoZIO6Sq!TSfNOl##d!0mlmQ}9SIn52CNH=L9vy$Jfc_(0)ManxE^-TudYTD z*L^!0pAW}x0=zz)c7N-B=)S`P=ACx0hG&yE6r)dO7o~W?oluItVy~%+uQi??bSJlO zC$`|x#npeh=kw*yCKsct?xg$2s~_zDSHDaq*Ee5x-Om@3UvA&}v(azeueZNlAD$0? z@BV)K zQ42i5z3Tq?)4%NAeL?szbn498b4P9OjJe)9dvWH1>*-EH9I=xPEPFD$y5kowyVt|_lhcLEJ|6r$#D=aW!>h@SrIAwg;igdfDdvwc6X8RrXK%)HGtF&H{K1=+-awyj?Mo3B1z(-} z5(gg&KemOPjjnDcL+*$Y<+0k&8WY{O7Q) zMT1&0wFT?yUW$b{*4cyDL)pgeW=kyE9a7U4b|-vicYi!pKm$a(7@$b48){pj_md*Qyi8Medz#iKTd_+6zVu3E{7 z0>rb`uAICU)FBy`M)l*;QQ++^9rY}vXVM$fPISv1kXuUNzc1Wk5N5a`2}F3 zE#AS}#C8)r*A-_kX&=&4_QC2@Bm`?cgy0jS;LKhme_XbT&ShKNPP_)mEilZHoF*@u z@MZGE8!$%LZVnr9BKt7&|4rqQ@8^!ZRqn{;E_WoFrGrclq=QeiBPy^~vVM&E2&@nh zKYy%Ol#}A}XoU}He87r70g@?Vw6*+tNQRQTvOYc}yZ)oa=$Hbk>rj@lSmsTzSbo5A z5h0O(H{ld%apeovKc8yWTJD*(<_*jmQGeO2%R)h&dz3S^eb?HPGa~jxU;Jo~pET_T ziE8wv$O0s)s6Eq@vBG?K6lo7IA!_jzx_=U_sQRo0jigmj1(xcQ&}W7TBBoVqN;e>e z3?e=j+l|60R-~(%_6QTW1|I-cdYFJD?ThLcf(eWph=4{tOn^RMaq$bm1i&GW9n5h8 zXNEm&h7-2&tD2zNI|NPvh)kbOaIf$ylCT`xRo7sl1%^4sLHZ1wH{r~H#`&`}O@Eh~ zSNn?b<$lw&=r%FFF2wlKhwajry(RCCVWI$NBDW^w*qYVFYBdqU45|?9Z-t9d*bT!V zdd5HtZ6(}sh)=Dpl%gIUrBwHjM+lhS-cV5yAE0T}KBc{nWv`Sr)3iBADVyM^a=$qY z%kj1HCY;JXNO`ncVSjz(dfyf6Hh->YZ%pT|SbHc{d!MYkK`8;GSZXLExj(^%a#A|9 z2FyM{)hzB<7X%(Kk2`GHkIUzaI|RXtjXXl}rt;|R?B56Di^1E=;jEd>#a@kZP6IOt@7c_RZCL;Z*k^JmIK37cLyUeTKDGw$|N(Ga(x+ zynV3oEc&$UyM}algxxI#XMddmm({3jnd|QTVJ&$R&LG~tWLnQjfxUf_ww@CxJjBo6 zFk3FOwyv!7{^uwfw}Nwg_gR2_CN|9t)F%njo+v#r>#%7IJwZLur=QrTpV+6LnD&rt zW-)O31zDZPz*G_Y!>VLc2~qu9c2tytf$G3-4p#`lD0cTWAdIh0kK(`h(ZB zTaJhCR{J`)&+%kBcv>M4(Zjkx6!y|zmFlrlYxCRJ!V&c`YGfC)`n+6K zMVB$4YbUoh@mS~se~L^FIUbkpn8HzqgyN5pvnIYAVLm3^gc-mIWN9yEhr^qHc){L3 ze!(p8yhqzc9iq)pG*LkGA=csWNFavw4hVNc*r{wEcF1WCsJ*nFfHcK&#BJ7*;;*qj zet|(UoPysBD-14yVTUhgg`;4FRd=w$3@D?z!ay`Euma&Mf3J~a9SN(3Mlr0Q5qt(5 z<{ETc)9Nt`Y|kMPk5G&WUiI0rZ3WKOfbOo?CbEHT67GX-vVv`)EC4L}L7+j-z4g^R_a)sn~VnC9`1uI4t3`kU*_k7o79}mS5(5vw2 z0g9syU%nV5MxFNfMG)Fyu8oXj!&U-|6R`XkJRtd|RJ)770*5KJ1nrF{52L`8+l;Sf zS_5v0pC-6pHW^L40ocjk2e6Y|0k#aNEM+UkDXNZRe_lp`lxS1`<%EGmgh9#Ig~9ky zqNK5ij9=g)kw|l6OExiYg#?4F+7c9^gxqPcz!MH zCx?w-%5bNw7R~kr9_S;o<1h_M@Ih1w;(wWjjd*Ht>Cr2wTSlNHd zyU01Ae>f|PV*;yF6g;5+j0lVwq$1ovX|ngbpfptD-N*z9sHAsXY*!gf$KSx_P~`7` z&2i|hEsQHWOTM?-F5B@L+pn_i;ALr<*~JHUu*2!u#e6n7LG)G^qmcM9{+5q$F7qw> zS1Srj=t9L1NXKZx`?8MFw2e2SG1e(4_~YlHe<7=2`6*6vSLD=9-Dp9&j=b zIH`X7QjiP67qvV3;v(7MMs~5}x;^9LCTYZiQ4A%N810;yj8s91*P~c@3|rC7U<#gG$Z>=wYjPPr zfBI1DzkQCF2TJ6{g{@P+>wDLLESsCuWy~gZE_pp5i(Un!4slqv<13L$J&;&d$1E;U zd}t@Ucsn`o7MTR~vFJ|9V|BhBI{{tPj-?Urf#GQcs*-Pt^SoA~mT*fBE1R2-5n&QJ zjnK5yniBYH$v5iL$L?(>ns;|^JCj|ye|H&n9LvJb?M!wd&>-+2g#W|Cm<>YZE1%*W z1p-O{l!V^dQLqJq9oT2@?ea zH~R%X*UgRrHr4TvoFBhH)NQvjLyW|)S9LKl&`#5rI_Qupelb z4B>{;Bjk)7SO+Pp))v+|kmE$RThCs1ac&pw&~Rxyt25WQ)p#m9I9M@yYG1Pr)&pWN z!Vzzuc)#5@3>*VSpjVseg8cZp;!^W`@41Sg5+J?`iln1b59fa-9tk@uCWiOoz^4P=grLVgn zOJUngkA8BM&ED+n&OFb|-sQr%^Ia}nI^tx4b{q*p2wljzOWvnWDB2b2BxVzQC#n#{cPZE{ z!DXqVAS8MOp>(RnZZV!5*rZ@Ks=9x46udo3A|$ELN|3ZZLpu_f&n4noOm;U>M=95_ zm}w4X0>em?jflQuuXYzxXReM!?l?pn8$-v**K4KY9Bfv&!8zNtgt3L{wFoKMYQQ9` zCfLYW1@bogD3Iz*6C^Hn4bFtf^;+sef(oQ;>t@$7bwM#UvEr`Qg~|*mo9BP2bmB>2 zqeNR^y9@V)t4DBEg4pvgNr}Z)1H&YHn`y>a+YU&It*CP@zKgz?M}@k`WKY2)qlo!| z2gI0d&LwwP(qbD6y&UR@0x8>*i*~WFJx}qxlIjTQqIy`X&UkD(Bt!;@ja74y%?}M- zl2orrm!jHOY)Z;?b+HDiRF8iYV>MSBxUt$d3nwh9JsCG7R%`et!Y#~{EvmvJT!V6o z_E6hKJjV23G9zdp!RZY5vr_#hul^~XgWWBVq)OT$;>`~V9b(3=kwA)wD@Cv)K5&f@ z?IqbdD-Tc+Of7*R@g+b@@*`FN3^pB76-$B+n2&`?5!zglM zzwx9pg7FxffzZZ!R_BMfUc7FsKRp4O*;8Ni|M=&>up!AAQe?!z?E2#3^dnl?8M1JW zF2nx;nu%OMwrn-K{@eM*eDU&fayIRP4e0vkljU-{n037R`Imop%kN$;C(CI^s|(NO zvn6aivn3`3q*-|ujTewE^#`B>?(_Nw)*^6y_T$I>^Tqt^<#c({KY#kHe>Hu#JbiEd zpHF_8VnVa!bhf-Q2w%DIVtO^dUYt#@R+w*>ewe;FpL{caSN8>(VnKh3@e7PZYHO}q zbw96Gv{TJLI;nrmV{TODfpEIJ`?qhnhws#4o!J2n0cPaLGA**RJbE+zt^eEg56|5%7yavt z`RhK$$r;OAoxY{;W*UGKZ*%k$uW#V>WI6$l0kcT@tHpm=|J!77K6!mHy~6N691|Bk zItGVYnmzh3)Q3CELe6NlIm=QU<@C9oon2i1IDL1ysJBIZ@tZUN&)$+z z?jR!vVAlBhWTTvoyW|pF8O0m&@~C&;L7J{D|P2F5UugRy+dO0FO|iQG$?NK+Az@Bq!Vc?8FLN z)R1(~5Htuy^EaSy+R<8rH{woYkS2;b%JjuRa`rbMIh9X=Lig&7dOMIZGDacMABU_uv#0RCOu-Pk{)D%`1MIUZz zYDQ|JAQ;;kXKSg@WbZScHH|4$ zYQ_Vp%ll1d-oc`zd#cU%6dJe)pb@{k(hV3Y@+mN+ z?^TAmflh9qlUqlZThW+X(O6p1SX$9oTG3bzD;g7ajncLwN|anmpS>eGo6oM6iwPiN z-2euT)&SOWK0QaRhik!5mR5Y^(zqV;Eq46yF)hSgozCgBDRO(g5pYlAqzZkxh8ee_*kX-Gx z#{J3FUeRpGRU12MXhJLYwehYt-qpst+IUyjylXFK4my#+U(xN^YUEO5@L`>;=301{ z;76g>?7TG}9+;=bspNdJ^9gn2?_xJf<8f<1&Ijb{hFdWU;K3c%mB-`OjrD)Vt$VGH z;d|rOW_`o0`>bb;qj769zTwt=##51lxYb?-rR{Nk0_J;qSox*NA02BgV8&`|$vBSi z*G_mD#XE2%q&u@Kj}T$lOq9$U>(**A$$sk}beFoOkdJnk?<;Jm5`dB<4bT*Hmmv?) zw6{Mw@(|5{WGei{kSg&FQYC-?DWpnUQnl|1)~u)pv7#_G$Zy|M0HqM14=ig*DS;JL z4t(QC=rIF&^bJILMzcI9EuA zXlC!M#QRbbm2Vs^*;g<76IEGv6E*m4qEbs#YIQ98CQuW&2?xG(1k-&*0 z5L0&9D5{kDb*FtN6O-J9U#rvR{{a{Y4!H_tZe(+Ga%Ev{3T2o6VsZwz>Nr_3HkT6C zQYM$6+HeJzPaI$hw@`0c`T~DanjDdw)agm&<0)4PCpm>lsK>d|WI7>I7ct?w$b--Gd=A31jL-SW3%bU3+Ku^Ew)2tJGDJ#E zsCDWP%@Vy}J+^C7(wo)H?V3XEHuy^f=ugDtYoYsd19Z$c0(4CG3D7-(+dF9Q6)dB0 zq+Z}&klm`5RDA)(+f*%z%vm3mf6I#9$;qxRE7{n?#%U#2lr9fmpZ(`@a=e);XL^E< zJVp{I>XTjRv)Y}t<7o3o4ivR>+)pQg7~PMM3)W5Jj;xD+4qmcu-6T=#h zU6NIdrPK@B3%M6cFZ4v2!+4juibSpUo(O@^Nqb4oODT7~oRY>k`EMtm8+24?V$a*q zbBJRc{o6g$8l1D8pbWsyV_Z9curk**xG4J}%dTa&H)HHZuU#khxe1l7N_|{M8`YR| zO*BGo;`RNxT{t)f!<0TXqeY8s0m1cXl3U9+xF(bitJ%L^AK8XRZ4qUtoXE96uPh{!Hx zH6poG>}jno2P0x|Rq6oIzf3>9|fhrkP0-vbulY_&}b~i%?BBP3< z9NWT>tK?))K(G)PdnCxr(yp-s!A2#=T1?869Y?lRQUR4r0(@|4hr!V}tKBWQR@7w4 zSfw^evp69s*aPPjZqH^MMoN=3;aJ?RWhc2wU&u+xZDmlE>~3LD?L@hNskXC#skUDxRoKFEzOs$X2NV6x38; z0T-#JgF*zGNw8<3_9*QMs42$zwd!KxCLgFA#h%3~1%iVjmxA#TK5%d~N?g*^sNzyA zI0uF5QdDyOzzCgpagXIf8=Vf4G)is$zGc&K$&^4GJo^ySOI7Bp_TEqK5A@xWLM37KowWHNea_ei;{%(L7AT6->yb#cM%>j1?&OWtEt*ue*^?X zZo5@bO&d@|txdaF3R({)f(l51a7o%#X=+dlG$oSR0zdpI6XX5F)^S2O!|G#dZgb>B~>r^D$B;|#~$-@2c=A70S>%hTb> z?1dEeoJ^VGqxo&BUJynQ&NG$cf9|2f^3S>-C(kF{Blqnk9vV%?fA&S=pB~`fj=NW% z0zA1!k4-g-H&{Y!d)~CSl->7cwoMQxN*)*j%n+}@q8Q1;Pu{Af3v}C=;j9Q z9#6(IEd3b%2EW#}_+tPQ3CsM8;i);({EoqFXp22~&^?(>PM!^CFS;j>9(T`&Z)eAA zYI-vGbqImRv*CDlX=prO@9FSzay2~}Ud|!iF8wk*9Sy#pylv`BK%HFq7|&1fq|x)e zo7yku8KiA*eyY8D#@pQUe|EdT;~g#Rf=Krf$eozH05vJHuZT=Qk}p+{53bp{d$?S_ znFj{@`_rH7|F^%*W*3)#>AGJ>v)`^>`IE`(?)R(L7l)_AH{H)yzdZ53pLeg$C$G8~ z2Pdp&b$CW{Iut;_8M4(N)Ki>vFdQ%^00e1wIX&slFJ8VL%%-Eae=ko5vjNul=7`JT z5pWDnaj>ILYQULcW#j^10iIgKCuFA>GU8-YL=?W}lX2yffJ$Ew;nyAWCKt4eM2}s3 ztYr(%Sk)T>e+p+`x%4}p54@J`TzswZ3ka3V;rMbi8@(CL{@@lXR1c4G*+ZxZ;M8%qQrN<*Z5SsBHgkI=8w;;lMHf4SvJ(k3g*{;Z4w7pX{> zRz}I_S<`k_Huzis+pQ(Sy9`Twg=3>O--1)&6V?iR>ayb+EboA~CEUQCv_H=vvbMKd5p>ym8$}yirO%1}hnZx49$ZfBbDYYoKaocyGMLyc4c5fK%ZU z%M!9CbPICdie5bV%~34j@F-SU>Dc11(g#YYHHHs_^lh9aA(NFYI60#gN9VZ(XA+cU z`nA9W#C{hhY{dKVFkwUL6-@MPaOvCN(zn5NLD-0TK~PU{Psr{gPGzJJvSBrOvVmU^ z?crodQaRk5&6eWU&&x z>e?sLoJ=Q|i)kgHWDNPX6t?|2e??Gz=ej(nNb>pK#}F6O(RembA~tA> zlJ=6Q7o}-cD@dG0GysYljBFYLkgivz_R8wRmFab^#Uvn$C(7G!M$`^lttpg!jj|1A zfQ4iJTBZv`3HL7u=TK3!=UjCU9Z*5Yqo(SGFdJAW{2n3JI-nij62ivolWR1ee^Thn zsm`guqdD+(@E6*qK$e@67E)vY;cYlkyXVAT%}hpbBCFmBS#=#*`@xI!I4WiLF^l=S z(0tON=qyAl@TI(W(vcDsLRrU}?8k_vq1`IHRAAy2n5)e?(!GQE`|8HEk4gcML zg@FFj4TzpZiKH|X!O~{wI;21lXTY|=D9+AH>&)>P=W~$luiuBdd-tVxwa-2mb_OIq zzV|3mqR0i*jO(0zvoba~Xh?oXy~Bat^t z6eSODg&X@yX6@DI6ps$N!>i+|_4o4h{NLTPMeirm)A4zC*!}(W5BC4-U#8QG%RhD9 z&!^L0u8#f5_+$6s>f?XKlXv~6?r&E=zVaW=y5qC)amPG5q5Qt~?_+w`r%K_yau|jB zPAiT25f&Iajk&v=oOGW?lhe`hS$~PJC9uuY6gN05*-`N*LR1U4Pr%$_Alkv%6KYiQ1 zdj6t&(|?{Gt!V$%=;s~-I-mCE(@P6tv;JQ9m*cC+Nq;$utoG{1{@v;5+wteNDuSqh zB|k#@30eX+WhT3=W@{xg@dh$HU<(h}!UOC`*b8J3lRSS=ZDIP%(Ia?0wCSIW&o8Hw z(J6G=j6Y(0Pw-do)A(~p-eMGKg1aN6#{}!Y4rgN7f-|?2PVl*e)gPoM$=;HO8>Nec zy-+SvbMD1bM^Z0QAKg;3+EPo%%cVAG5L!S3;_nueSz#EkgA;i|Hnjt1#4rCoFtY@c z-^QHV!i;~?2Fz%<3(Tl4VMYd+k+K)4WFhmFg{2|8hKbilXK5NMEKPIX1}e8mA7b^& zOALijPh1{X`hYZz;<`uaPQhC@Lvqg57u|(1v6mhAT8xJy+{}rh&P%FaOgd0D(}A)} zIuMJj`)OJA(;@ilkPhhZrff?GZW|v3IRHv};pBge1dbI_dT2+QxBTj5Rd`VhA>Kn0Vrc-Q#7v0FsC!+~;SV z*P0R5a@PH7o*1%^b(sucjio+#bvZu%V8-;RZ~D&p$xD@W&?+~j0cA6|LuXz}-i5QU z&oO_0G4N71;icXQUTRswOBukV-UFBnc5Vq4GEm!_^A%+tBS>mY8+M+Ek+Esz5CZ%n zW-0sGxj>%nnhu7JWIs!KT!x-lpS;Y0)=j2D@yJFtVkV_>g#%rZ|(;P^f%Zzd%yQl*p{S(pLYIjwFF+Udx(!FrWpQHg&8 z>V(SHoz;EyMWhhU^DQFc@9;P2SWD5EZ9|A z!K_%2*vsScqo@JdeNFd?TdBa0(lWWv1?lBx1!YEpygsIqq697o-eLcp#-WZ&gxnrw z6^z9b0(MHl=aR13=hU@bemiWuIT3$Z=Nde;Ao12+I7^0R^udyb?nSn`GwJ*x+e5jF zN2X1Wq&szo)|lVl+D|M0kR-9<}mhXD8Cp(wkx9nY(`GvowBvO{KO zg|E;xdmNeeN+}ZbOUq68#6Spna5aA%olM5djl%oLC6cP`79oeKKFl`_t37`M1Iw0N zVtLL{_pA66CH#tpOT^EEpK_d^UHsI4zL?A+jaa17vR3Zd#f$5cCEA2dk>Eq2T{tuQ z5_jQDSg^bsC$W$D_dlCmL-0K+z1dxjHE5m#{w<+7uRwF!FExs&z-tRP!~O(Pgv^fv z5V}7v&rD{uT>t`eUf-yoS)hNsDL+`_x^AOlE9cgYifx>cfj3ol;mp|=k}qbXf;Z0m z>;~8!%$JvE33mNymOc#kmuR@ZM0?&};>zA`oh>qo(3bGQGm49TGMbJjvuH<>5bstu zneU!bAcYmX8E9!X&yxKJbjV1zgOuwo)!f6if@H~lkcIS&l0Dlchnqd57p{9=E5J0v za+za-8p0!3=IQCj)BpC9pMYKcxPi3|Cpi+#@j0X1rZ zmr=416Sss9TEat@0XkSHf8lRjw+;X9ze2#ibOWp>ilihCg|W0*x(+TDBpI;HFp9Ht zX|HvB!TDUI`|J1PJHIKQxn9k&K843zv;Gpo%hX%e9g!@^u8brjW8^aatXV<{jh`j~Y z&!7UR5;UdiR0Sor11f{^Ie-p9bM~+3RGIs>PGK0JD5#P;AE+XI3$$&mf5)LD>fcEy zZZe=Sbr>{cPy)4hXQ0gWKvxA_gTmyL(vOevwKmr`Qz%XSe_hU@*y0_QhmyC&v{x*q zQyQw&0vWK#+FJ=jg=*?!&Uj3%?>R4;wS`*hTCzWy^D%}dy+-Ud-kgQOqS?pngVf@B zxcQXiE!-ih&o~QOH1)Q=P|eMpMS}H)=?iZp-XEB;(0vOEwwPy3iE;6-Fdu{GK!(&{ z+7C?{9HlxRe~i_vm+QWll1pdEq(ts^tQn;Ai>+{sROCWQf)~KDQ|(>N?UA+hUMD+W zf89MjfXfn`{6+V#fBy&XYiw{TEiL-IpPrwb9PaJi!bzktL*yEqDMf3SIYamD^kh1F z`EGPP4(ts=_k1*;k7uVLFCPE;e*WFd`Di{4w0QAse|kEHjAxi1q9VPNXK*BP<5)a6 zY^1z+a9uOz4G(*J-SgS>_~m$h&^>?pta~+nKff69tKZ*^A^E2<26Q?fpU%%58Wvr= z7@tkgXUF6IRq9{;Fn&E5eKUQ3;Ex3^P%R&#{R}NbBlx>>Jvlv{E;`bM_??3u9$k$d z9xn(Qe~3H~JPOi!C=zBg~s?&?_UY;M#{b_%4`fKREna*C1XZ^6#VfVN0 z`|jHVT0FcMAI}f6)|lWP0PZLNSU6YA@VAoi+xW11643q2?z`!$Y4FJ+h zBl_ds-lfUBmvn}Kz#+8OsN#{OU^IZKRwL`je}$LATM*tP8oX=}4#bL}?-X8B*<3gv zK4u5s3*o{R9mxMLnu|6FU&_{8BDZ{}?5!+0RgJ_hl%vA#bGC>)z++D&m0P5%-5~vD zfdI@vgTS1ztPms`D+H6~Xb2J+zlbM?J69Cwo-DiXF3__yxw=RZ7;znpYOC)1-&b#$ENjg8+BzaF#Y^rmVWC3_9j z7>!36o|_s;cQ!ljrtjvHx0C;lXFpDWL$fykMs)OteUhrX`=sRSy|byQTZ=?MNs?HQ zR&XIqJ_1OVh!}l~t+%!XM}xW5th9)f3mwT zXbCK(mVl*Xy3(`v1Y3GSr5l~fuDJ>~LcD70a3Yy$ zx(+8X;2HVd8k~rl&FVuq>c@QZiVJ_LqZ(av)Moc_RJ)W>w;?xfgU7ZZH*Rh7l$a2% z66UxtQsN#Qv5sE3B7tD4w`3?~e;dJ)4ANvJy|$>RWbc%YGI<+0F)gHBNaxBCR&uxS zwpnr}k|J<(g_(jmH~HKM^4n-O86BOB&lWIJ$p9l&K7bKR>jda4TnlfO44kyG4kvN+ zy|^zVK>IG(2Y$~NXmY#Xb81)oo`*u-{oV$5x53?QD1~hcrLfz2MMsESe<-soAOVjF zNwSwmns2dv-9oM?NDis2gsUMrW?DlyZ{~OnnI9&3>3D|nj6S#Dy&WCTrf1z>j;E(* z^VtXqOYeYS+1=-)_sdqeLPZ#OE)uy0Q9&V!x)955<$fx|+v4Oc6g`=Y{_$?URQ(D* z_&)BfX~t!SrNhJcT9$Pc>JQvhju&O>%mioYGkqfMY%ThWE!v^x*(n~2D!9_uKqL(&NO7;!A{7CVl zrnb9ZMYgbmLTt#eq)$u?Go2~-6|-oGwcZBMeYUUxK>HSHZ7YE0e~N0-9_x%75E{wy zrU(t)kwUB>IwK?32ZU%UYou^jxrW57#cS2zjf@GETgqR`SqSsB%FR#0?g7)h%HaHj zZvnx10OdS@a+ZP6fhYq}2Vx7=oo|I!-)}~ORs6)(ELsDQC)gaU!vzG>J{E-}lhyi>^lMtP(l#+7#Wr7x#9*c4;vn#w9vvNqpy ze=Ir=rERaVsQE6SZKiRigc!N1B{J2RAE&~qvWtJVh0H*5Ly(eS6(*gLxC2)z^|;Tq z+~QN3H}a`Q(Qh~mlid(zm>=b2bIB;%O1&C#Io(ke@%3#Ge?K&2({(tLA1kiI$$s)m zvJPkV17lu;lVA*f31bb;#;CvPi>cm(ucZY-_el$+tkMEW8y&d#t%0Je0~fF8Nk996 z%bW4&Y;rU?naqFx@%ZQQ@vq24`)$Mm=%K65AbFkq^9t9(evraMGhTbXh=`;Xzsyx7l1;+Dn&3EMO*=*{E6$ ze*yE7!up!LZY{d#guwQF-DaIzlC}}en7$Uc^ z)g_6xUI@qHO@qp?4ung9F3`tjt^&%eRbq7D6?>iGYBpdjRfAy9nbc_%(=S#~YBI1XYQni- zDrNHstP7NRnK^@sc^6}PRoew)f6?6Zqim)#t*AJyoJ>Y_IW|5xZl-E{Nn93cl!8(l zfyHDE?Og#S(I|}7+QyR0IoZmw6}gyOGmMkrYmi|Z5SmuD0kPScn+r4wKS;2ZGbYGw zX82X9wxNv2IvtB)HK_5~yV&+k2$TfKUHbP~wUjnraWTZU5FFqbNZULKB)sa$_uqHV-{4FOj`*wYAOHLp-e+GRCk66&eRg?z zy8ra)HH=h>hjMd9*Znv;9gX+S2ZuwKjNf%H2b0NgeCBBS_}9;qpY|q$$O{1_v_ zh3zq}XJ==lHc?Jf@lW0~Sz1+-TTSp{Nm4D_wHo!{_?;djy`rDEFiylLu%)`pr#@fbFT8S9=3RuGL2amEudixqS!Y&nKV!e`x%!8ysA86o3{X0V}uL zeoda@+{d+gK>4HDeB=e#{J5}2gG4P0kf?w}L>NT8-vH+l*AzGrsXU^{CY(_`A)?<0 z#xBC@65wuuu_dfvY%aIK*rIcc%{`*#9#OOQMBWZsC3{AOIfvHdYpoCMcmKH@9K9WW zJ|8#dLw2}>fB)nzkf#URgumDWitH^_Ht>y-SD**BNJuwDDzpnJuu2+bJJa`SbEim+urA2Utf6^wLIr>br0jDr~l}#8^fJ1M< zNCgol@g|&Eyrs?GN}5~K3Ix}98wjp>4#6eQ0JoH$s57F5H4uDLTvD77z`Vfb73CRG zXc>#d>@({%DN)@HkO%?5N~r#Dk}`6m^w6jC(_nluI5-_nk0xO&c6JH1=N*KA6rzV9 zxR)Zu83H6D`z-dH)TcG3hNVPH)r?q)AVjFV;~JNDu38;`CaKsG*R^Q1j&nU)t>Gk~ zRnD>rC*Vr%DZRS~Y~k5_3)o^!rki7nb(XHMrPi%-IIh84ckQZhtl3lH2hS-EJ{U-S znr0F)S_-!mT&=ZtZE#&=xT*(GIz~;Ka3YnJB`5p}u4VmKBsbFsMSdALZ0&TBSDY@= zZJaL71DbVzKU?@R)R_^bCuWh&I-fHlZs(!MH8kc04^#S&7o^Hg&!8Y1ysgjdAC2z$rigLT+{bAnD#BEk}tzm5{IAeRET$5ebu zO*R=?FziCtw7E)JitToJ@#WaQ%+-S>Qk=XAqmpN6`i*p1m{!9uZ4!o=WEl}@-es|S znQcHW;&3fg_OX&rF+McL9gfZ}CgTCh`YFoA5*2lBsmrZAyQsQ87Sn2kjW|>yWfM** zp5-eU-;}UzM#{4Xwuf>XXG^Q$H_>gJZJG*9otG-GS{?{**Wf}jTFX3_P_SAdf9G7U z!S_Ai=>g=n}0YBxnIE-ProdKD-Tv(qGA zAd7^jmt&0dIr04+DM>iXGOwWpe>rRwendyA;7HZGxO`2Dq!8f;852-L9f~^?1t<~{ zQe`dI6bJ2!bBk6ZLIc-@RwHusTGOMw`v?Ib7InM3k8Ckw?pG+pYI<<$+IYKIyPe!xA)r zziC0jq|NWPuD4Oe+7%dNLbhFHpsI&T>XBxz=)fg~fV~wBnV^5IchLN>mP;`^%#=uK zeoMcrM5G!+C{*DG@FpoyTed^llwbs1xM7AORUhpQbEM3uM^m7?=(=I;?Q_>i-o6GT z7@yTTQMC4I=U%)pLAWKMvEm4z1_k{4z}5-&xvaTfQZ8KJ13|<-za?sS&~u2>cwOH7 ze+rVMmoevG6SrKlTI^7lGqPeQmu~}GB!8{kId!B!mV>mvzR&DxCChef#j8VPz?Nor zha3($^URAj<``XYl`}g|_H7sVE96o#x~QX+?MZc%?NL@|qwpxWLiVWOD%z2 zwOuVfQn%bHE>Sy6RhI-4WLtI0(WGer)v8#tOC?}^f{#?ONKnNkttLa0qmVOXC^?F1 zdMH$&Xlqe%#N6^_>`Arxv^c84bW`k;QaeH&2We*xj$>`5VV^mQ%Yic}h8_|G6qc4l zijIX^K0KAeM&VwLm|3vtY?}xQBY&_5_Oya3Eu{_|Vo%8lNpPY#7@=DCa+2(X$##PZ zsM5~D4%^&PV3uy?>Lgd24{MR4wgL#pM%v8D7RfDN0ae<2P$tC)JyON=wnLIqCkPa| z-06`pqMF@EVo;1TH&wG%n+41zX!}%Mi7g+QeX*^D*cGX=hv~(Y_AH?xD1SRkq3B9? zmJF(rJ!OngHo3Sgnp+AYQy_b4hsQRSLuZb)HMkrZdf1Vb)IP=1N;W-kTD58`qc{!i zd0=T8yIIsJwYwqYG>3LR2F0d_2&ifs0c+Bd#AIYp?aVkRt>yueqf<4Jg5|~#q#az1 zH1CoOdk;x%5cH0LsO43Vt$zzjF$QUES?q3(viJS>&8uTLt-1M|<{$t37w#8dGfu6F zSFC7qeR+BE;>AOpC3=F6D^Az^IK7)^GCsc;{V@G}9B`Ro`$f|U z#?LSkT(D*1dO4X)yNOJ_V{l~O*ESs6#)K2ww(VqM+ji2iZQHhO+xEmZCU1WKyPm4I zYE^$YA9n3N)qT#|*Sdgl@Dii-$;_(xc@c)F)^G&iGH=lg!6x7S*ZzO*!Y?3Ct? z8?QIgnU73%Uniac#xus}2ksFtgJ*SgV&%3fA^3|)K=+S5=L_%w!p-d!S~wyC;D{2j zAjnPs7na@b09UfG<2K45{%io1!g$MhDu6sPXkRpS00(~a!&gyd$V|V-RN@M z)rr>H{yvg6kRYJoDLxloO16*QA>J=sXgud#VCTPsqWxV}%YP>^|5u{Z>%fwHro2jS zE3aS+o*k);Xb@oDW>wZbhBGIR_r zP~re?+#Fhsz(iYd>*uYqFm>Eqjh%iDX(f+fX5A4`sPR#6{awly2T>A4Q|HGQAJ!4i( z;Lf)c9aqN%ug4&i+Iy;R)SDor*1?5hVvhGtEQ^hP@dl)goe`rzX^+l{R{$i6MGsRx zffw2hkmn9x-;0t;I%lKZ!gO`vur4)2N@o>2uu)j|Oi{If+D8rutFRs zh(raM+Bg|aDR@JOJ7ir2PKsm5#*mE#Vce4g5EhYDrFE$2#&2xW5Pg~3?E;sw5dW(| zho7uFh<1%57|23;pX4%~4H>^x|Byr>Ib|Td9@PPKza4?up$$z7)5u^yxXW~h7PL0} z8BvkDDtLmg{@bwFDRF=Q-$Zv7De)gkTze&8CWxINWgx9bYbm@7;T?o>Mjp~4F^v!v zz(ow5VFAMVoO&RkK?5lZW{ZBKl?6WK4S^%gi{Qf_7IFpI(Jm#nk#nb&ZO6qa`^7Ae zZCRr&!a|+Do^yYUwwC_f?5jLAK@*5Tdhq#HxP3M849hQ8kQ($dz&XmdP<2*qCB}0e z<5jvU=hwx`&ug)1_5RZI%{8=`rh`Zm0!+Bc5Zxup6iGsm(PedqsCpm=^MvA6(kDa&1Awbr zyZrDg8BT3u2*TsJ{yP!)l+Th+?sYB$g_d%lKTMRD)k2u7v-Z_B4pBFmcw^RZuRaD_ zTpl)t7}!4XaBT@vCk5YCccPElp=h@(o2PX863X9$wj*o1&&#%?YGR0-h3|-}hqA|C zrM7I97_LaFrYazpcl#C%D|_bwCP@t3BO_to;KVW4teSNj+(R;y6mXItH>_9@Q}Ljg zu8u1L+)2h}hE{v>X%NR#40_*4Z2;T42Ph`9RJ)(m0gEps`=!@9ATV73D1Ph^$>3_t z_N68<0_vNTf-I!J$W$wL5(mExblGg>#=fSZ)%zi`e(eVW1;cZI7HmFfd6)^^>x@mw z2TXbYc8TL^17M+6KOs78um&zS0Ky7MaOJzQW{GYxL4DhQJ z`CpBmV4mIr$bnBU7%L1tnl!bg9c;K_T5-cw zA%sHvogj1CM%jU3(sNY@#T={{80M8InN~T1IG^)A;z8EUrhTt`^0By{VYthk~ zmDwF&kxC3HH?*eiBamb(NJmB(-2hVzfvd01D6M>RX8ZGJILxr8 zCM-_rDwxcbwa((V=%0N%1 zt3K?Ry%{rl5MaI>XFtTCHJ?}lEVl*T+#Fh6lty{`5Q+n6&61%WLwH7TM4jAU&ZDcP zu$i}~pZB}lhs%#^uFCcFZ9ON?aYhT8w5Ss zT{nK6@6V~;_ER}}(^4I&MCO!Lm-mc=N(+&r?iorMA)jPw`4ZF+7Z8w=&Wv1_#zl7Z z({ zhwGc~S8}0I6aCTSr{UpoaqPWc_&bm^zX|r|xa||(VXC_Kowr{aBiBD)w~wsP3*hay z8^;Y9v-P;H0f2wUg9o99!^Vs*OZ@I!o!SB;%A0uo)3OuFMJN%!Qu*^BA1D2j=A%d}HGG0#~bGF#; z;|zFfMe+4#{)S?BxVyN6&EYcMi;OjzSV{8z#+4=p3$%{xV$nQ;2EA5uAZPUKo3M>{ zBfxEpkeBcYjOI*4j3-EmF2`6)6Bk@P?oovG1jF*9W6vv0>l*vv%I^5J30bv)84SWe^a2Nl@z%356mWV%Ig2EZbBlav{rjCg^X-D5I;%JMOiMyCz8~M@ z-R&k&bO4H$#WCdwloyl4u}90ZgdyNjsJp57 zF%2+O)f4zA;dV-dkFz^X_o=QDe4FrCVf224Sh$iw{>mSI9WOD4N~|*F*% zKJd*pSpIAJlyyLtrJyLb_?+xqJJFg5yi1Ke)NI@bdhp=)O5+9G-LGYP&6ibIxFmsC zRYIi*d}D&>GF}rldZX*ea zixiGW|HH$D^xr=U?l|-R>Q-FnMHw};*>^&id`6IGJ(`Tj#?DIE0uWS0D$4WQq#`@l zlzUrbJn2J?(DC0^KA1%UA-s)wNXKuO7T3W@HWt%=*)Yw;@2EkgTxI;|ojiN9)xLz- zsutqIXtc>7{g*;`Sjv+t!tFdc?}@C(&kp_=Si3WXQk^1g!6rnZXhz^c4l*K)Lo7M} zitAeGdCJt5=*o5!CjlbchQPE&>HrSdm@!gA0tX81S-yCE6}h|C;?-uO`R*6|eVd>F zSe)UVO$UoTn}OzQH@L#(P!e`hVKM&Pg~2O$&OA>Ek0@KBfmz1}X-xHw1k{-vD?5*( zQyVvz-)QHCyiybF3)G&<+%dh%9oA~+#BM6*R&bR(O-diuQ8v$uobeum zcJZ$~cDKi86S>^uMFqB^d}|5e^|+7*B6t&FoQV*YBzT->?tF1jc~2+viXvTAf+^Ny z2rzQbVnr^G$J*yNO$fexq{9rKp)OCT9i|b=9>u>*qUekp4ibEPr`DE+6Uva`!mz%(yHz<4B#2TxJ3oRc)K z0x;>vWO&I0WmoyCJ`k4S6%j~Q23`SXG6jbXowPYICeU6TMN;-?WuVY4Ho|I7M+aYF zX$#JTWmNfWM`?b+YH0minZLzvf{y^V?8GQtIA?~&z48kR>nA(0GNAT|m`~_-N-7Yp z3}{(fZ(jilAkfdz&7W>g(JhQkMvG0A1W-XKyL{-sByIH-K`54>hxa!9$JQA>{p1Hz z{KPz1tdHATB-Kad4XFy+^H#wE=~N4*8nAqXBN+Fl-UcJqbT*|g$>3TuS6EUN7tiQ( z{&Y)Q=*!1WlR4=!81Yf`rY3Pg>Bjtou75~<8B?u5Q%$;BxFB5#%+_^Bgc4z}gpsC+m4mh#g&M_Xr>&EC{K$(0PKDEKjix zCRn8eg}R+w&{HQhhLBWTp04RLFOKe<9XJGt^rg_F1YayXoOs^s?{hZ*89{fySv-TE86@5r zZ&eAmC#S4uw|i*TG?AGNc@d@6RG5fUk%6+&gyXIRH-5IB+(@9Zdfh0_f;+_8(koe= zO>NCbTwjcnOE?K}&UR}@>J0>DV;P8ypkhjJ4nm-mGy@O^GO?}SGR!I*jR^9(5v-gA zM)%gn)H;i&O-nkUo(zos!_sfV7``m}8f0k&L!kO0Y0XtSJOb;=WQJ8iI)=t`H^+++ zLd2SD`|2Fff2OkOa$t>s_t2<;{yTjJbs%b4gQfD(` znV78GPAisQ*Imuk|d`LEnK^+(BF3RWmglMB}w}x+=Z(q5ogU9$I#F=_->&BW@lKkPaCe=)@cm1(VS`oBi0Fjb3^JN1cI z`~Uo^QePId2=Jwy3sf*vBVe}vz4J95#jB7=CrJ!D`;85Dwr6jzr?M<+F#+?Ynk{OH z0qW8Eb!260g(|LUYL)e?6)xB6tR>u6$Pui9hD)0u!?|l3trnm~og}#p3{sWIE%{(< zB`Wx&rtDG0Q>Dm7zn~A~etR1s$0!irS%FxX77E>KpwnoIe$r``a%B?a%w4)cuh!wD zI+lt?N*50XEak@0A#WvphKn4yVbg^)0-lxjH%Lu$nR#;7Hc%B(T8JsgReLM3NT&>H4KA|+cE4{@5}F^9o0TF)rTM&C^jpq;FL6R4WZ z%Gh2r5rt9@l6SIXRt*SBcNFO|j)cHXGj3ty2a|0%_Z?X=b;BY#U2b8Hun>7ptz6PV z0aP!1FA>)PA4}oy&7D=0&7vh%QFd;V=uFRxi|MayJX25>wTP?nTo+~v*C-sF?5gNI z&e4Ym#88T@G0q}ep^D!tJO&F48O3b_t;h`>1!~;WSdPRsh?v?=FQ(j2Wt3{zdWC5r zZ9=KjDjv7JJgo+{es^QR=j7(bmIku_0o;`QyV(0rEw-0=cVx`M=}ZzP9@vY}L*VTt z(MV7$KDsE(1Ov@TW=upZSFR+$0adEdj1QmVhV?bQ*Lk;jwGPsrWAD$E$mdp=V;^D{NePYwip=ro3a z9H|R08ZzjwC^h1GbMxWK?`XrtitBjg;dbH3l@^YBj5g*1-Z;Llr=2G9-&xf%(eoD9KEFA>;ChS}B{%>sWkTX&iBkM_6c!;}4+^P^|;5#M_7 z02~9Mzl-y4j|=%Mtwg%9bfbVjiHGyYa9&>vh=qxZ`|O9YHhOUBAa%S052!rQw68PG z8@{?TFoMjzZflnQ^o7d-?E>9>-E$a@&b$n^vEX1{;yyGCzmf3r9R-5#sr=U{Vw8cQ zy_(!;TOejJ2V3I=;y%BgUjF^~Ldlo@NWJmle7Um!c|Xzpisgs%ZGQ*Y*Z%|~xZJi@ z66gl&%|P7DjNCv_!pCatuFiWUB*qga?)*gytw_eKsjvghQy&ixz&zSn!X z`@>9ZZ?_0`+Bn;Y5FB0sUK_4tRrVHh$-K_K7goQ#CWw~}1X&;8%uPMErQO9KST%_tc@Ipo8caoRE<~S(J?b|QwDEuffO-pD zvKCaK9$a6)NvqCGG+#Wah;mN$vRzi$5UI|;v@eHrz#AtFKZ5s(?0IQaKbCnA{2479 zROTwaM2h~DHtu0AOaURHyHN#nP*js958wY{2`Q47hJ-C_5~~5gNe;^3$170->;cUr zD|oLHreKX5M(CeSI#W&UsC0YtwPH71_#{XGFKm7_@au7&2Fzp=drmyG9uTLbDb!B!D}#f|Id^e8bg)w4xa1oB3wKcMi&&>m2{KQ{T)(AMYjTDdBSWM(W*3JwkF;Q>Yj zcM(r9#T*t_Rv){CB}T|xF8=yw-R%GeC+dc}YufyIt`(TuX$-dFD9X$E#IO7hO$ryTfu(sFz`zIM&;4=JBr z?(zNECjA0ZGI6H>)|H2*3Y%aNd*7P(phjq^&a3gt%Qj0&0nNoO`8c0Y&$<^T#R*;m zOx1$CwN}#$8*{d+R2Sx^U`BFQ<`Kgui>xg3_m&Ox#qqRCc772@qka(+FlAGS^WKMl zh0cQir3~qww%0yx{qek}=6y-VFCJp!@?_2v(g_Ig_%SF0ROb0w=tM_)0w=q`AB+I`WOb%5;-9)hxhJtSNM_IK&M%4pH&)5J?A1|OY`-X;aOS+bY2mM6o! z1M9>Q4T6yZZ1=nVSdIb7W7y;7;h-}p^53XJ?{T|{zG1-J6kHZoBiT`NK-8QTt$1INFOg{m*_VNNa9a7CY_3 zQb|7FS~ct{O4k-;YG@cV&|Bh(RfW*khjy+vt7t_4F)0%~Ss?R*QoDtk_)7R!l?GgI zsxzZk6)I`IVqV0B97v1ZYKz&rCNuR7=BlOtS0q~IS10yny1MgvkM?H1V<-9XoCaGYg{cbX_mo|a62>>wX(Mytw>G?diZm@;8AaE$9WT^$F#vNl z6b%|YLOyI9O*!mevZlNsG%Di;BS4(`m7MCvMJ#23cT`(m&JBOU{_-R|p7(r+qBaYw zIHyTnUbBjvb|n$xA~v|HR5*q014+71`;&UOC*?PPW$`Q?+g~%x#zO+?56CS9ke1~1 z3gmFZ$SIZT9Tt8aQz~f+YC5&=88bKSD#rYrg%B1=7DyUXc0Sn07wOotXp?^$d*8s>x^7{qcb!^jt<76n z%(SUOuO2SvIrclZ?9uJhCEEewR4)8WsPeL)%}z0S3n|dxEs$*Gh+0YxbX|q z4L27GCv3n9hX$)jI4ztaL-z$4z;&z&U?OQK^8;iNaZ>~6LJXJx{Gu=@9*b+sLkk=r zG$bp&#km&Ly?+;r$wP5Q3-zkNsr8K7DUT_5fO?8HPIF35g@>%zh%iWwa?9S&N>G}2 zABY7rRp`Iq1x_wJml$FG!-o}AOraX}VwnJvzf&m-L)U#X0z%op%AO?k4j~-6hq4Hi zObCFHzY}u>=c2%>MHJ|7AW23+ZBxO6HYHCMS_gv`q--N5EltP{pE-j{lOd_uSQDY2 z7`4|Q!{%ZLPAl7)%nOJ?oMP-prxe?owA>EJO;g6BJSsO36x0ppqC)g2KJDbga_F&C zrb2ZF!;1f56gD8stKz4G{h>!o6ESq7#|22b;3E;X&-~^{EYqZjleEuLQkUVQBFIV* za;^BCo}^z=lqgrefq(t;!Kcr(UJ3YpbcQ3x65qUu zA$eSWpLbCqr>C79CHXh+#TcC-ugnQMXN3T-+c+?}Kt2%*F7Ny{uj?K3nld|f5Af5? z-uI=RYX(Y2G=zC3XH|wsCRe!z1`3!iC$r3zZAcrfDzcJ`AzGpEduR!7rvKSi5d6je zwjX*j{r928gDrD9b^2n`O}d*aW9pw#2EpIRMb|qu!G1h;fR(R>uc!3(aOJb{TS_`D zQ3z=~yc{U?IvhZP>;eRjeHL!07hvm~)0@sdJN<&`Zo!oMg)MU?FMnsJ{BZ^24;`Wg z0}W#YDUxC|46n6nPn3D|IzIB6X{J~7rx|OEU-zrvyZ5_JJ4f%c*kVUMg@A5%J@IYy z2&AWrw;1jYtW#E#q3ya3w{o_^nA1q=P(maE5HZ>O20ew z#L!`(_ibD8WL^?nEl-SWfqooPttWUnqQz_JynilX7M4kzcnH?!K%$MUP2-B^vtZd9nKJ%=FK}S9LW^VVYso9pKN7zSw!U za_l^RTu`B#>U*-hFxx|J8|lAa$tl@|i zg`@*sH=)9rIt9r3vYiFQBX>cnwp9+DC}~zqE;@n7MaX%q-Njv^cx>IHY?uCEv?9j!c=& z-Ie^rjwYb7v@O?Up50z8jU*yyAup&1z;C zjHg1}cVoUzb-Izn^@$mj!&8YMH&D$G2hys)6Yc5|kjjI|fDLkeTGiO=1o=IsEB6lz zB^rrrZ-xh%TN5f=Y*DYXPOD|v8dY%3fTvTEpYI|nVFG0aWlr{qbOo#$e(<=RRTngE z8zvJo?uauGK7#Dxi8V0(nmNc`yI6Z%{ZT@df?FOjD6EvMhq>1=K7afhh8NjO=!beM z@)H&uS$`1@&_!^Pf8Ea1KoROIn0_8}#e&F}n1`noELY+1!FyDuw{*7)Q@u|nu`XH-vaL5rpvQE9wZCBi?%z$M?Htv@kd0#Kd!64veBxjIqX&<}&JuF_AJ0*RUR1 znVFUAiAG$;f9^rUue5Z@{Rj&J`(`O<^&Ule0yS(RYQ9Bw8K^R>GtJK6fcS;}BG6ze z*GzE0@6jtQq*d&9DhciS02%;$sai7oGmxzj9OZ_BF;po7kRec^_|us()VPA_g#$g|bntu!$xcM8dZ188$xvn>qKY8E#p6(16kC_v__l>+`wy{1p%y z{yzB?s1dKB8X|`xH`ulzT^ZgSeduL%q?TpKRA)Ak$M*6;b9VQ&r2|J%0Ym?U%5%cF zVGDvu-gT*1Ddds0=v|&jWVqe9i7kN(QH0W+Z#6GOtDFGTM%FW1pUX+fXw@iTcDW%2F~HbXkxyAzMhA(PcTMj&g`ht!*wriy)L^A zjfe1z*u(W>_YG|te)-M$kI8Y1O&QbDtK_e`&!3a~m!j9=5Sl%q=ET&~2XAlp_36~s*%+4B;!1YL~9l1RLAEkY}lt|}Dil7~^AYSw6 zRkK|x&>3u>XULiQE+`igLAX&D=1UwRM`N=Yu}0hK+2onDI!eU{%H6=8H zkTsCP#h-zvSZi)#RTgu?Cip~B98+aXG^nb7t0jl;fcj}$69(n4I z7`8=A(S4mUCUApQ@fnBGmR+>2anNz?m$W5cLi$92x?ZvUDBx~Lyiy~1eF*m zW?`M;C2{gCn2Lj9K^w{%g{?Qb3OsPo{w(MVZXhejbE0xF_~;yS(% zDN%78xn4-@N9bk)*(~Jn*%v??PqN4erjQXe(8A?#|XOQq%&|ndHa-)5{bTI6-H^10khDwMDU3WBJj{71N&+-OpIhiwh_`Od6(e zoN5*lQyDddhc{IDwsNTYYJ{t(hQpv6_8qpU&sJkilrWb^;ts#U4^I@i(jB=A7lLRZ zH2ts?CzCQpLujpAC)`&EV8gy-GFY4=4K&oEhb}Wr2{Lf%WeSuZt0HR)&5VnODci~^ zqf0dA^5zA#bP z=mMk5D`v5nx41esoR=UI7C>f~-RIjn%4p0G_X~)$?twmY2f#8e z+f9ruUFMBU+AQAwg~E;oW(;CxzH=uGf#IL3uik_Wj3FetI#XWtVdl=(`IRLfQ%Xm4 zs@HkFY|NLdo5guf|NU<8@2cOMDYs*7*PW9)liz2fJ4k#eZQa(D9#%*hgqAMPuwY5A zPo>VSIr6_q#h)WZAmHq?&g<#G4rfgnZzgBQUGYdM%#T5f5&=*iK^lA+JQ*f0Cg`pE$Q`Tf;>{WkaE;SUP+nq;jS zHfs!utA%2rJ22w&T)@-r&ffI=xS9R8$*Wi6%LCx&zCh>zbp4z8=ks*v?d$vBkZ}L& zbF{McpZl}Z%i{9vUoY}Sy^dZzpYMrp=Z$XO?CvWOveBWN^G6*S@lglU=4F)^Uv4sOXn+v>vm-l0r``{$ZRs?S}DB^ zHKVP~SjR=R)yFQ6-TL0s7usP+G%}ce)CBjcb7aF9!&?c_{~|b#5j*V6>`Z?mIG2x` zY+mJch5cXgiZfM?qKcgj@1j)POCPl#pcdNQrTL`+XX(65(`*YKU}qZL$LGb589X+P zFDU2m3$1Pr@N2B}yxNVmG_hBEy)tw=@;fM}2>;_A2^h zD><9}DJ>OeXUYqE4FDO@@DA5E=gZM{=eG=hmfqtI-cVL& zR9sKFVdijMA-%mn$w}&|B$MM3ZTrvVPV53^!bc&N&*{S1c4d|erKVt+Wh+=vB;^v#&C%`|uJEwP}vkukn_ zRZB*@?Ao^{etmG90xdQLe>(M505C^d06p%oIPPc~q^8>6vpW(<|!K> z&4C?(9Vfh_BE(Fr!VE%($-s;yehM*Fyl)SUAF~E&d}ofN9rRl*ytRqgC6<8N3{pr5>kJ(^LPpOMhhv@~rIgr2q7BQhH2sZC7<1=KxqA% z3F;L{8KfOR1I|oF&rTGA1W+|7(&m&D1j)}kv>*yIT7oqTj5ZwZ$f&iY@ZXXHFRx)R zTaKE`M|J^H00I#>OzxU?EJmVf;G7u)N?ZN}M<5fapTl|}DT4C@BS&`0R2)hC@CvZ!!x%y1kg;T3SUGDg&4lA zdN049bo*2n=3$7mcaPWWn|VowxYLb2p0ciPPO6G~>zG@{)#;j()WFE%Sc>CVLWXYd znC}6lt2z1haeRKC0-XMR>&VKf%^Onm9-rXpn#UdMX*M&3JTZ+Q_Rev9H(xQ{?f6Dc z;60mrDeom1#47sbB>HMF+a%P5@>`)^J@>r1#(72?fb)LX*!5d9L%}a^XU%OUp4e~< zlL2koj~LHYSr1BXY~<|1rs>l7@{XE#O2jPIO*rsGHKbt#0cgU3%_jXCP5RcE_N=k( zTj1K2LbTIEEi_^}L9dgRLx3yWE(gQ zWC037R-#sWK*+J3mn7GSHN_pP6D2mRr`}@JDblj2kWL4f0paK$cFr zu#WY77&gCtY_y*lFER_Bu3^uhdA-HrJCxt2G(vxDtqJ|ECAE7uBjk^RT(dAQ5D8H2t;p8 z4k;4lOrnialVL`njoeMQ68}-+rb?KNBPWGPrZ7mmO5SiPAP;2ycqVh-ZDYFwza69;dC!E|KUjtS>sjfsW}LpAN6&H)iz5DONOj5q;JbmomO zU%2eGlTK)fYrPRf6AU08?66QUO!H>g34x}*0XYmXy+DuBB^b`a;@z;G$Jq6ue8ClncOqtE>y;?;v2lvVUS`_=CEo%~iRnLnk1 zIgc}ICl^1z_q#K0sT;iT8hoh*AR~7c6B0A=u$%}_e`7VVCX>!|!dl1iJYiM=fdr?*0@{9AlTAkEVM@~H@Y(3mpNv8- zUh90kzePS@Jvy~+O>P48Wa>-wO4QG*GG{s_cSN{`GtZ7cE&ppm{YCA%Gjg(IeX{_* zW)9fd@sP6(YJQ?J_>@-6zC@ zP5d(eO!7rhjTm0*@2wtdzySE8eb_O9+s&RaeB=QTtEH2>TO#XywvBaEsQgA?WuYAT z7JuefrH?D`mxCKyZZqW7?oQWI?+w56_V6*m#&c@p_29Ci6VLbBKhLK-!yDuG@~_F| z%GK%GzgP2bpJgUFzdr0UN=swpN|L&H(OXafneus+y>fc^ zI&Qjre2G>^|6!*gHY;@@*9dup*-QS0ie019gC%c(XZpK6kXQ&m5c+{}TZ=s1FTE=S zh_T^09(}HsPaIx9I`#I{(1x=ZxY_S*L(ZDwwv=!f1HO+d^&X%{BG70PRN62!vvX@@ zp70M*G*UeyX$j}#Re84;Hly3ozKUX5%8=FZjY`sO&pFw5P|mFbXVbPX#0b6EvV z{gE7m9$(iqWB;AGV(UP=s40d;gowBYNLmxg2hPGz0d3fwK6Ru!ebPEwT4wR2?)RmP z-kE55nJTwUFZ|}kTwaOaWh(XE(hAQ;yJERaqWSfHo;EKX zJwARtJ`5MsmO*g`!^Ws9=8p?xK)UDGjCsOa8>V?miyn{ITL(0`|K^n}++NyV*v5ML z)yH3odxlmnsKqYO5k-jSLsS$DusZY4kK_>G!dc1=!0CMKTR-1pw1W8TIBzFuXw7Zd znz;8oS5~HY-+Kbd|L&WdH;;8=n5*_8AiDnE$p5GS9B*L-2BvK%L zF?gee{o1C6{dyZW;dkj`k{4>?W9in+bo>A6l-;52w^ASb+#$e8ppKCIXQ$8WRrwjM zK%zML53or1z(~^j6gxP)kR4j?ag0cs8CXy1^XPgdXp`Z{knS|Kg-H(@3GRLzGP%F0 z?nt=v(euAacrPm6u%M}+dD(Pn#eG|EnBS4_9ip^<&EKB^<4<%}c~HEO0ioyFC3$Tk zV0o|6{?2RG-~{lYSZ@8e=IdB-|Im+7EZlh9%KSmNR7^L)mh^Sw z7Bm=HS-bY*M4_@{d-9;h#e}>Vgp|e05E?+M1_6?K-vAC47fD1rhuqanuGG0Bh)is* ze#e67`Ky&J501ij1)J+RlY^W3Ltj^4#Q{Fpo2$RSMmXkCkD|(MzJQ!{Kg^D9s_4J{ zYMY9EPB;RxnNz)Wg00@l=(~UHsoLGKZ1qy1oVHkQ5UyeXkAa(SqHfQ3m;8&vUXNFc z!<6>5{D6UG1Xh0SEO7=7Q3&ElL3L&YGLc>NHU8p+wI1u6z3*=>>Y>Hyao{=S+3_=1 zHu&e55zFBH7?F-})M)f!7C&Y}k_5PPX7$htaR__j#}LPYioZua=|@u+)#&_X%@Neq zs%8Hb`szxA)y_#qt4Gkvgh@1Bk*O0Q^;w!fqP)CWl6)C^gA9~j+T zXxp{*Hd?}Aw;J+MDS!%W8z7{5D zfP!ME?Xj3d#PD7VL#`}v7r%f-UWIRx;!7In8sJ1@;^!OacXS!3wdiOckfK%PyJrZP z2LlnVNv>`i4#XkA-+Hw^P#G#B%2K~5!LUFjkHEj_!LyFOSi>O*seXgdG6J7d2WDB2 z+w}qCMUHS(?*AS5me#ZI!mM7;c5gI-rf5x~H;M+VKv@l$oHsgnpe>?LRG_r>`mEo! zgDm9>-sh)x|N8n=+-is~u_F8|HH=B|785~#9}+uEjI+WMgz71!=o@L?`y{!RD)ikm zpR>XTE!_AOXD&~jdY!6`1Hj+^%s`@7)6T$uEAIk>? z&G8m%jrb*}8sN*Rg~nfw9Q3nrtx7-0VR06oC~E=7jIoG|l1)+AVp_C>94mG{UFapt z>QRFV?l|2a$AmC#1K*(d11Z}n8>UZvCYW%YXd;e+r5$D}T-9M@R9w|xq;x<2S1oB+ z45q|ZV6Y`YL0AB&B()DK=d{MV`p9@(QaVSa!h}erjkJ!k{t=2c^&sttIE=_@Lc=rU z-s}uHL)ApVd51nQclJOOE#Rdg6>EZ@#_YLvkt(}JLr3(TT-MH$T6{!bqCiBWq_V7InWZ|`GyamVh>opX>;q;Z z5pWqk2{dfZHc2{FX^XC3Tw)=qE8SwD8~(A~_v3ny>0~JVmB){MYhq~zeQZ48iVqUV zY_b|gYYc#HK@4UsnS1ts`;mt#xUN`Jt9EG#7Y-!@CEEvSB;}1jI?VRhKazc~AIZL34MSY%lZ%7f7sHR)5<3rJBn>l4$0j~tG^&^dEInQmgC-*qBaruJGBm4e>{?bkJ>ky<}oYNs3 zI-Pn0ICkS7%TRe;!hGTSC~??5Lln#_*c3RHAc{Jy|wo6c~mEW z<$LMZ{o!%@;_~wMec~u8?dt?_>o#o8F>QXAbbN!`N5+SHP$;a0@sChhY1?q01CT;Z zLA*=StrSOldaf_;`;5cK!rH3~ryma|mQmpj0B^B84$%QOkWZk!?TkT{OX|rgRhEB1 z0eR1-+^w>2CEwjzhit3xmTsCSodfll#M#f@kRwSVS~~%Lha@njdm^co4O>a64L_qsPQho^(3Gs;Nzs`Uevp_RKQ&n~n}+@Z^__zJu+V)u0WBXc!l=sY_yhG^z=aC(0%oSY%nlm?y6&e`m~p8CLG z%^>%NBaz9DJ4b zNZo!%DqbQH;ByJi%x?BiM%_;cHsxe)sBCAH3BI|=Z56QY9000WJHya278nAcTeDI& zhp?eARL8 z#&)aMh=^RBh7Cd==9~!9zI5QWWS`*T<=<6)N)S=G1tx;)9Y>9)_*ev81wItHzfgn? z*>a{-dV&=ie3c#5^iAe{S zm2vbJ?q$6zjk{L6QXZ*K!##?w`KyHUm3Bf?01*+7*@G($wgysG!fg?UHqaY$J_cmI z3CgYi4=ZAk3t2>A*3SWIoJI68*jcD9M)~imvz(qC^aX4hO+QbY4j?c|N^AH&*)aC3 z@8GqE0kTv8UO+!OYvFJ52xR6M9UrtuN^gTl68G`jI1 zS)8yV>a@SIOA*)9X@y<=BxU$D{`l=)?p5`#6C1DMj-VmH+uH=lx;Y z*DH;`OGbZBN+9mxeiWY@3HF;PZq^@F#(&Po9CSbO{+hwgB2WaBlKMo+@}3Z;?6+TLn4&&Z-2XC$L^HvuHPV(fdtMj#{boX~!FO*XxjrdIRco-{Am zr=z`D0VlqOO;PWf)7^7Sb{w<~q_OT=I1IKya>*LC5%cV;qBV{9%5gkDi}f;=>auX* zIs&d3P@hz2t;=dvA-^$#7Z#0OsFFlaIpBWCL;fu$si{MD$2q zlWA7q1X5pAgrSWy?`n*{9-PX(UANN!MMobK9?--g_quUgel_9#2|}8A)WO8+vgpd4 zW3f-1t8skfgRtSdBhRkeJ`MS3x7*^wX!z1(i-FAWb!!P3NNe1`32AYB!A?WS^A7t5 z5WuUQDLfY46ak+B5(qvYw;S`9sQgr4v>Lm#l%vwzx6|i{9zlzU@46CbtEu>o7>L#j?ycA2Va^cxZ?5@_90@4xn zXm_O0JjADT4B5+VKDW)jDx%u*Uq}o=Dv>)z6Fvq*%XR+3uxt;G`|qRL+p^9$3ovWi zTof94s*Wvq+6{~@A-MDH(g|A&I;<`U2ta{BUS4mrgM;kvIkGEHqTP$1XFaa~Cl9Yy zs|7>r-q@a37pH(Luin?u)>~N6X@?Txd zV8;3`-BsdAwkr@lF|;QN8-@O3==n^-s3`B}P>Pd@qM)I-*PFw>fxWf;EidDv27vy| zuisY+u$YeRdfC+)%?Sr+3K$hfL$7m2Y=KEzUY#DUJ}+B$Th2*}U?$ZcApi0XSimMC`;dQsJlH5w z-;bxfe4F3y89!V){hV*-3FrV=e%&uem)8|T8+-N`ad|I!3ZZEfKYjh5ydT<{i+#2s zji}#Tozqmfp>HsDoI1G7*6<-FzjFxSD~7y6IKFSnjyvMQ&k6QI@$xuuY5;xrHGQURAUq#N8JOLkOPPl<`a7X?-1zZDyHyi347QyL&0jDJ>j2t zF`1{f3mrvm5DIAaF{Q}G?gRx!Q>RwrhoIE-53fcmWFB%qlYhwZKo}rVd62ZC)!XG2 z2(qk2%mUFa^y29AFZ^Ad1OPTL#nB-;;5mLV++kHB(fI~k{fa1K@#N-l_gbYOYW{uJ zwDX81KgtqTceo2%5$kas?%YhU0I>}5CDcH@EAUh&FvBbIarqE)6x)gR443Pdl8X>H z_)uDOku;E9PzUf#MJl3`O_N3Q7j#OdU9fSl@J{&i@QBeE-l6sT3*hilpknCk+{5?d z$>WoT!=1)zq{*YXr-|?`*R4{F)BE#nxmqtKJ?HhBB>tOgUuwuaSwvV9#3<~X11~WR z6Tp+{0{K^9qz8%|sjA9*DUf>y<)64i92$c!Y;wzWeG%{JXPB6U#%?{7DS;rvbG#~q z-xW*gAAec;cS-R_aR7<{{g{7j<4SgRUrzO;X9ukIAtH=6T%OA6@RtFt&16;~8@+?g z8b{C~q?a7u`{AUhVzQNPV~Yq}Fm)t0_f=-6f4KtTr)%^hYSX|kdpy$>1ixc+-m{j* zB6{%hQ>wW?CpN17ug4Yf(%Z2-Z`3H|y22A5N(A|)J;?k42|q?%gfG-_>(BESKqIei z)eK^s0>@xKH#%C!`s@qDQ7pjpO`3GQnnJv&XV`&XXt}_Js z=g=VUfxfQ2cmTrMJdrlHiAPjzHU2=w2atzw zH(n8}iimtE?gHJ%&_y6V<+TC`#-8MjdF(_{q(EMC>(R36rwqdlTogsoZXNsdf>;Jb z*{IKmmZ2`U-_#lrk}w2k@a|yElY!vy4%-rmfu)GC%r!}12(M_ah*H%CEn?kJ`m4oI z8lwa7FM$5zqxvqRs#8p(}ayIP*-rmJVCQR+nGvV zvn!Spe&_4|`!UT?N{Rw?7R`?`<--J&vM6as9oQ*@>RWt>MF}mPygG7tc*Vldq7u1} za#v6i5sJ|1&VFQMg6A#L28bOQ0b*aK+TzW-M)4gwR*B)K@aVy2*@r$7y{B5)2Xz7& zJ<#rB=S&y8!#>_{+zaH6!ILnr8YPYxS{+EGrM6CMK&YP33) zXr;02^7_?t8D=hT08&m@d*c1M6fL~dY369XhQC|1<%1zO<+1q*sxgAO-Lk1+a4hVb zl5(hgA}raL$|#?_nN(3_D-f~+OJkjDtG9O4em}R5%$=eC9V=S6Agvpe?8#CPWB!sh zY#FNkiLLjFB06B882&}#{*}k`&5-k*HvMgF|H}%a8pja20Pu5=wIUi3jKYN_8!Or> zK#zznqtvb>Meq{1(L^Tas6K_Os|71$Q)}IuCc!in6~%64j$W9E2y*8+g|-}_hy&@D zMXI!)9GF|_xAjgmw_~m5lyu@BiA(T6GojBPwK-6)J|!P>ZF>5&`rSV_JjRWl-LC*; zTnWu+2Zs4tu%2)NW#1p9VO$Iyuh7dOQ#9tqocOmqv;Y+{!g583pbx`4F~}Hc#d-r)lz{MuVt0vJ4CPv9$j73ib^T~%e8O)*@pp3i!q zYXBgnzFt1Urmwzd%YAREN=3T%SK2bLkvj6d`o-VD;>R>dNlL7)ZriWd8UQG>Kl*mI zer^ulcA3A832d~(I6J5cq=i#sWLAqcL;%UCA}FhKJ#dz5v1O(`xp~sr*O0{~_B=$% z8jhTu z7h@)m!+T-Oqvr}Cvn#D*s^dw;y_G%3yXc=b+-axvOh-n^wC9Qa#@eA1x1IUDO?k_9 z<49>y4MpBLD+LnJ<)%nuULlzvf#)Lp(VPS4glP8NLBdV9#-@Ofb>iTC$K22iJVAxSBcV_t-c|cEMx8aKm5`gD|# zbKi+nqADBUoAB+fC}HQHk!iWTu1vDI%Q2`{7h|-##XX=bP~iatJ)q~{fzxj1s$Drm{xwc2*SNc@{->A^}5$+n$c-)WO(O|j`9 z?)gcAS^as%%kWNDia4ZbKJ+1%yGLnBIA+nTI^e6fBb>w*s|b_fN7EMmDrSvCS=OUN zJ#A(Vs78GRLkU6g2`3MgVgkU=nuza*JBFJ@H|LM`=&~r*d(E;6vJehQdd0ic>e=dy z!Q&+3<5nL*xIK@-cjn@}&66DKom$6Ja{LMISYDdj2u{wbZ<#xThVek9$(nBnnNfQr zvLBQ^GoMV(gUj=m+JBJ_qDpYRnGs?K{MAZsvLY`C24-Tx1KO^G8+&rDTNF z)Q`Yrhk!`Xsm-V3C0k zxXJDP^7BqILr4vEk?O^{Wfo=e$Cvu~;mHUUvx_1Z$z}ssE}M1CTaNTD)t8lJuMv5j z0MiM^3=e}GrFy6LO4s*F+aRENm#WJcvY1*uYMKi0KcF5}y7bYiM0l3Ot$%Qz#8mb) z6Y0ahFZRMX5f;H-l7d&ti;a*EM~=y(QVmE92O0_q*+r6B1p;F9inONI|?)Tf<9)^`Z%{Vm}84aMiSJIJXy?@*3 z=Td`?J!H$MXWYC!dnfHbbaMf31y&Ptq3I4WCRsIk0uIxa1OkCu7$|0u^+etQUFhz& z2oAUD(PBu&lTUgvw9}ZRtGF5kWEycE_`Hn)NQ<4~41>cTJW*A5FnT;aN_xOP9-Mjw z`d5{dRA$Q!0H;Rb9@DPZ$~}s;8}-HizBh7+>t2gnAu3Xs`1@ZSPr+FbZ?V@VyQe&}(5q*BQndT0q6>1)9 z4{j{?+FLY3BRcki-=2{Gvij}WkG}oQBIeCwvj(=DOZ%2B`G&_s%lr1v)u|kx&wo;| z#`an-jMwXq?$jf3R3e>L3KZrGpHD7sp;8MIPrDWm7I%&ktR@^ovK^-aVhV%g`)ZB& zu_H-qf`(>(#-+H+`<`5tCm?ElY5^6y6-ebsVyn6@IyS5u=H5B7yj`5w-$j`cNoPVl zbln+S$1BI4_Z}nD_cnVLMh~ZAlC0sez9N{HrbK9CLx%-cZ z3=Y>P?=Lxg$4$4dgWYgye~@F6D=6#9rGV)zh}-?CV>u4dK6WeJoB)%~U(^ncg#Ftn zI%!FUQ*Jy;NjorVtp{7cBDctsb6 zDs}PyV3~Yb`jd0blLHX2P&FWOWOd9zcIUxCcKd-qb~9#Bfu3YQ1RZn7snm#Oz%|+e zDmHu7>~^U+96s<+fpGI$*J$s06xQRrOkeY2;xoa^CU-&YLh|=hE7H>I#X?zI;8Zq; zLMCV#U58IiK6SUhtMB;h_bCnuWURV$dn*6!6RQAcDoDTji zT=v}lpIze3JL`(T-n#?Qp7&Q`uz<5o>WyyKp!3fv2GXGd(tz2e0l!HBd65S0ycqi! zXwk3Ll;LWz>lM@^S=$+f__(?}S~gnn6j-O=pS&t?g`~SKKK>b(Fuww&$E+hOjRMFu z={uaZ@53;Nwl~Mf(SF0Yq9slD^8f|JoJAJV-K-oLY|0c1c8~T`S;PUonw4fX<^DTx zXXFSgkHVLDVuq$D^*+buNTtV}Pw=t&jmC=kEI!f_z1I8tH$?dj0*sq$fV8+92t!0n z0xhbYMn17%z(pa5c}&=A?H!CxuOA?u!Rpax%E?f_<}J(Q*wgVXvwoPXibhjD&kT&1 z9&wHq|K;Zl-4yFq)2kUHI=9(JlA~2?6frx5!bx60lDl9vvhpvH!}35-5+xkLUC!VX z0|ao2J(CSmt&usxq;Q5vXA6_b7oe0XMyON{QmOBwogLGV-IElnN;~PiCIIT)z?0Ay zA27g^-ugsg$Q>V7tF^aG(DP)j&&l0)WWHL)r4FsBDe@?F2B_Xx-)SiLGSgJ$|Npy{ z9;d`J5a7{c87M({8IX9ZGm@nmg1=ug;i_#y<(q_RcJb64lCQBqJ_=yF*HL4-$NErM z<=?;vMA04pJy?m%b*+ejnbMeif&YX0Kmbc?j?g6pNcE>O&M}If_55?@-NZs_*@H0C zN|o$w>mGT!J-EMH{Fv#5<`JX!IN>w-l#F6+Yb&Tq3@F-wpJ6S1 zMfh_FpmbE>(`?|86Lhn+sYWU4^O4e}sxp)Qo#1|NHc7LfQc$t4L5eYh{>b$Y$6W zfY4{t98pH}_mG)F1f|);S$;CKrP;3t}@_GNmr}^}WA@0}H!`s7$ ze)YR0yFkV?BFH{Jt{dQ5&sBh6@MvJ;>~^1U`7lY0$lC+Mhu1rZTl#@IYzsE5@3}+Y z?4Q||%<}+vd-nA7_pS_l4HmiU6NiT}hIEgy@ z_&oGD2k>3QPMb+=rJZW}oYEhUY?;)h|A=kqOE5e>J62XV-{5*Gj5K*BT)TJ$`B^Hr z-2mSs0*1zSLz`d$zJ8u=ZZGt$8??PfqQc|;ncnJg*! z47Zu=A-MgVLkl_6tN(9;0xX)%N}UClt(k^~HJ@)5_USrThb??|Yil4dTNnHK@G$k!6*`5UcmO%l=;Z}!jKT4<=Lslo8z;c zv-5b=I|)%`73hRZU+1?KqHTD~Le!68!^5kt5^?##%*%=U)$*yyvm+%}=M3rdJMy{h`y7XLB?Wf{t0Xqgub*^FTlN&dyOxlslIW6KU_MmkZh1N-|@!|M+A$wl^-IRq(JF_k!UGZU-^f08i5q;l)QOg zYJrLNyAdC?0pqg}FET|1m@*3R#Uzk(Dd5LH{w_giK-vLC?s;H~%r+@iWWYp>K$E3h z9@(mn-E#Rr4qGU^)2lmq;NUjw}F(n(n&jgDn_^9u^q(Je{v5F zq?HhlsR&^Jz}-#zRKJ}WHMZ5|j=&ffU{vJMc^((TBMZ|_H3Ou7vq0M?lo1vWw~|vQ z@Hx#dfHeJ@kwmVzfX*Ijv%B>JF^St>SK2G(I+k$fGki{R*H_qFd?S~_nx8aFjh1bw_U=r-mBxiQyY~EjnqBatlFUk@Q^MQIZKyFyvI)}c9;3b0dUa! z83X#<7~;L&?^@)Jv`)X}4N^F2;CfMt)Dc-rvwY!>TsMpQ_x6{GTM->64_e0)L%x`s z2I14QcALtn;UgtQ_VMxxvMN+5-!@z&pv|YDB~aPbN%pQ=en)~o!>Ra&-#R_m3q(Ip zmO^w4P`y}e_-X0Hn@8t({BhY-5@P@d*(_@K*w5RxU*o$y9*pwmfU)_Iju#m>;JMWDTyB#^v^_ znL}H5X4|DZIDwb6Ml62W0c}-{NgfRv4<7;v;~sG&<*Rh30z2$l!{D6H8=oQX1KVN^)b?5zzS3>rzwitxcje_lHV;uwhX zO6Xv5Bur0PxI#)0=FtIu^Hn-Mos*pGjgkBBd*T`|qX=}Do+qgjf$L&EhX4M}mnP`y z$)_=`f{?e+?CSc00?LDkMvAz(i9I<`2KSNgjFHZHWJe8H4Ted7MQ**CthRhC=*3vN z*OWY%PmUI!+3Quq-Fl^2KF#Xta4VJyQ_NbBx`AzfpSw*8p}g;pNcsJw&7 z%s_hU3@9NCjOMh-*DTby2~+?!mZ@#WTDXQX<{Bk1oLn9M@nyFzfec&a8mrNDDVhh? z72D3rsN5N#0Qfut_&jDqM<8nUUM`;@^l*XnM(-|qt(_@^;`x-#_lgg9g@o`oCW;P{ z<`^Un#=`o3d~aDM?hN*4G^nSdx^LsOdgn#&-27Si0M4%;?#=|0vZ+(>rY*fh;Ecii z23HRC7p?EK;KYZE?lDN((L6Wk+Z}G$GE2W&6_#KiAkP~OIm<%&k!=hjlQO0APiI7l ziM`s&RVHpBq9dvt_0mbU0L9@B`Vp1Bkmvk+zK{KX4)ZD&+0t3qMc7T)dc4gF$1<`_ z>)U{{F*9jW6X_zx4doTg)eTD#Fn|bEj52Qkmud3Z&<~8JTB+s49t;IF!P5wheWML> zlms6@<02-}7+&bI2a;u4ce-y|j_3hh5X zA`=^4j<4%5eFY5NwS0h)i(ZK^;LWE;2|=tYjHHe4&hhY4ki1JomjhiU&|DL z1_JYCurFwPXCYf@!D<*(Q$IvzxTuk5Bk1C_X>g`=uD~jCQS!T>aVJcS6N5!`d$9Of zfT9;+GCowXjhHgoIIZNH6Q6pXvZoc6rWO_keqgrvV>2=BXe7*}M0jer1gThoYq~x@ z!aX#u@Flxr=qu^mN}>SlF=|0@4D2XCVm@H1l4mZ)6dcZ|HKcaPL2eJbSK)#@GkA;P zh#?e;N`K4^{&~zzSMSd%{0?o4ao%CwgYee%7pZB_7NnO^8$OGhKK!eYoBks- z&=|U%@j0ez;#LT3q1-;jwogS(8@+6W?#XW~udXxGcFWajG*UZUHzgS5+oM~+%*oep zSn1WRf!rP~SZdpT7WKyCl^SecrEO6b2z|jv`;|)cNml#(aLgzg+!GeUWjPa58d{k> z>eQ_h>Mqy45@yN_uM@E>kg^N!_(GujlK3 zysPB8RUJxSLwx0Z`*OT;Gv)^XblSp&!J<*7GR-4tt!wqRA)h}nqppF7L)0~^2s3KP ztUe>oy*xLToVG$ey99GYCM$Dv=Sdo^1pB z`~3panVt`oMg3GiO)SHD)KMAcV-wu&7U$`UTRR{@-jEiXPrS)I-tkCN4zE^9-10Dz zHvQaQ0rDa2|J$2-Io0)4NCR20Ax}%=)Wd@oPXw`rFLJ;&ZRz6Fg8%_M=G~9oJY3pv z4WK_GSj+2A&~VzweBkczN=djRM>v$od&T(ok}s z_f`?YN`bw5aQ)J|GZAL`IY$1)PMar1jh;O#+{{1=@CaU7tlkXWwDf$FpvBRnO;^h+ zAPPhZLcfbl=c9j)x*G$WCgx7L%`m(3a^)F*qRR0U0$&0dFA1i4*EDxuR|I_1KX07e zShK(~1w4K{&jG{Er&wC^@<&{%BH72Jc{2)hQ4HWrRF6}+yjV{RB_j+J4MB$AYxjFg zhXXc!j%jaSb2F%nF6>#^Q}leYk81JPM-S)w9!^|wu3x96V_ATtqJJd>?d)*)5St>E zJ-yPH;F~*j?Y|gKfLoJxxK5c?1kGWbXZ&1c( zIdQ4AV;u?ya&SUfd3EgoygV7XeUx8s`x4*ZQypuUA9ryBH}_+gTT2%nyuJb-PLE$c z&r^px13$Lu^*BIJHbRX;X-!ymT&(6!^O$xb2dZWEc4~I4vNtFfu3T(-6`AP9-rc?j zClB99|IU@^{#F+)Iz)@J-03s(<4{BjZMk``6%$b%)j`8Jopn$4L(vye|5Do1mw^Q8 z=*GfX|JID#_ux-;>`w|+r2jCWmFRlVI!yfW%7I90vo zDiAg8;9_+NgWJK1W^h50UJ^o*e3E#HUVfDA>oe~%m?HDHkbhX#q9DGsI}_myk@Ln_ znmGI|(VGw+JRiRlXT>&{qCq7Yl7T=k?5uMnPNh*GifBKyWFEbkP8_879|7X)uPk| zw&%;qtVJWb*&c<_7h$K^4VE`AKF@*N^gCyhw2dkBr_+?Fc23 zq3*}7j2XmAUsbHwDHBy6Q?LB5+AbMAzTr$W9lU1N_zi4vYndZ9Q*X7)pq_;@QNv)G zWT|LR))I+lua}3PV*m<_Z{C11hHc>%Wqv(GP_VwZlf; zRN9{qQEphG=BWFtE+e8Ol+H%F7O@^q4nWUR<;h*7lv2SYnL1Q(DpJeNFL|kqWUHJF z(u&B^itOnRWU5nXBBDRkK^7)NL1X)qn7t1OjTA5aL&V}r&4%k+j9q0oy{`&xdQNOK z&>x!e*Pog{t!!^`W;DOPMm9a+6D*}JS6v_LWH-@=ub*Y%9L;QTeQH)be9|;oT-2AZ zL_G18YZQBIvuY&&rWvV`5ZjlYCq)Niy7aho5O`>{m`pK67u#HsO$fp|snvU;SSk_F z-m?5hK9hwa1f>oJ&hYXL)yiqI8+49b<+e>3+h%-*9D>@Fg}Mxzh-8R7>ctD%x%fri zFgd#{izvT-#$VI<+Qr|HzAg#4JMjY-dcJajB^0~jA6j7Y+Dt&qK=L%Ch$VeDGhDv( zme&pXlm|qyC4exxkyM}FxGnHNI&clJ*qQ~zz~U;_9%}4T(_j13QBhUAMDr<;ynWoQ z7JE0pk+{l+PNgem;hNUjoVbw{N}z$?wph$)aWKX`01Z(RB-(G4wzl+8Q?)vcMzwMfQZ(I^t{&_Phk3e=0Ww zrrOf!yn(Ol;Ct9D6%F6_u>%8@k-EmtF)HGH`Fejk`bV+w^m@2r`M%)OoIRadiXR;4 z0hs&YF;36?3R_s<_xPM^ILj&;i@T4jAr6hiq)tI(1O#MUKeiosv1U!ZheXB!UiSJb z5LgAD^XE{PFgzV=*Tp%iECGOQhHY7loM4aHuO{F1uV7%tT_7HAo$f$#;m~?u1R>=6 zWG}~<~3>EyW4Y@Jy%6bcVQDnua#T&-?#gJzdx_HoIIW0PMSX-EncrL zT{*LR>;XL9fV-Qi2a)%QwT6?umV>9q+Yi^Q`@{H!4Q^kVJG02uXnTN6Y|`(Y-It`Z zU|`HS%BIq&0XH|FzzD#qN>iA3$Q^;B&&L|);V?oCKhtAS3@S^p0T3)ROf3^5eTeG0 z(0f_m-TT$decJt#=CG+_pE zHn{e|Z<}9#67jioLgVUwL}5K`A#Ngw?FfKk#+IruFo`;U5(daPnNv$&BAPt+O!p+_ zqp%?K_)ofvdO`SPgd%N);v|$@q?^8Q0*b(<2*jokrIQ#Gu^K6pM=@&z67FaS6%jV8 zK0)NrX`~`<&Hmx{0G@`$2%9L>$2j#Dqb9DL9)W@ak61&>9n$wYy&|HMuxLFYkf5lv zQ3a8=YCqV`CIClOcOF4e0ou#m*BGO$826F5oNXSLb`CyW+s6CM26=v5x}C5$GVfFU zOsm<6C8d}08G=E@gCnKp%H%%jXzsn}TMpx!3&ewd8)S;deIgjH0;4*#b9ZVe9z(HJ zSDxttPGo;{2qf+x*bhw5oyWWo6AJz0DqGpvU`n6Z7NDEscjv3Kp2;%=hDB6gnwvbhoj|jJ+KxBV+sqG8Oas)_kd0G_lXHlmJyVt7>0xKQO@G3C*wG$)|s2}#@In4(w9cglTe{K;QY@*|>w8Z%8$ zXXml=Z-MlAdoj`iY6CE(U9hBG3a-u_?$VE=xHt2PRNEjBhQsTM{;@_Tp(h7Im z`-X9zFLW`{C;lh`Vw*jO5-epkYWrMcds1qImnt{|{KyfjU1YS?m!ge0zjp3sNF#I0p!`QxIJRx6}e1LmAPl;VR{#i;{8R)*}0#cnQ-e25|mv51=j%%S-x2uWP?!+WV+0$=v_$U5LFz!u{Qs5JrqnxF%V>-u|lGq{9 z9g2YH2XHv?P@JH^Twu!A09LOy+OQbh#=@euhr(i3d_2mEWw!esTQnKJ9pN)QkJh22 zErmdoEHZ0azr;r@1Ic;C2hl6cL&9bkRM7#2E>5o5G$a-MZ$Fd4k z$LW0kVGoq&j-e@!8FLN=wkYjL3mK;Y`VC&`@pry|l|6eTT`6Wc$&c1Q^#RWmZI*H$ zI}pCh=I)ufE=kU+8yv;x%!U&zHK;2cnN5a z%sObNw)X1?RCaSNz0HJ}n}fCs#g2QN7+Zdy_|nY>gVX1$mI(-w)^E64g_L)5B2tH4 zE7R`9hqGcs<^{2B>Akv=PbHEVUFk^eq-qi!xDC*CB*Z(&nSI~5!syUO(mdo&62is& z=-~-~a;T=+OxgIrb&-DWsYkv8jk-oNX9=m+NQ;s~>OvXvcVN*~8mTIl`B;*nH&)@r zWxK%NPUy}fREzWmsHHknrmU%4YREB1syyV^t&Q}%2)6|Y!on1_^IpcN&P%3Oqz>pI z+)7nf{Z?~2JipFJrE#=F)60eZh3&RQE|fC?d7Q$uavZJ!Wl!XFu$8Vifu#kF^iCMW zE66f^E|#`LFY*^Yf^a!b7KOsHazt*_IykV#1hVbgw79tu_J&CvqQ9*{OVJwGa0 zo%2(DStx}5m?30NZca*#g56fttsWs+*<;ccmc_yY=cqKKfg8czBy+b`K80dV7IVSK zrCQoMc-*E}29D7!mQa%zmdT+zH8@xSh*6ZCVgQ3$(2JS<3a;f*xbmBWvqUqu(l@l) z-r?q?Ubgr|VLt49^z$AH`&xj{kH604lcDH#%)#gMN22~X^N#U}>Jxx2@p-p?A0J`gpBKW$4)2HZ-oHN24hN33-Fe>@ zzmM)NU2a?$u^#Lp>}NtTt`F7-2>90fcJOQmX}QEifunUq;S%a;Qm-=bUOQ6~2p9x> zxB0NX5UlmP14BMH8s;|iTpa+Dd%9TNBwSe1hTrsm30|BMVGu(>A+CvlL;y_u*Ll&? z6hRC3doP7~lMruVzWZCB@fz?inN1ZE3Rf~XzT@4={Mwl=VNz)u;R0qSGP-va}x7I;!lVI)UV%piO6Vum5}AV&tO1Dw9C7&G8TPIN&p zzE&8L%psHdOjg-2|2;GEof;#0ilEW>KYKS@LCd@s-cVO&b~EMQH`PhRy=ffG-S#;+ zt@e1euk>K~W#H1uUR3nG8^Q>~6qu%h#>$E_=CAz<-$xrL5yCAy7k^qAzaX_R%M4;@WHcezjdn9ZJHhP= zwEEq4Q(-*(0XhNNv7tAJqpv*!n{zJ@0_pxU2XkXbw}-=`gB#>Vz6|ju5*ko(Amc-K z@q}LsyB@sd1L*P{@5DZAyQN`O%N@csP!Ew4P~Iw40ofo3Btsv=4hmUL>glk{e~ zGU$2|oHa$#aG*eH7iC)9#r8p48c@DG@jF-@Lkz|ofRmV7?S2q9=kz_+3w2JsMXL}R zY0!Kl%em(Dd3`D!hcN&K)zXFxk=C0eZO;a&nC(#&5-q z_ZNNE)AnKBdw*6AHp8#OXfs=V_5`#vL8zkN z?u5U75nz$=kC$E!Y!SPoc7}u1h7Oo}AZO^LJ`mo5h+SOsk1u)u-Ke`!1kv#_=P8f& z6y%1Wy9uOizKP4oMVTI~h}MnEy8+S9Xd;pGv0rg`RUI1&S6!liiat(Z5>gnlX_ zA8`Iuk%jCd?Y0~+4;?Hyx^g65cb-z)*%?d<1Zd*>hjwFp&kzKATK4B*OCPcCAzhfubx!;f(mjQm;LX~$rECEh?( z3GM8bL=qP9SF%GCm6|{_Q#%wKRH7rH$y6&Ab@!k=?afP!kh=2nlURNvWMQ(2(zitR zDcO;iqRtvPmEmGAh)+O4C}o^Gpr|b(6((#vP%*!dLWnUr{4;A^j#>*rA~U1_AtHsB z0SSkX-`MCHSJpT<%Q(B36IzFisZGdEDb$z*uT83IV}{Are*>{rhgaf)I!v+LRo3C$ z?}@o&oulP$@!2^j30n$vtsJ4-(0L=@EjY91k>p>kc}b4|O$|0FRw!XjN8ZN+IVyw~PB12IA~3YA`MTw=)GoRz zS$J;Y4fQr8OSaiwRns~*H#wib)om(&t;0#L`xa3pAHK#~=Kf3n)ibvz3^laI)}@$O zv9iZ|v%c{+S=T+Gqx4>)!`FqK6Yx*`;2Fp6+`kOEHb#k0>Uy;THt`Y#P)cLjprJa%fbDj?wd^s&p|jC1vXiwnwLfj6CedMTJINFQ-;n>C3*>G1ix@Mguov~u-b zh`F-h7Yez?E6#~TkNJvP>Bj44F5bHA^X)Bo1J%MoARlch@7Bc#&im9utKrPG=G+6J z9ikd+P?&v;IqT5i5N~iEJNpk>Hp;VgZ%g21Vog`8a#;R~SS>#@$V8jlNdbdF4}qM( z@155Zm?L_}F!iJb=o>a%rKvCtnZgh)Z2nE}r}Tfy;HM0K%IK$zf6Am~{>@b9SK8bK z!vBW%*tVELwiqCrp+f@-ynM!QMRI%yJp~fR_e7Q*aL>IlPd%I_v#ED^*+(+;CTIM( z-v60A4Xi~5`8xiVfuL-@pnDb+tB4TO%w@7b(=YzgOMy@UPZO~S*2QH(X2x>Jz`XJw zu`@7As=4Z<2Sb)9KiCYI$yfk{nVu15u0U=RFpKj@ zMrXl7x>JRxYidvvGg`xWmoOz?B3&(5i}PlGZ2E*YuN(1-fcio!*)1$`dWA-P=DH)N zJnD-6d}*StrWg?i+sGqbB-gv?Bd5lrZYv zqu;$+W}29!*;D}dHgA+gMmJPQV5a~?x(Nj|EQDAjvFZns=j<=8BsD`0)f3@ifEJKJ z9T-S-h|kr2lrH%ffJ8_nY-N+<*6n&jKTEgupQPRXZ=U%&H`eVQQ@o9{Rr;7Kl&f7G zR0PBpM@iR>CN}sRCekvgq|#2m5{#%|AQ@|zwQ$=iQw{)!Bb5}7tXf@=*q!>7@bqNo zo)HveM=QP)$b&jFV59FgPO-kCoG={9bItiOIr=Xdez1AachF$i;t(fHGNY3NRLVI zD8P3+DMt7=pXL7}>_32_c)s{ibQf51&LCk)l9S}T3n+->oU=%f3=#x}D2U`NNf42o z1SG=}6p)-HgJe)ZqU1Y#fB(Ag-COnQRc)W@={Y^qGt;Nf>2p5Yy-`_PJ@v}IBXbt2 zmSVWyUrX#q`$MHEDgfKN0|Y0RK5zfvs7EsN%m?G?*@c#?g|l@+C*Sgf+u^aCdACJ# z`q+*wdE@|{9hhE#$sSA&U~&YL6PR9t$+=;G&V}MQ{cjocAuwce=V~HGc-IC*1YbS( zL7cEglNNRhSXxxJ5YSZGi>>TO=egy~OqtMP#p!sR&n!nK9slmx+1!-yG_K44aKW1N zv5$!Jn-X8A_}bs(SfYIGF-?_Jl{aQr`l?4TU9Y9}1l4t7wX{pNc8>P8OtrU{jwiOQ z+$R{UA#drX(g8sn9D_%+BZV^G9?0h>SqHq;?tj@wVbE`l4eT}!Yev;1y^QkAB4AdE zmdw(C>r`sMqJ1r%;-^{Xpp9#D{Sk3hme<3Z&`Fcz3u#z?5}KdFMfjMk80RUDZ3=s- zzbKO~+2cMcGy|rv3{;`|U}yL`*HhT1NfL0P-YDsESPi%*GbLDAsL|Gt4i4Fc5ELco ziDhK7=^d{U@D-N!4=YmbTK-0EN}{oLGS|&ko3>YSs5<0X=BgzTr1oDP9eBz=pr(9O-MaLPUC!^7-NWp*dDHihJxsskuqx|RM_GnnYE_E`D z$BU4=Gv(#OWa~#fCAQxoC6~ggkS_$>)cI~}Z2tm0NqHQsEZD>L*+kq0A19WplfsrI zw#tSuk|hmG)X|>sWDk=*y7gHwW!_s_{jB@iJd>3g+-T4-bUJ5^lsjkgF1s$Uh`H%^ zS|I2`~Yjm8V^g9tu&evNT@S0&=+-${_elgJEn7<9aRIm z0CTMA3Of2^3+}U_XKF>TX6b|5n-6!)Cp1V=$qq>=sirJ+CX}6GEpgsM?OnohM;zN7 z0{w|V8M!Qeb5n#@LElQ#POe&-=H`Ot)xUV60apti_JO5;XDd6`0dJq?ViM3qwMq`? z#EOlL?V?jMY1%VZ*9$vtNAkCC=kjh&08}?e&(D8n6)nc!L~itd?~={BUQmGlJPPnL zB75~<%@2_1Fjl=9&?B9BA$L+#+i!48*)~>zGGNb5w^aV;b zRk)hu#6^&Tugg&Ep>`oT+8?+`Vl`){mc#861C!!^gWh7p`nxXiL2Lnng+_R-2S_WS zQ>?w%vw+Y24!m>31u_SRuO3h7#Kp
    DenseAxisArray{T}(undef, axes...) where T

    Construct an uninitialized DenseAxisArray with element-type T indexed over the given axes.

    Example

    julia> array = Containers.DenseAxisArray{Float64}(undef, [:a, :b], 1:2);
    +4
    source
    DenseAxisArray{T}(undef, axes...) where T

    Construct an uninitialized DenseAxisArray with element-type T indexed over the given axes.

    Example

    julia> array = Containers.DenseAxisArray{Float64}(undef, [:a, :b], 1:2);
     
     julia> fill!(array, 1.0)
     2-dimensional DenseAxisArray{Float64,2,...} with index sets:
    @@ -34,7 +34,7 @@
         Dimension 2, 1:2
     And data, a 2×2 Matrix{Float64}:
      1.0  5.0
    - 1.0  1.0
    source

    SparseAxisArray

    SparseAxisArray

    JuMP.Containers.SparseAxisArrayType
    struct SparseAxisArray{T,N,K<:NTuple{N, Any}} <: AbstractArray{T,N}
         data::OrderedCollections.OrderedDict{K,T}
     end

    N-dimensional array with elements of type T where only a subset of the entries are defined. The entries with indices idx = (i1, i2, ..., iN) in keys(data) has value data[idx].

    Note that, as opposed to SparseArrays.AbstractSparseArray, the missing entries are not assumed to be zero(T), they are simply not part of the array. This means that the result of map(f, sa::SparseAxisArray) or f.(sa::SparseAxisArray) has the same sparsity structure as sa, even if f(zero(T)) is not zero.

    Example

    julia> using OrderedCollections: OrderedDict
     
    @@ -51,7 +51,7 @@
       [b, 3]  =  3.0
     
     julia> array[:b, 3]
    -3.0
    source

    Containers.@container

    JuMP.Containers.@containerMacro
    @container([i=..., j=..., ...], expr[, container = :Auto])

    Create a container with indices i, j, ... and values given by expr that may depend on the value of the indices.

    @container(ref[i=..., j=..., ...], expr[, container = :Auto])

    Same as above but the container is assigned to the variable of name ref.

    The type of container can be controlled by the container keyword.

    Note

    When the index set is explicitly given as 1:n for any expression n, it is transformed to Base.OneTo(n) before being given to container.

    Example

    julia> Containers.@container([i = 1:3, j = 1:3], i + j)
    +3.0
    source

    Containers.@container

    JuMP.Containers.@containerMacro
    @container([i=..., j=..., ...], expr[, container = :Auto])

    Create a container with indices i, j, ... and values given by expr that may depend on the value of the indices.

    @container(ref[i=..., j=..., ...], expr[, container = :Auto])

    Same as above but the container is assigned to the variable of name ref.

    The type of container can be controlled by the container keyword.

    Note

    When the index set is explicitly given as 1:n for any expression n, it is transformed to Base.OneTo(n) before being given to container.

    Example

    julia> Containers.@container([i = 1:3, j = 1:3], i + j)
     3×3 Matrix{Int64}:
      2  3  4
      3  4  5
    @@ -86,7 +86,7 @@
       [1, 3]  =  4
       [2, 2]  =  4
       [2, 3]  =  5
    -  [3, 3]  =  6
    source

    Containers.container

    JuMP.Containers.containerFunction
    container(f::Function, indices[[, ::Type{C} = AutoContainerType], names])

    Create a container of type C with index names names, indices indices and values at given indices given by f.

    If the method with names is not specialized on Type{C}, it falls back to calling container(f, indices, c) for backwards compatibility with containers not supporting index names.

    Example

    julia> Containers.container((i, j) -> i + j, Containers.vectorized_product(Base.OneTo(3), Base.OneTo(3)))
    +  [3, 3]  =  6
    source

    Containers.container

    JuMP.Containers.containerFunction
    container(f::Function, indices[[, ::Type{C} = AutoContainerType], names])

    Create a container of type C with index names names, indices indices and values at given indices given by f.

    If the method with names is not specialized on Type{C}, it falls back to calling container(f, indices, c) for backwards compatibility with containers not supporting index names.

    Example

    julia> Containers.container((i, j) -> i + j, Containers.vectorized_product(Base.OneTo(3), Base.OneTo(3)))
     3×3 Matrix{Int64}:
      2  3  4
      3  4  5
    @@ -115,7 +115,7 @@
       [1, 2]  =  3
       [1, 3]  =  4
       [2, 3]  =  5
    -  [3, 3]  =  6
    source

    Containers.rowtable

    JuMP.Containers.rowtableFunction
    rowtable([f::Function=identity,] x; [header::Vector{Symbol} = Symbol[]])

    Applies the function f to all elements of the variable container x, returning the result as a Vector of NamedTuples, where header is a vector containing the corresponding axis names.

    If x is an N-dimensional array, there must be N+1 names, so that the last name corresponds to the result of f(x[i]).

    If header is left empty, then the default header is [:x1, :x2, ..., :xN, :y].

    Info

    A Vector of NamedTuples implements the Tables.jl interface, and so the result can be used as input for any function that consumes a 'Tables.jl' compatible source.

    Example

    julia> model = Model();
    +  [3, 3]  =  6
    source

    Containers.rowtable

    JuMP.Containers.rowtableFunction
    rowtable([f::Function=identity,] x; [header::Vector{Symbol} = Symbol[]])

    Applies the function f to all elements of the variable container x, returning the result as a Vector of NamedTuples, where header is a vector containing the corresponding axis names.

    If x is an N-dimensional array, there must be N+1 names, so that the last name corresponds to the result of f(x[i]).

    If header is left empty, then the default header is [:x1, :x2, ..., :xN, :y].

    Info

    A Vector of NamedTuples implements the Tables.jl interface, and so the result can be used as input for any function that consumes a 'Tables.jl' compatible source.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[i=1:2, j=i:2] >= 0, start = i+j);
     
    @@ -129,7 +129,7 @@
     3-element Vector{@NamedTuple{x1::Int64, x2::Int64, y::VariableRef}}:
      (x1 = 1, x2 = 1, y = x[1,1])
      (x1 = 1, x2 = 2, y = x[1,2])
    - (x1 = 2, x2 = 2, y = x[2,2])
    source

    Containers.default_container

    Containers.nested

    Containers.default_container

    Containers.nested

    JuMP.Containers.nestedFunction
    nested(iterators...; condition = (args...) -> true)

    Create a NestedIterator.

    Example

    julia> iterator = Containers.nested(
                () -> 1:2,
                (i,) -> ["A", "B"];
                condition = (i, j) -> isodd(i) || j == "B",
    @@ -139,21 +139,21 @@
     3-element Vector{Tuple{Int64, String}}:
      (1, "A")
      (1, "B")
    - (2, "B")
    source

    Containers.vectorized_product

    Containers.vectorized_product

    Containers.build_error_fn

    JuMP.Containers.build_error_fnFunction
    build_error_fn(macro_name, args, source)

    Return a function that can be used in place of Base.error, but which additionally prints the macro from which it was called.

    source

    Containers.parse_macro_arguments

    Containers.build_error_fn

    JuMP.Containers.build_error_fnFunction
    build_error_fn(macro_name, args, source)

    Return a function that can be used in place of Base.error, but which additionally prints the macro from which it was called.

    source

    Containers.parse_macro_arguments

    JuMP.Containers.parse_macro_argumentsFunction
    parse_macro_arguments(
         error_fn::Function,
         args;
         valid_kwargs::Union{Nothing,Vector{Symbol}} = nothing,
         num_positional_args::Union{Nothing,Int,UnitRange{Int}} = nothing,
    -)

    Returns a Tuple{Vector{Any},Dict{Symbol,Any}} containing the ordered positional arguments and a dictionary mapping the keyword arguments.

    This specially handles the distinction of @foo(key = value) and @foo(; key = value) in macros.

    An error is thrown if multiple keyword arguments are passed with the same key.

    If valid_kwargs is a Vector{Symbol}, an error is thrown if a keyword is not in valid_kwargs.

    If num_positional_args is not nothing, an error is thrown if the number of positional arguments is not in num_positional_args.

    source

    Containers.parse_ref_sets

    JuMP.Containers.parse_ref_setsFunction
    parse_ref_sets(
    +)

    Returns a Tuple{Vector{Any},Dict{Symbol,Any}} containing the ordered positional arguments and a dictionary mapping the keyword arguments.

    This specially handles the distinction of @foo(key = value) and @foo(; key = value) in macros.

    An error is thrown if multiple keyword arguments are passed with the same key.

    If valid_kwargs is a Vector{Symbol}, an error is thrown if a keyword is not in valid_kwargs.

    If num_positional_args is not nothing, an error is thrown if the number of positional arguments is not in num_positional_args.

    source

    Containers.parse_ref_sets

    JuMP.Containers.parse_ref_setsFunction
    parse_ref_sets(
         error_fn::Function,
         expr;
         invalid_index_variables::Vector{Symbol} = Symbol[],
    -)

    Helper function for macros to construct container objects.

    Warning

    This function is for advanced users implementing JuMP extensions. See container_code for more details.

    Arguments

    • error_fn: a function that takes a String and throws an error, potentially annotating the input string with extra information such as from which macro it was thrown from. Use error if you do not want a modified error message.
    • expr: an Expr that specifies the container, for example, :(x[i = 1:3, [:red, :blue], k = S; i + k <= 6])

    Returns

    1. name: the name of the container, if given, otherwise nothing
    2. index_vars: a Vector{Any} of names for the index variables, for example, [:i, gensym(), :k]. These may also be expressions, like :((i, j)) from a call like :(x[(i, j) in S]).
    3. indices: an iterator over the indices, for example, Containers.NestedIterator

    Example

    See container_code for a worked example.

    source

    Containers.build_name_expr

    JuMP.Containers.build_name_exprFunction
    build_name_expr(
    +)

    Helper function for macros to construct container objects.

    Warning

    This function is for advanced users implementing JuMP extensions. See container_code for more details.

    Arguments

    • error_fn: a function that takes a String and throws an error, potentially annotating the input string with extra information such as from which macro it was thrown from. Use error if you do not want a modified error message.
    • expr: an Expr that specifies the container, for example, :(x[i = 1:3, [:red, :blue], k = S; i + k <= 6])

    Returns

    1. name: the name of the container, if given, otherwise nothing
    2. index_vars: a Vector{Any} of names for the index variables, for example, [:i, gensym(), :k]. These may also be expressions, like :((i, j)) from a call like :(x[(i, j) in S]).
    3. indices: an iterator over the indices, for example, Containers.NestedIterator

    Example

    See container_code for a worked example.

    source

    Containers.build_name_expr

    JuMP.Containers.build_name_exprFunction
    build_name_expr(
         name::Union{Symbol,Nothing},
         index_vars::Vector,
         kwargs::Dict{Symbol,Any},
    @@ -164,12 +164,12 @@
     ""
     
     julia> Containers.build_name_expr(:y, [:i, :j], Dict{Symbol,Any}(:base_name => "y"))
    -:(string("y", "[", string($(Expr(:escape, :i))), ",", string($(Expr(:escape, :j))), "]"))
    source

    Containers.add_additional_args

    Containers.add_additional_args

    JuMP.Containers.add_additional_argsFunction
    add_additional_args(
         call::Expr,
         args::Vector,
         kwargs::Dict{Symbol,Any};
         kwarg_exclude::Vector{Symbol} = Symbol[],
    -)

    Add the positional arguments args to the function call expression call, escaping each argument expression.

    This function is able to incorporate additional positional arguments to calls that already have keyword arguments.

    source

    Containers.container_code

    JuMP.Containers.container_codeFunction
    container_code(
    +)

    Add the positional arguments args to the function call expression call, escaping each argument expression.

    This function is able to incorporate additional positional arguments to calls that already have keyword arguments.

    source

    Containers.container_code

    JuMP.Containers.container_codeFunction
    container_code(
         index_vars::Vector{Any},
         indices::Expr,
         code,
    @@ -194,7 +194,7 @@
         Dimension 2, ["A", "B"]
     And data, a 2×2 Matrix{String}:
      "A"   "B"
    - "AA"  "BB"
    source

    Containers.AutoContainerType

    Containers.NestedIterator

    Containers.AutoContainerType

    Containers.NestedIterator

    JuMP.Containers.NestedIteratorType
    struct NestedIterator{T}
         iterators::T # Tuple of functions
         condition::Function
     end

    Iterators over the tuples that are produced by a nested for loop.

    Construct a NestedIterator using nested.

    Example

    julia> iterators = (() -> 1:2, (i,) -> ["A", "B"]);
    @@ -217,6 +217,6 @@
            end
     (1, "A")
     (1, "B")
    -(2, "B")
    source

    Containers.VectorizedProductIterator

    Containers.VectorizedProductIterator

    +end

    A wrapper type for Iterators.ProuctIterator that discards shape information and returns a Vector.

    Construct a VectorizedProductIterator using vectorized_product.

    source diff --git a/previews/PR3913/api/JuMP/index.html b/previews/PR3913/api/JuMP/index.html index 1210c03393a..31b7fdb6d22 100644 --- a/previews/PR3913/api/JuMP/index.html +++ b/previews/PR3913/api/JuMP/index.html @@ -15,7 +15,7 @@ julia> @build_constraint(x .>= 0) 2-element Vector{ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}}: ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}(x[1], MathOptInterface.GreaterThan{Float64}(-0.0)) - ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}(x[2], MathOptInterface.GreaterThan{Float64}(-0.0))source

    @constraint

    JuMP.@constraintMacro
    @constraint(model, expr, args...; kwargs...)
    + ScalarConstraint{AffExpr, MathOptInterface.GreaterThan{Float64}}(x[2], MathOptInterface.GreaterThan{Float64}(-0.0))
    source

    @constraint

    JuMP.@constraintMacro
    @constraint(model, expr, args...; kwargs...)
     @constraint(model, [index_sets...], expr, args...; kwargs...)
     @constraint(model, name, expr, args...; kwargs...)
     @constraint(model, name[index_sets...], expr, args...; kwargs...)

    Add a constraint described by the expression expr.

    The name argument is optional. If index sets are passed, a container is built and the constraint may depend on the indices of the index sets.

    The expression expr may be one of following forms:

    • func in set, constraining the function func to belong to the set set, which is either a MOI.AbstractSet or one of the JuMP shortcuts like SecondOrderCone or PSDCone

    • a <op> b, where <op> is one of ==, , >=, , <=

    • l <= f <= u or u >= f >= l, constraining the expression f to lie between l and u

    • f(x) ⟂ x, which defines a complementarity constraint

    • z --> {expr}, which defines an indicator constraint that activates when z is 1

    • !z --> {expr}, which defines an indicator constraint that activates when z is 0

    • z <--> {expr}, which defines a reified constraint

    • expr := rhs, which defines a Boolean equality constraint

    Broadcasted comparison operators like .== are also supported for the case when the left- and right-hand sides of the comparison operator are arrays.

    JuMP extensions may additionally provide support for constraint expressions which are not listed here.

    Keyword arguments

    • base_name: sets the name prefix used to generate constraint names. It corresponds to the constraint name for scalar constraints, otherwise, the constraint names are set to base_name[...] for each index ....

    • container = :Auto: force the container type by passing container = Array,

    container = DenseAxisArray, container = SparseAxisArray, or any another container type which is supported by a JuMP extension.

    • set_string_name::Bool = true: control whether to set the MOI.ConstraintName attribute. Passing set_string_name = false can improve performance.

    Other keyword arguments may be supported by JuMP extensions.

    Example

    julia> model = Model();
    @@ -52,7 +52,7 @@
     z --> {x[1] ≥ 0}
     
     julia> @constraint(model, !z --> {2 * x[2] <= 3})
    -!z --> {2 x[2] ≤ 3}
    source

    @constraints

    JuMP.@constraintsMacro
    @constraints(model, args...)

    Adds groups of constraints at once, in the same fashion as the @constraint macro.

    The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the constraints that were defined.

    Example

    julia> model = Model();
    +!z --> {2 x[2] ≤ 3}
    source

    @constraints

    JuMP.@constraintsMacro
    @constraints(model, args...)

    Adds groups of constraints at once, in the same fashion as the @constraint macro.

    The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the constraints that were defined.

    Example

    julia> model = Model();
     
     julia> @variable(model, w);
     
    @@ -75,7 +75,7 @@
      sum_to_one[2] : y + z[2] = 1
      sum_to_one[3] : y + z[3] = 1
      x ≥ 1
    - -w + y ≤ 2
    source

    @expression

    @expression

    JuMP.@expressionMacro
    @expression(model::GenericModel, expression)
     @expression(model::GenericModel, [index_sets...], expression)
     @expression(model::GenericModel, name, expression)
     @expression(model::GenericModel, name[index_sets...], expression)

    Efficiently builds and returns an expression.

    The name argument is optional. If index sets are passed, a container is built and the expression may depend on the indices of the index sets.

    Keyword arguments

    • container = :Auto: force the container type by passing container = Array, container = DenseAxisArray, container = SparseAxisArray, or any another container type which is supported by a JuMP extension.

    Example

    julia> model = Model();
    @@ -102,7 +102,7 @@
     3-element Vector{AffExpr}:
      x[1] + x[2] + x[3]
      2 x[1] + 2 x[2] + 2 x[3]
    - 3 x[1] + 3 x[2] + 3 x[3]
    source

    @expressions

    JuMP.@expressionsMacro
    @expressions(model, args...)

    Adds multiple expressions to model at once, in the same fashion as the @expression macro.

    The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the expressions that were defined.

    Example

    julia> model = Model();
    + 3 x[1] + 3 x[2] + 3 x[3]
    source

    @expressions

    JuMP.@expressionsMacro
    @expressions(model, args...)

    Adds multiple expressions to model at once, in the same fashion as the @expression macro.

    The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the expressions that were defined.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -116,7 +116,7 @@
                my_expr, x^2 + y^2
                my_expr_1[i = 1:2], a[i] - z[i]
            end)
    -(x² + y², AffExpr[-z[1] + 4, -z[2] + 5])
    source

    @force_nonlinear

    JuMP.@force_nonlinearMacro
    @force_nonlinear(expr)

    Change the parsing of expr to construct GenericNonlinearExpr instead of GenericAffExpr or GenericQuadExpr.

    This macro works by walking expr and substituting all calls to +, -, *, /, and ^ in favor of ones that construct GenericNonlinearExpr.

    This macro will error if the resulting expression does not produce a GenericNonlinearExpr because, for example, it is used on an expression that does not use the basic arithmetic operators.

    When to use this macro

    In most cases, you should not use this macro.

    Use this macro only if the intended output type is a GenericNonlinearExpr and the regular macro calls destroy problem structure, or in rare cases, if the regular macro calls introduce a large amount of intermediate variables, for example, because they promote types to a common quadratic expression.

    Example

    Use-case one: preserve problem structure.

    julia> model = Model();
    +(x² + y², AffExpr[-z[1] + 4, -z[2] + 5])
    source

    @force_nonlinear

    JuMP.@force_nonlinearMacro
    @force_nonlinear(expr)

    Change the parsing of expr to construct GenericNonlinearExpr instead of GenericAffExpr or GenericQuadExpr.

    This macro works by walking expr and substituting all calls to +, -, *, /, and ^ in favor of ones that construct GenericNonlinearExpr.

    This macro will error if the resulting expression does not produce a GenericNonlinearExpr because, for example, it is used on an expression that does not use the basic arithmetic operators.

    When to use this macro

    In most cases, you should not use this macro.

    Use this macro only if the intended output type is a GenericNonlinearExpr and the regular macro calls destroy problem structure, or in rare cases, if the regular macro calls introduce a large amount of intermediate variables, for example, because they promote types to a common quadratic expression.

    Example

    Use-case one: preserve problem structure.

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -144,7 +144,7 @@
     2576
     
     julia> @allocated @expression(model, @force_nonlinear(x * 2.0 * (1 + x) * x))
    -672
    source

    @objective

    JuMP.@objectiveMacro
    @objective(model::GenericModel, sense, func)

    Set the objective sense to sense and objective function to func.

    The objective sense can be either Min, Max, MOI.MIN_SENSE, MOI.MAX_SENSE or MOI.FEASIBILITY_SENSE. In order to set the sense programmatically, that is, when sense is a variable whose value is the sense, one of the three MOI.OptimizationSense values must be used.

    Example

    Minimize the value of the variable x, do:

    julia> model = Model();
    +672
    source

    @objective

    JuMP.@objectiveMacro
    @objective(model::GenericModel, sense, func)

    Set the objective sense to sense and objective function to func.

    The objective sense can be either Min, Max, MOI.MIN_SENSE, MOI.MAX_SENSE or MOI.FEASIBILITY_SENSE. In order to set the sense programmatically, that is, when sense is a variable whose value is the sense, one of the three MOI.OptimizationSense values must be used.

    Example

    Minimize the value of the variable x, do:

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -165,7 +165,7 @@
     MIN_SENSE::OptimizationSense = 0
     
     julia> @objective(model, sense, x^2 - 2x + 1)
    -x² - 2 x + 1
    source

    @operator

    JuMP.@operatorMacro
    @operator(model, operator, dim, f[, ∇f[, ∇²f]])

    Add the nonlinear operator operator in model with dim arguments, and create a new NonlinearOperator object called operator in the current scope.

    The function f evaluates the operator and must return a scalar.

    The optional function ∇f evaluates the first derivative, and the optional function ∇²f evaluates the second derivative.

    ∇²f may be provided only if ∇f is also provided.

    Univariate syntax

    If dim == 1, then the method signatures of each function must be:

    • f(::T)::T where {T<:Real}
    • ∇f(::T)::T where {T<:Real}
    • ∇²f(::T)::T where {T<:Real}

    Multivariate syntax

    If dim > 1, then the method signatures of each function must be:

    • f(x::T...)::T where {T<:Real}
    • ∇f(g::AbstractVector{T}, x::T...)::Nothing where {T<:Real}
    • ∇²f(H::AbstractMatrix{T}, x::T...)::Nothing where {T<:Real}

    Where the gradient vector g and Hessian matrix H are filled in-place. For the Hessian, you must fill in the non-zero lower-triangular entries only. Setting an off-diagonal upper-triangular element may error.

    Example

    julia> model = Model();
    +x² - 2 x + 1
    source

    @operator

    JuMP.@operatorMacro
    @operator(model, operator, dim, f[, ∇f[, ∇²f]])

    Add the nonlinear operator operator in model with dim arguments, and create a new NonlinearOperator object called operator in the current scope.

    The function f evaluates the operator and must return a scalar.

    The optional function ∇f evaluates the first derivative, and the optional function ∇²f evaluates the second derivative.

    ∇²f may be provided only if ∇f is also provided.

    Univariate syntax

    If dim == 1, then the method signatures of each function must be:

    • f(::T)::T where {T<:Real}
    • ∇f(::T)::T where {T<:Real}
    • ∇²f(::T)::T where {T<:Real}

    Multivariate syntax

    If dim > 1, then the method signatures of each function must be:

    • f(x::T...)::T where {T<:Real}
    • ∇f(g::AbstractVector{T}, x::T...)::Nothing where {T<:Real}
    • ∇²f(H::AbstractMatrix{T}, x::T...)::Nothing where {T<:Real}

    Where the gradient vector g and Hessian matrix H are filled in-place. For the Hessian, you must fill in the non-zero lower-triangular entries only. Setting an off-diagonal upper-triangular element may error.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -204,7 +204,7 @@
     f (generic function with 1 method)
     
     julia> op_f = model[:op_f] = add_nonlinear_operator(model, 1, f; name = :op_f)
    -NonlinearOperator(f, :op_f)
    source

    @variable

    JuMP.@variableMacro
    @variable(model, expr, args..., kw_args...)

    Add a variable to the model model described by the expression expr, the positional arguments args and the keyword arguments kw_args.

    Anonymous and named variables

    expr must be one of the forms:

    • Omitted, like @variable(model), which creates an anonymous variable
    • A single symbol like @variable(model, x)
    • A container expression like @variable(model, x[i=1:3])
    • An anonymous container expression like @variable(model, [i=1:3])

    Bounds

    In addition, the expression can have bounds, such as:

    • @variable(model, x >= 0)
    • @variable(model, x <= 0)
    • @variable(model, x == 0)
    • @variable(model, 0 <= x <= 1)

    and bounds can depend on the indices of the container expressions:

    • @variable(model, -i <= x[i=1:3] <= i)

    Sets

    You can explicitly specify the set to which the variable belongs:

    • @variable(model, x in MOI.Interval(0.0, 1.0))

    For more information on this syntax, read Variables constrained on creation.

    Positional arguments

    The recognized positional arguments in args are the following:

    • Bin: restricts the variable to the MOI.ZeroOne set, that is, {0, 1}. For example, @variable(model, x, Bin). Note: you cannot use @variable(model, Bin), use the binary keyword instead.
    • Int: restricts the variable to the set of integers, that is, ..., -2, -1, 0, 1, 2, ... For example, @variable(model, x, Int). Note: you cannot use @variable(model, Int), use the integer keyword instead.
    • Symmetric: Only available when creating a square matrix of variables, that is when expr is of the form varname[1:n,1:n] or varname[i=1:n,j=1:n], it creates a symmetric matrix of variables.
    • PSD: A restrictive extension to Symmetric which constraints a square matrix of variables to Symmetric and constrains to be positive semidefinite.

    Keyword arguments

    Four keyword arguments are useful in all cases:

    • base_name: Sets the name prefix used to generate variable names. It corresponds to the variable name for scalar variable, otherwise, the variable names are set to base_name[...] for each index ... of the axes axes.
    • start::Float64: specify the value passed to set_start_value for each variable
    • container: specify the container type. See Forcing the container type for more information.
    • set_string_name::Bool = true: control whether to set the MOI.VariableName attribute. Passing set_string_name = false can improve performance.

    Other keyword arguments are needed to disambiguate sitations with anonymous variables:

    • lower_bound::Float64: an alternative to x >= lb, sets the value of the variable lower bound.
    • upper_bound::Float64: an alternative to x <= ub, sets the value of the variable upper bound.
    • binary::Bool: an alternative to passing Bin, sets whether the variable is binary or not.
    • integer::Bool: an alternative to passing Int, sets whether the variable is integer or not.
    • set::MOI.AbstractSet: an alternative to using x in set
    • variable_type: used by JuMP extensions. See Extend @variable for more information.

    Example

    The following are equivalent ways of creating a variable x of name x with lower bound 0:

    julia> model = Model();
    +NonlinearOperator(f, :op_f)
    source

    @variable

    JuMP.@variableMacro
    @variable(model, expr, args..., kw_args...)

    Add a variable to the model model described by the expression expr, the positional arguments args and the keyword arguments kw_args.

    Anonymous and named variables

    expr must be one of the forms:

    • Omitted, like @variable(model), which creates an anonymous variable
    • A single symbol like @variable(model, x)
    • A container expression like @variable(model, x[i=1:3])
    • An anonymous container expression like @variable(model, [i=1:3])

    Bounds

    In addition, the expression can have bounds, such as:

    • @variable(model, x >= 0)
    • @variable(model, x <= 0)
    • @variable(model, x == 0)
    • @variable(model, 0 <= x <= 1)

    and bounds can depend on the indices of the container expressions:

    • @variable(model, -i <= x[i=1:3] <= i)

    Sets

    You can explicitly specify the set to which the variable belongs:

    • @variable(model, x in MOI.Interval(0.0, 1.0))

    For more information on this syntax, read Variables constrained on creation.

    Positional arguments

    The recognized positional arguments in args are the following:

    • Bin: restricts the variable to the MOI.ZeroOne set, that is, {0, 1}. For example, @variable(model, x, Bin). Note: you cannot use @variable(model, Bin), use the binary keyword instead.
    • Int: restricts the variable to the set of integers, that is, ..., -2, -1, 0, 1, 2, ... For example, @variable(model, x, Int). Note: you cannot use @variable(model, Int), use the integer keyword instead.
    • Symmetric: Only available when creating a square matrix of variables, that is when expr is of the form varname[1:n,1:n] or varname[i=1:n,j=1:n], it creates a symmetric matrix of variables.
    • PSD: A restrictive extension to Symmetric which constraints a square matrix of variables to Symmetric and constrains to be positive semidefinite.

    Keyword arguments

    Four keyword arguments are useful in all cases:

    • base_name: Sets the name prefix used to generate variable names. It corresponds to the variable name for scalar variable, otherwise, the variable names are set to base_name[...] for each index ... of the axes axes.
    • start::Float64: specify the value passed to set_start_value for each variable
    • container: specify the container type. See Forcing the container type for more information.
    • set_string_name::Bool = true: control whether to set the MOI.VariableName attribute. Passing set_string_name = false can improve performance.

    Other keyword arguments are needed to disambiguate sitations with anonymous variables:

    • lower_bound::Float64: an alternative to x >= lb, sets the value of the variable lower bound.
    • upper_bound::Float64: an alternative to x <= ub, sets the value of the variable upper bound.
    • binary::Bool: an alternative to passing Bin, sets whether the variable is binary or not.
    • integer::Bool: an alternative to passing Int, sets whether the variable is integer or not.
    • set::MOI.AbstractSet: an alternative to using x in set
    • variable_type: used by JuMP extensions. See Extend @variable for more information.

    Example

    The following are equivalent ways of creating a variable x of name x with lower bound 0:

    julia> model = Model();
     
     julia> @variable(model, x >= 0)
     x
    julia> model = Model();
    @@ -233,14 +233,14 @@
     3-element Vector{VariableRef}:
      _[7]
      _[8]
    - _[9]
    source

    @variables

    JuMP.@variablesMacro
    @variables(model, args...)

    Adds multiple variables to model at once, in the same fashion as the @variable macro.

    The model must be the first argument, and multiple variables can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the variables that were defined.

    Example

    julia> model = Model();
    + _[9]
    source

    @variables

    JuMP.@variablesMacro
    @variables(model, args...)

    Adds multiple variables to model at once, in the same fashion as the @variable macro.

    The model must be the first argument, and multiple variables can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the variables that were defined.

    Example

    julia> model = Model();
     
     julia> @variables(model, begin
                x
                y[i = 1:2] >= 0, (start = i)
                z, Bin, (start = 0, base_name = "Z")
            end)
    -(x, VariableRef[y[1], y[2]], Z)
    Note

    Keyword arguments must be contained within parentheses (refer to the example above).

    source

    add_bridge

    JuMP.add_bridgeFunction
    add_bridge(
    +(x, VariableRef[y[1], y[2]], Z)
    Note

    Keyword arguments must be contained within parentheses (refer to the example above).

    source

    add_bridge

    JuMP.add_bridgeFunction
    add_bridge(
         model::GenericModel{T},
         BT::Type{<:MOI.Bridges.AbstractBridge};
         coefficient_type::Type{S} = T,
    @@ -252,11 +252,11 @@
                model,
                MOI.Bridges.Constraint.NumberConversionBridge;
                coefficient_type = Complex{Float64}
    -       )
    source

    add_constraint

    add_constraint

    JuMP.add_constraintFunction
    add_constraint(
         model::GenericModel,
         con::AbstractConstraint,
         name::String= "",
    -)

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    add_nonlinear_operator

    JuMP.add_nonlinear_operatorFunction
    add_nonlinear_operator(
    +)

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    add_nonlinear_operator

    add_to_expression!

    JuMP.add_to_expression!Function
    add_to_expression!(expression, terms...)

    Updates expression in-place to expression + (*)(terms...).

    This is typically much more efficient than expression += (*)(terms...) because it avoids the temorary allocation of the right-hand side term.

    For example, add_to_expression!(expression, a, b) produces the same result as expression += a*b, and add_to_expression!(expression, a) produces the same result as expression += a.

    When to implement

    Only a few methods are defined, mostly for internal use, and only for the cases when:

    1. they can be implemented efficiently
    2. expression is capable of storing the result. For example, add_to_expression!(::AffExpr, ::GenericVariableRef, ::GenericVariableRef) is not defined because a GenericAffExpr cannot store the product of two variables.

    Example

    julia> model = Model();
    +4.0
    source

    add_to_expression!

    JuMP.add_to_expression!Function
    add_to_expression!(expression, terms...)

    Updates expression in-place to expression + (*)(terms...).

    This is typically much more efficient than expression += (*)(terms...) because it avoids the temorary allocation of the right-hand side term.

    For example, add_to_expression!(expression, a, b) produces the same result as expression += a*b, and add_to_expression!(expression, a) produces the same result as expression += a.

    When to implement

    Only a few methods are defined, mostly for internal use, and only for the cases when:

    1. they can be implemented efficiently
    2. expression is capable of storing the result. For example, add_to_expression!(::AffExpr, ::GenericVariableRef, ::GenericVariableRef) is not defined because a GenericAffExpr cannot store the product of two variables.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -316,7 +316,7 @@
     3 x[1] + 3 x[2]
     
     julia> ex2
    -2 x[1] + 2 x[2]
    source

    add_to_function_constant

    JuMP.add_to_function_constantFunction
    add_to_function_constant(constraint::ConstraintRef, value)

    Add value to the function constant term of constraint.

    Note that for scalar constraints, JuMP will aggregate all constant terms onto the right-hand side of the constraint so instead of modifying the function, the set will be translated by -value. For example, given a constraint 2x <= 3, add_to_function_constant(c, 4) will modify it to 2x <= -1.

    Example

    For scalar constraints, the set is translated by -value:

    julia> model = Model();
    +2 x[1] + 2 x[2]
    source

    add_to_function_constant

    JuMP.add_to_function_constantFunction
    add_to_function_constant(constraint::ConstraintRef, value)

    Add value to the function constant term of constraint.

    Note that for scalar constraints, JuMP will aggregate all constant terms onto the right-hand side of the constraint so instead of modifying the function, the set will be translated by -value. For example, given a constraint 2x <= 3, add_to_function_constant(c, 4) will modify it to 2x <= -1.

    Example

    For scalar constraints, the set is translated by -value:

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -338,7 +338,7 @@
     julia> add_to_function_constant(con, [1, 2, 2])
     
     julia> con
    -con : [x + y + 1, x + 2, y + 2] ∈ MathOptInterface.SecondOrderCone(3)
    source

    add_variable

    JuMP.add_variableFunction
    add_variable(m::GenericModel, v::AbstractVariable, name::String = "")

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    all_constraints

    JuMP.all_constraintsFunction
    all_constraints(model::GenericModel, function_type, set_type)::Vector{<:ConstraintRef}

    Return a list of all constraints currently in the model where the function has type function_type and the set has type set_type. The constraints are ordered by creation time.

    See also list_of_constraint_types and num_constraints.

    Example

    julia> model = Model();
    +con : [x + y + 1, x + 2, y + 2] ∈ MathOptInterface.SecondOrderCone(3)
    source

    add_variable

    JuMP.add_variableFunction
    add_variable(m::GenericModel, v::AbstractVariable, name::String = "")

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    all_constraints

    JuMP.all_constraintsFunction
    all_constraints(model::GenericModel, function_type, set_type)::Vector{<:ConstraintRef}

    Return a list of all constraints currently in the model where the function has type function_type and the set has type set_type. The constraints are ordered by creation time.

    See also list_of_constraint_types and num_constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0, Bin);
     
    @@ -354,7 +354,7 @@
     
     julia> all_constraints(model, AffExpr, MOI.LessThan{Float64})
     1-element Vector{ConstraintRef{Model, MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.LessThan{Float64}}, ScalarShape}}:
    - 2 x ≤ 1
    source
    all_constraints(
    + 2 x ≤ 1
    source
    all_constraints(
         model::GenericModel;
         include_variable_in_set_constraints::Bool,
     )::Vector{ConstraintRef}

    Return a list of all constraints in model.

    If include_variable_in_set_constraints == true, then VariableRef constraints such as VariableRef-in-Integer are included. To return only the structural constraints (for example, the rows in the constraint matrix of a linear program), pass include_variable_in_set_constraints = false.

    Example

    julia> model = Model();
    @@ -375,7 +375,7 @@
     julia> all_constraints(model; include_variable_in_set_constraints = false)
     2-element Vector{ConstraintRef}:
      2 x ≤ 1
    - x ^ 2.0 - 1.0 ≤ 0

    Performance considerations

    Note that this function is type-unstable because it returns an abstractly typed vector. If performance is a problem, consider using list_of_constraint_types and a function barrier. See the Performance tips for extensions section of the documentation for more details.

    source

    all_variables

    JuMP.all_variablesFunction
    all_variables(model::GenericModel{T})::Vector{GenericVariableRef{T}} where {T}

    Returns a list of all variables currently in the model. The variables are ordered by creation time.

    Example

    julia> model = Model();
    + x ^ 2.0 - 1.0 ≤ 0

    Performance considerations

    Note that this function is type-unstable because it returns an abstractly typed vector. If performance is a problem, consider using list_of_constraint_types and a function barrier. See the Performance tips for extensions section of the documentation for more details.

    source

    all_variables

    JuMP.all_variablesFunction
    all_variables(model::GenericModel{T})::Vector{GenericVariableRef{T}} where {T}

    Returns a list of all variables currently in the model. The variables are ordered by creation time.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -384,12 +384,12 @@
     julia> all_variables(model)
     2-element Vector{VariableRef}:
      x
    - y
    source

    anonymous_name

    JuMP.anonymous_nameFunction
    anonymous_name(::MIME, x::AbstractVariableRef)

    The name to use for an anonymous variable x when printing.

    Example

    julia> model = Model();
    + y
    source

    anonymous_name

    JuMP.anonymous_nameFunction
    anonymous_name(::MIME, x::AbstractVariableRef)

    The name to use for an anonymous variable x when printing.

    Example

    julia> model = Model();
     
     julia> x = @variable(model);
     
     julia> anonymous_name(MIME("text/plain"), x)
    -"_[1]"
    source

    backend

    JuMP.backendFunction
    backend(model::GenericModel)

    Return the lower-level MathOptInterface model that sits underneath JuMP. This model depends on which operating mode JuMP is in (see mode).

    • If JuMP is in DIRECT mode (that is, the model was created using direct_model), the backend will be the optimizer passed to direct_model.
    • If JuMP is in MANUAL or AUTOMATIC mode, the backend is a MOI.Utilities.CachingOptimizer.

    Use index to get the index of a variable or constraint in the backend model.

    Warning

    This function should only be used by advanced users looking to access low-level MathOptInterface or solver-specific functionality.

    Notes

    If JuMP is not in DIRECT mode, the type returned by backend may change between any JuMP releases. Therefore, only use the public API exposed by MathOptInterface, and do not access internal fields. If you require access to the innermost optimizer, see unsafe_backend. Alternatively, use direct_model to create a JuMP model in DIRECT mode.

    See also: unsafe_backend.

    Example

    julia> import HiGHS
    +"_[1]"
    source

    backend

    JuMP.backendFunction
    backend(model::GenericModel)

    Return the lower-level MathOptInterface model that sits underneath JuMP. This model depends on which operating mode JuMP is in (see mode).

    • If JuMP is in DIRECT mode (that is, the model was created using direct_model), the backend will be the optimizer passed to direct_model.
    • If JuMP is in MANUAL or AUTOMATIC mode, the backend is a MOI.Utilities.CachingOptimizer.

    Use index to get the index of a variable or constraint in the backend model.

    Warning

    This function should only be used by advanced users looking to access low-level MathOptInterface or solver-specific functionality.

    Notes

    If JuMP is not in DIRECT mode, the type returned by backend may change between any JuMP releases. Therefore, only use the public API exposed by MathOptInterface, and do not access internal fields. If you require access to the innermost optimizer, see unsafe_backend. Alternatively, use direct_model to create a JuMP model in DIRECT mode.

    See also: unsafe_backend.

    Example

    julia> import HiGHS
     
     julia> model = direct_model(HiGHS.Optimizer());
     
    @@ -402,7 +402,7 @@
     A HiGHS model with 1 columns and 0 rows.
     
     julia> index(x)
    -MOI.VariableIndex(1)
    source

    barrier_iterations

    JuMP.barrier_iterationsFunction
    barrier_iterations(model::GenericModel)

    If available, returns the cumulative number of barrier iterations during the most-recent optimization (the MOI.BarrierIterations attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
    +MOI.VariableIndex(1)
    source

    barrier_iterations

    JuMP.barrier_iterationsFunction
    barrier_iterations(model::GenericModel)

    If available, returns the cumulative number of barrier iterations during the most-recent optimization (the MOI.BarrierIterations attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -411,7 +411,7 @@
     julia> optimize!(model)
     
     julia> barrier_iterations(model)
    -0
    source

    bridge_constraints

    JuMP.bridge_constraintsFunction
    bridge_constraints(model::GenericModel)

    When in direct mode, return false.

    When in manual or automatic mode, return a Bool indicating whether the optimizer is set and unsupported constraints are automatically bridged to equivalent supported constraints when an appropriate transformation is available.

    Example

    julia> import Ipopt
    +0
    source

    bridge_constraints

    JuMP.bridge_constraintsFunction
    bridge_constraints(model::GenericModel)

    When in direct mode, return false.

    When in manual or automatic mode, return a Bool indicating whether the optimizer is set and unsupported constraints are automatically bridged to equivalent supported constraints when an appropriate transformation is available.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -421,14 +421,14 @@
     julia> model = Model(Ipopt.Optimizer; add_bridges = false);
     
     julia> bridge_constraints(model)
    -false
    source

    build_constraint

    JuMP.build_constraintFunction
    build_constraint(error_fn::Function, func, set, args...; kwargs...)

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    build_variable

    build_constraint

    JuMP.build_constraintFunction
    build_constraint(error_fn::Function, func, set, args...; kwargs...)

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    build_variable

    JuMP.build_variableFunction
    build_variable(
         error_fn::Function,
         info::VariableInfo,
         args...;
         kwargs...,
     )

    Return a new AbstractVariable object.

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    Arguments

    • error_fn: a function to call instead of error. error_fn annotates the error message with additional information for the user.
    • info: an instance of VariableInfo. This has a variety of fields relating to the variable such as info.lower_bound and info.binary.
    • args: optional additional positional arguments for extending the @variable macro.
    • kwargs: optional keyword arguments for extending the @variable macro.

    See also: @variable

    Warning

    Extensions should define a method with ONE positional argument to dispatch the call to a different method. Creating an extension that relies on multiple positional arguments leads to MethodErrors if the user passes the arguments in the wrong order.

    Example

    @variable(model, x, Foo)

    will call

    build_variable(error_fn::Function, info::VariableInfo, ::Type{Foo})

    Passing special-case positional arguments such as Bin, Int, and PSD is okay, along with keyword arguments:

    @variable(model, x, Int, Foo(), mykwarg = true)
     # or
    -@variable(model, x, Foo(), Int, mykwarg = true)

    will call

    build_variable(error_fn::Function, info::VariableInfo, ::Foo; mykwarg)

    and info.integer will be true.

    Note that the order of the positional arguments does not matter.

    source

    callback_node_status

    JuMP.callback_node_statusFunction
    callback_node_status(cb_data, model::GenericModel)

    Return an MOI.CallbackNodeStatusCode enum, indicating if the current primal solution available from callback_value is integer feasible.

    Example

    julia> import Gurobi
    +@variable(model, x, Foo(), Int, mykwarg = true)

    will call

    build_variable(error_fn::Function, info::VariableInfo, ::Foo; mykwarg)

    and info.integer will be true.

    Note that the order of the positional arguments does not matter.

    source

    callback_node_status

    JuMP.callback_node_statusFunction
    callback_node_status(cb_data, model::GenericModel)

    Return an MOI.CallbackNodeStatusCode enum, indicating if the current primal solution available from callback_value is integer feasible.

    Example

    julia> import Gurobi
     
     julia> model = Model(Gurobi.Optimizer);
     Set parameter WLSAccessID
    @@ -455,7 +455,7 @@
     julia> set_attribute(model, Gurobi.CallbackFunction(), my_callback_function)
     
     julia> optimize!(model)
    -Status is: CALLBACK_NODE_STATUS_INTEGER
    source

    callback_value

    JuMP.callback_valueFunction
    callback_value(cb_data, x::GenericVariableRef)
    +Status is: CALLBACK_NODE_STATUS_INTEGER
    source

    callback_value

    JuMP.callback_valueFunction
    callback_value(cb_data, x::GenericVariableRef)
     callback_value(cb_data, x::Union{GenericAffExpr,GenericQuadExpr})

    Return the primal solution of x inside a callback.

    cb_data is the argument to the callback function, and the type is dependent on the solver.

    Use callback_node_status to check whether a solution is available.

    Example

    julia> import Gurobi
     
     julia> model = Model(Gurobi.Optimizer);
    @@ -484,7 +484,7 @@
     julia> set_attribute(model, Gurobi.CallbackFunction(), my_callback_function)
     
     julia> optimize!(model)
    -Solution is: 10.0
    source

    check_belongs_to_model

    check_belongs_to_model

    JuMP.check_belongs_to_modelFunction
    check_belongs_to_model(x::AbstractJuMPScalar, model::AbstractModel)
     check_belongs_to_model(x::AbstractConstraint, model::AbstractModel)

    Throw VariableNotOwned if the owner_model of x is not model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
    @@ -496,7 +496,7 @@
     julia> check_belongs_to_model(x, model_2)
     ERROR: VariableNotOwned{VariableRef}(x): the variable x cannot be used in this model because
     it belongs to a different model.
    -[...]
    source

    coefficient

    JuMP.coefficientFunction
    coefficient(v1::GenericVariableRef{T}, v2::GenericVariableRef{T}) where {T}

    Return one(T) if v1 == v2 and zero(T) otherwise.

    This is a fallback for other coefficient methods to simplify code in which the expression may be a single variable.

    Example

    julia> model = Model();
    +[...]
    source

    coefficient

    JuMP.coefficientFunction
    coefficient(v1::GenericVariableRef{T}, v2::GenericVariableRef{T}) where {T}

    Return one(T) if v1 == v2 and zero(T) otherwise.

    This is a fallback for other coefficient methods to simplify code in which the expression may be a single variable.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -504,14 +504,14 @@
     1.0
     
     julia> coefficient(x[1], x[2])
    -0.0
    source
    coefficient(a::GenericAffExpr{C,V}, v::V) where {C,V}

    Return the coefficient associated with variable v in the affine expression a.

    Example

    julia> model = Model();
    +0.0
    source
    coefficient(a::GenericAffExpr{C,V}, v::V) where {C,V}

    Return the coefficient associated with variable v in the affine expression a.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> expr = 2.0 * x + 1.0;
     
     julia> coefficient(expr, x)
    -2.0
    source
    coefficient(a::GenericQuadExpr{C,V}, v1::V, v2::V) where {C,V}

    Return the coefficient associated with the term v1 * v2 in the quadratic expression a.

    Note that coefficient(a, v1, v2) is the same as coefficient(a, v2, v1).

    Example

    julia> model = Model();
    +2.0
    source
    coefficient(a::GenericQuadExpr{C,V}, v1::V, v2::V) where {C,V}

    Return the coefficient associated with the term v1 * v2 in the quadratic expression a.

    Note that coefficient(a, v1, v2) is the same as coefficient(a, v2, v1).

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -524,14 +524,14 @@
     2.0
     
     julia> coefficient(expr, x[1], x[1])
    -0.0
    source
    coefficient(a::GenericQuadExpr{C,V}, v::V) where {C,V}

    Return the coefficient associated with variable v in the affine component of a.

    Example

    julia> model = Model();
    +0.0
    source
    coefficient(a::GenericQuadExpr{C,V}, v::V) where {C,V}

    Return the coefficient associated with variable v in the affine component of a.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> expr = 2.0 * x^2 + 3.0 * x;
     
     julia> coefficient(expr, x)
    -3.0
    source

    compute_conflict!

    JuMP.compute_conflict!Function
    compute_conflict!(model::GenericModel)

    Compute a conflict if the model is infeasible.

    The conflict is also called the Irreducible Infeasible Subsystem (IIS).

    If an optimizer has not been set yet (see set_optimizer), a NoOptimizer error is thrown.

    The status of the conflict can be checked with the MOI.ConflictStatus model attribute. Then, the status for each constraint can be queried with the MOI.ConstraintConflictStatus attribute.

    See also: copy_conflict

    Example

    julia> using JuMP
    +3.0
    source

    compute_conflict!

    JuMP.compute_conflict!Function
    compute_conflict!(model::GenericModel)

    Compute a conflict if the model is infeasible.

    The conflict is also called the Irreducible Infeasible Subsystem (IIS).

    If an optimizer has not been set yet (see set_optimizer), a NoOptimizer error is thrown.

    The status of the conflict can be checked with the MOI.ConflictStatus model attribute. Then, the status for each constraint can be queried with the MOI.ConstraintConflictStatus attribute.

    See also: copy_conflict

    Example

    julia> using JuMP
     
     julia> model = Model(Gurobi.Optimizer);
     
    @@ -548,21 +548,21 @@
     julia> compute_conflict!(model)
     
     julia> get_attribute(model, MOI.ConflictStatus())
    -CONFLICT_FOUND::ConflictStatusCode = 3
    source

    constant

    JuMP.constantFunction
    constant(aff::GenericAffExpr{C,V})::C

    Return the constant of the affine expression.

    Example

    julia> model = Model();
    +CONFLICT_FOUND::ConflictStatusCode = 3
    source

    constant

    JuMP.constantFunction
    constant(aff::GenericAffExpr{C,V})::C

    Return the constant of the affine expression.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> aff = 2.0 * x + 3.0;
     
     julia> constant(aff)
    -3.0
    source
    constant(quad::GenericQuadExpr{C,V})::C

    Return the constant of the quadratic expression.

    Example

    julia> model = Model();
    +3.0
    source
    constant(quad::GenericQuadExpr{C,V})::C

    Return the constant of the quadratic expression.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> quad = 2.0 * x^2 + 3.0;
     
     julia> constant(quad)
    -3.0
    source

    constraint_by_name

    JuMP.constraint_by_nameFunction
    constraint_by_name(model::AbstractModel, name::String, [F, S])::Union{ConstraintRef,Nothing}

    Return the reference of the constraint with name attribute name or Nothing if no constraint has this name attribute.

    Throws an error if several constraints have name as their name attribute.

    If F and S are provided, this method addititionally throws an error if the constraint is not an F-in-S contraint where F is either the JuMP or MOI type of the function and S is the MOI type of the set.

    Providing F and S is recommended if you know the type of the function and set since its returned type can be inferred while for the method above (that is, without F and S), the exact return type of the constraint index cannot be inferred.

    Example

    julia> model = Model();
    +3.0
    source

    constraint_by_name

    JuMP.constraint_by_nameFunction
    constraint_by_name(model::AbstractModel, name::String, [F, S])::Union{ConstraintRef,Nothing}

    Return the reference of the constraint with name attribute name or Nothing if no constraint has this name attribute.

    Throws an error if several constraints have name as their name attribute.

    If F and S are provided, this method addititionally throws an error if the constraint is not an F-in-S contraint where F is either the JuMP or MOI type of the function and S is the MOI type of the set.

    Providing F and S is recommended if you know the type of the function and set since its returned type can be inferred while for the method above (that is, without F and S), the exact return type of the constraint index cannot be inferred.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -578,7 +578,7 @@
     julia> constraint_by_name(model, "con", AffExpr, MOI.EqualTo{Float64})
     
     julia> constraint_by_name(model, "con", QuadExpr, MOI.EqualTo{Float64})
    -con : x² = 1
    source

    constraint_object

    JuMP.constraint_objectFunction
    constraint_object(con_ref::ConstraintRef)

    Return the underlying constraint data for the constraint referenced by con_ref.

    Example

    A scalar constraint:

    julia> model = Model();
    +con : x² = 1
    source

    constraint_object

    JuMP.constraint_objectFunction
    constraint_object(con_ref::ConstraintRef)

    Return the underlying constraint data for the constraint referenced by con_ref.

    Example

    A scalar constraint:

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -615,7 +615,7 @@
      x[3]
     
     julia> object.set
    -MathOptInterface.SecondOrderCone(3)
    source

    constraint_ref_with_index

    JuMP.constraint_ref_with_indexFunction
    constraint_ref_with_index(model::AbstractModel, index::MOI.ConstraintIndex)

    Return a ConstraintRef of model corresponding to index.

    This function is a helper function used internally by JuMP and some JuMP extensions. It should not need to be called in user-code.

    source

    constraint_string

    constraint_ref_with_index

    JuMP.constraint_ref_with_indexFunction
    constraint_ref_with_index(model::AbstractModel, index::MOI.ConstraintIndex)

    Return a ConstraintRef of model corresponding to index.

    This function is a helper function used internally by JuMP and some JuMP extensions. It should not need to be called in user-code.

    source

    constraint_string

    JuMP.constraint_stringFunction
    constraint_string(
         mode::MIME,
         ref::ConstraintRef;
         in_math_mode::Bool = false,
    @@ -626,7 +626,7 @@
     julia> @constraint(model, c, 2 * x <= 1);
     
     julia> constraint_string(MIME("text/plain"), c)
    -"c : 2 x ≤ 1"
    source

    constraints_string

    JuMP.constraints_stringFunction
    constraints_string(mode, model::AbstractModel)::Vector{String}

    Return a list of Strings describing each constraint of the model.

    Example

    julia> model = Model();
    +"c : 2 x ≤ 1"
    source

    constraints_string

    JuMP.constraints_stringFunction
    constraints_string(mode, model::AbstractModel)::Vector{String}

    Return a list of Strings describing each constraint of the model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0);
     
    @@ -635,7 +635,7 @@
     julia> constraints_string(MIME("text/plain"), model)
     2-element Vector{String}:
      "c : 2 x ≤ 1"
    - "x ≥ 0"
    source

    copy_conflict

    JuMP.copy_conflictFunction
    copy_conflict(model::GenericModel)

    Return a copy of the current conflict for the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference.

    This is a convenience function that provides a filtering function for copy_model.

    Note

    Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

    Example

    In the following example, a model model is constructed with a variable x and two constraints c1 and c2. This model has no solution, as the two constraints are mutually exclusive. The solver is asked to compute a conflict with compute_conflict!. The parts of model participating in the conflict are then copied into a model iis_model.

    julia> using JuMP
    + "x ≥ 0"
    source

    copy_conflict

    JuMP.copy_conflictFunction
    copy_conflict(model::GenericModel)

    Return a copy of the current conflict for the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference.

    This is a convenience function that provides a filtering function for copy_model.

    Note

    Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

    Example

    In the following example, a model model is constructed with a variable x and two constraints c1 and c2. This model has no solution, as the two constraints are mutually exclusive. The solver is asked to compute a conflict with compute_conflict!. The parts of model participating in the conflict are then copied into a model iis_model.

    julia> using JuMP
     
     julia> import Gurobi
     
    @@ -663,7 +663,7 @@
     Feasibility
     Subject to
      c1 : x ≥ 2
    - c2 : x ≤ 1
    source

    copy_extension_data

    JuMP.copy_extension_dataFunction
    copy_extension_data(data, new_model::AbstractModel, model::AbstractModel)

    Return a copy of the extension data data of the model model to the extension data of the new model new_model.

    A method should be added for any JuMP extension storing data in the ext field.

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    Warning

    Do not engage in type piracy by implementing this method for types of data that you did not define! JuMP extensions should store types that they define in model.ext, rather than regular Julia types.

    source

    copy_model

    JuMP.copy_modelFunction
    copy_model(model::GenericModel; filter_constraints::Union{Nothing, Function}=nothing)

    Return a copy of the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference. A Base.copy(::AbstractModel) method has also been implemented, it is similar to copy_model but does not return the reference map.

    If the filter_constraints argument is given, only the constraints for which this function returns true will be copied. This function is given a constraint reference as argument.

    Note

    Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

    Example

    In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

    julia> model = Model();
    + c2 : x ≤ 1
    source

    copy_extension_data

    JuMP.copy_extension_dataFunction
    copy_extension_data(data, new_model::AbstractModel, model::AbstractModel)

    Return a copy of the extension data data of the model model to the extension data of the new model new_model.

    A method should be added for any JuMP extension storing data in the ext field.

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    Warning

    Do not engage in type piracy by implementing this method for types of data that you did not define! JuMP extensions should store types that they define in model.ext, rather than regular Julia types.

    source

    copy_model

    JuMP.copy_modelFunction
    copy_model(model::GenericModel; filter_constraints::Union{Nothing, Function}=nothing)

    Return a copy of the model model and a GenericReferenceMap that can be used to obtain the variable and constraint reference of the new model corresponding to a given model's reference. A Base.copy(::AbstractModel) method has also been implemented, it is similar to copy_model but does not return the reference map.

    If the filter_constraints argument is given, only the constraints for which this function returns true will be copied. This function is given a constraint reference as argument.

    Note

    Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

    Example

    In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -677,7 +677,7 @@
     x
     
     julia> cref_new = reference_map[cref]
    -cref : x = 2
    source

    delete

    JuMP.deleteFunction
    delete(model::GenericModel, con_ref::ConstraintRef)

    Delete the constraint associated with constraint_ref from the model model.

    Note that delete does not unregister the name from the model, so adding a new constraint of the same name will throw an error. Use unregister to unregister the name after deletion.

    Example

    julia> model = Model();
    +cref : x = 2
    source

    delete

    JuMP.deleteFunction
    delete(model::GenericModel, con_ref::ConstraintRef)

    Delete the constraint associated with constraint_ref from the model model.

    Note that delete does not unregister the name from the model, so adding a new constraint of the same name will throw an error. Use unregister to unregister the name after deletion.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -695,7 +695,7 @@
     julia> model[:c]
     ERROR: KeyError: key :c not found
     Stacktrace:
    -[...]
    source
    delete(model::GenericModel, con_refs::Vector{<:ConstraintRef})

    Delete the constraints associated with con_refs from the model model.

    Solvers may implement specialized methods for deleting multiple constraints of the same concrete type. These methods may be more efficient than repeatedly calling the single constraint delete method.

    See also: unregister

    Example

    julia> model = Model();
    +[...]
    source
    delete(model::GenericModel, con_refs::Vector{<:ConstraintRef})

    Delete the constraints associated with con_refs from the model model.

    Solvers may implement specialized methods for deleting multiple constraints of the same concrete type. These methods may be more efficient than repeatedly calling the single constraint delete method.

    See also: unregister

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:3]);
     
    @@ -716,7 +716,7 @@
     julia> model[:c]
     ERROR: KeyError: key :c not found
     Stacktrace:
    -[...]
    source
    delete(model::GenericModel, variable_ref::GenericVariableRef)

    Delete the variable associated with variable_ref from the model model.

    Note that delete does not unregister the name from the model, so adding a new variable of the same name will throw an error. Use unregister to unregister the name after deletion.

    Example

    julia> model = Model();
    +[...]
    source
    delete(model::GenericModel, variable_ref::GenericVariableRef)

    Delete the variable associated with variable_ref from the model model.

    Note that delete does not unregister the name from the model, so adding a new variable of the same name will throw an error. Use unregister to unregister the name after deletion.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -732,7 +732,7 @@
     julia> model[:x]
     ERROR: KeyError: key :x not found
     Stacktrace:
    -[...]
    source
    delete(model::GenericModel, variable_refs::Vector{<:GenericVariableRef})

    Delete the variables associated with variable_refs from the model model. Solvers may implement methods for deleting multiple variables that are more efficient than repeatedly calling the single variable delete method.

    See also: unregister

    Example

    julia> model = Model();
    +[...]
    source
    delete(model::GenericModel, variable_refs::Vector{<:GenericVariableRef})

    Delete the variables associated with variable_refs from the model model. Solvers may implement methods for deleting multiple variables that are more efficient than repeatedly calling the single variable delete method.

    See also: unregister

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -747,7 +747,7 @@
     julia> model[:x]
     ERROR: KeyError: key :x not found
     Stacktrace:
    -[...]
    source

    delete_lower_bound

    delete_lower_bound

    delete_upper_bound

    delete_upper_bound

    direct_generic_model

    direct_generic_model

    JuMP.direct_generic_modelFunction
    direct_generic_model(
         value_type::Type{T},
         backend::MOI.ModelLike;
    -) where {T<:Real}

    Return a new JuMP model using backend to store the model and solve it.

    As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

    Notes

    The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

    • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
    • No constraint bridging is supported by default.
    • The optimizer used cannot be changed the model is constructed.
    • The model created cannot be copied.
    source
    direct_generic_model(::Type{T}, factory::MOI.OptimizerWithAttributes)

    Create a direct_generic_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

    Example

    julia> import HiGHS
    +) where {T<:Real}

    Return a new JuMP model using backend to store the model and solve it.

    As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

    Notes

    The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

    • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
    • No constraint bridging is supported by default.
    • The optimizer used cannot be changed the model is constructed.
    • The model created cannot be copied.
    source
    direct_generic_model(::Type{T}, factory::MOI.OptimizerWithAttributes)

    Create a direct_generic_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

    Example

    julia> import HiGHS
     
     julia> optimizer = optimizer_with_attributes(
                HiGHS.Optimizer,
    @@ -798,7 +798,7 @@
     
     julia> set_attribute(model, "presolve", "off")
     
    -julia> set_attribute(model, MOI.Silent(), true)
    source

    direct_model

    JuMP.direct_modelFunction
    direct_model(backend::MOI.ModelLike)

    Return a new JuMP model using backend to store the model and solve it.

    As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

    Notes

    The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

    • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
    • No constraint bridging is supported by default.
    • The optimizer used cannot be changed the model is constructed.
    • The model created cannot be copied.
    source
    direct_model(factory::MOI.OptimizerWithAttributes)

    Create a direct_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

    Example

    julia> import HiGHS
    +julia> set_attribute(model, MOI.Silent(), true)
    source

    direct_model

    JuMP.direct_modelFunction
    direct_model(backend::MOI.ModelLike)

    Return a new JuMP model using backend to store the model and solve it.

    As opposed to the Model constructor, no cache of the model is stored outside of backend and no bridges are automatically applied to backend.

    Notes

    The absence of a cache reduces the memory footprint but, it is important to bear in mind the following implications of creating models using this direct mode:

    • When backend does not support an operation, such as modifying constraints or adding variables/constraints after solving, an error is thrown. For models created using the Model constructor, such situations can be dealt with by storing the modifications in a cache and loading them into the optimizer when optimize! is called.
    • No constraint bridging is supported by default.
    • The optimizer used cannot be changed the model is constructed.
    • The model created cannot be copied.
    source
    direct_model(factory::MOI.OptimizerWithAttributes)

    Create a direct_model using factory, a MOI.OptimizerWithAttributes object created by optimizer_with_attributes.

    Example

    julia> import HiGHS
     
     julia> optimizer = optimizer_with_attributes(
                HiGHS.Optimizer,
    @@ -826,7 +826,7 @@
     
     julia> set_attribute(model, "presolve", "off")
     
    -julia> set_attribute(model, MOI.Silent(), true)
    source

    drop_zeros!

    JuMP.drop_zeros!Function
    drop_zeros!(expr::GenericAffExpr)

    Remove terms in the affine expression with 0 coefficients.

    Example

    julia> model = Model();
    +julia> set_attribute(model, MOI.Silent(), true)
    source

    drop_zeros!

    JuMP.drop_zeros!Function
    drop_zeros!(expr::GenericAffExpr)

    Remove terms in the affine expression with 0 coefficients.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -838,7 +838,7 @@
     julia> drop_zeros!(expr)
     
     julia> expr
    -x[2]
    source
    drop_zeros!(expr::GenericQuadExpr)

    Remove terms in the quadratic expression with 0 coefficients.

    Example

    julia> model = Model();
    +x[2]
    source
    drop_zeros!(expr::GenericQuadExpr)

    Remove terms in the quadratic expression with 0 coefficients.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -850,7 +850,7 @@
     julia> drop_zeros!(expr)
     
     julia> expr
    -x[2]²
    source

    dual

    JuMP.dualFunction
    dual(con_ref::ConstraintRef; result::Int = 1)

    Return the dual value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

    Use has_duals to check if a result exists before asking for values.

    See also: result_count, shadow_price.

    Example

    julia> import HiGHS
    +x[2]²
    source

    dual

    JuMP.dualFunction
    dual(con_ref::ConstraintRef; result::Int = 1)

    Return the dual value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

    Use has_duals to check if a result exists before asking for values.

    See also: result_count, shadow_price.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -869,7 +869,7 @@
     true
     
     julia> dual(c)
    --2.0
    source

    dual_objective_value

    JuMP.dual_objective_valueFunction
    dual_objective_value(model::GenericModel; result::Int = 1)

    Return the value of the objective of the dual problem associated with result index result of the most-recent solution returned by the solver.

    Throws MOI.UnsupportedAttribute{MOI.DualObjectiveValue} if the solver does not support this attribute.

    This function is equivalent to querying the MOI.DualObjectiveValue attribute.

    See also: result_count.

    Example

    julia> import HiGHS
    +-2.0
    source

    dual_objective_value

    JuMP.dual_objective_valueFunction
    dual_objective_value(model::GenericModel; result::Int = 1)

    Return the value of the objective of the dual problem associated with result index result of the most-recent solution returned by the solver.

    Throws MOI.UnsupportedAttribute{MOI.DualObjectiveValue} if the solver does not support this attribute.

    This function is equivalent to querying the MOI.DualObjectiveValue attribute.

    See also: result_count.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -887,7 +887,7 @@
     julia> dual_objective_value(model; result = 2)
     ERROR: Result index of attribute MathOptInterface.DualObjectiveValue(2) out of bounds. There are currently 1 solution(s) in the model.
     Stacktrace:
    -[...]
    source

    dual_shape

    JuMP.dual_shapeFunction
    dual_shape(shape::AbstractShape)::AbstractShape

    Returns the shape of the dual space of the space of objects of shape shape. By default, the dual_shape of a shape is itself. See the examples section below for an example for which this is not the case.

    Example

    Consider polynomial constraints for which the dual is moment constraints and moment constraints for which the dual is polynomial constraints. Shapes for polynomials can be defined as follows:

    struct Polynomial
    +[...]
    source

    dual_shape

    JuMP.dual_shapeFunction
    dual_shape(shape::AbstractShape)::AbstractShape

    Returns the shape of the dual space of the space of objects of shape shape. By default, the dual_shape of a shape is itself. See the examples section below for an example for which this is not the case.

    Example

    Consider polynomial constraints for which the dual is moment constraints and moment constraints for which the dual is polynomial constraints. Shapes for polynomials can be defined as follows:

    struct Polynomial
         coefficients::Vector{Float64}
         monomials::Vector{Monomial}
     end
    @@ -902,7 +902,7 @@
         monomials::Vector{Monomial}
     end
     JuMP.reshape_vector(x::Vector, shape::MomentsShape) = Moments(x, shape.monomials)

    Then dual_shape allows the definition of the shape of the dual of polynomial and moment constraints:

    dual_shape(shape::PolynomialShape) = MomentsShape(shape.monomials)
    -dual_shape(shape::MomentsShape) = PolynomialShape(shape.monomials)
    source

    dual_start_value

    JuMP.dual_start_valueFunction
    dual_start_value(con_ref::ConstraintRef)

    Return the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref.

    If no dual start value has been set, dual_start_value will return nothing.

    See also set_dual_start_value.

    Example

    julia> model = Model();
    +dual_shape(shape::MomentsShape) = PolynomialShape(shape.monomials)
    source

    dual_start_value

    JuMP.dual_start_valueFunction
    dual_start_value(con_ref::ConstraintRef)

    Return the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref.

    If no dual start value has been set, dual_start_value will return nothing.

    See also set_dual_start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 2.0);
     
    @@ -917,19 +917,19 @@
     
     julia> set_dual_start_value(c, nothing)
     
    -julia> dual_start_value(c)
    source

    dual_status

    JuMP.dual_statusFunction
    dual_status(model::GenericModel; result::Int = 1)

    Return a MOI.ResultStatusCode describing the status of the most recent dual solution of the solver (that is, the MOI.DualStatus attribute) associated with the result index result.

    See also: result_count.

    Example

    julia> import Ipopt
    +julia> dual_start_value(c)
    source

    dual_status

    JuMP.dual_statusFunction
    dual_status(model::GenericModel; result::Int = 1)

    Return a MOI.ResultStatusCode describing the status of the most recent dual solution of the solver (that is, the MOI.DualStatus attribute) associated with the result index result.

    See also: result_count.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
     julia> dual_status(model; result = 2)
    -NO_SOLUTION::ResultStatusCode = 0
    source

    error_if_direct_mode

    JuMP.error_if_direct_modeFunction
    error_if_direct_mode(model::GenericModel, func::Symbol)

    Errors if model is in direct mode during a call from the function named func.

    Used internally within JuMP, or by JuMP extensions who do not want to support models in direct mode.

    Example

    julia> import HiGHS
    +NO_SOLUTION::ResultStatusCode = 0
    source

    error_if_direct_mode

    JuMP.error_if_direct_modeFunction
    error_if_direct_mode(model::GenericModel, func::Symbol)

    Errors if model is in direct mode during a call from the function named func.

    Used internally within JuMP, or by JuMP extensions who do not want to support models in direct mode.

    Example

    julia> import HiGHS
     
     julia> model = direct_model(HiGHS.Optimizer());
     
     julia> error_if_direct_mode(model, :foo)
     ERROR: The `foo` function is not supported in DIRECT mode.
     Stacktrace:
    -[...]
    source

    fix

    JuMP.fixFunction
    fix(v::GenericVariableRef, value::Number; force::Bool = false)

    Fix a variable to a value. Update the fixing constraint if one exists, otherwise create a new one.

    If the variable already has variable bounds and force=false, calling fix will throw an error. If force=true, existing variable bounds will be deleted, and the fixing constraint will be added. Note a variable will have no bounds after a call to unfix.

    See also FixRef, is_fixed, fix_value, unfix.

    Example

    julia> model = Model();
    +[...]
    source

    fix

    JuMP.fixFunction
    fix(v::GenericVariableRef, value::Number; force::Bool = false)

    Fix a variable to a value. Update the fixing constraint if one exists, otherwise create a new one.

    If the variable already has variable bounds and force=false, calling fix will throw an error. If force=true, existing variable bounds will be deleted, and the fixing constraint will be added. Note a variable will have no bounds after a call to unfix.

    See also FixRef, is_fixed, fix_value, unfix.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -949,7 +949,7 @@
     julia> fix(x, 1.0; force = true)
     
     julia> is_fixed(x)
    -true
    source

    fix_discrete_variables

    JuMP.fix_discrete_variablesFunction
    fix_discrete_variables([var_value::Function = value,] model::GenericModel)

    Modifies model to convert all binary and integer variables to continuous variables with fixed bounds of var_value(x).

    Return

    Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

    Notes

    • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
    • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

    Example

    julia> model = Model();
    +true
    source

    fix_discrete_variables

    JuMP.fix_discrete_variablesFunction
    fix_discrete_variables([var_value::Function = value,] model::GenericModel)

    Modifies model to convert all binary and integer variables to continuous variables with fixed bounds of var_value(x).

    Return

    Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

    Notes

    • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
    • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, Bin, start = 1);
     
    @@ -973,12 +973,12 @@
      y ≥ 1
      y ≤ 10
      y integer
    - x binary
    source

    fix_value

    JuMP.fix_valueFunction
    fix_value(v::GenericVariableRef)

    Return the value to which a variable is fixed.

    Error if one does not exist.

    See also FixRef, is_fixed, fix, unfix.

    Example

    julia> model = Model();
    + x binary
    source

    fix_value

    JuMP.fix_valueFunction
    fix_value(v::GenericVariableRef)

    Return the value to which a variable is fixed.

    Error if one does not exist.

    See also FixRef, is_fixed, fix, unfix.

    Example

    julia> model = Model();
     
     julia> @variable(model, x == 1);
     
     julia> fix_value(x)
    -1.0
    source

    flatten!

    JuMP.flatten!Function
    flatten!(expr::GenericNonlinearExpr)

    Flatten a nonlinear expression in-place by lifting nested + and * nodes into a single n-ary operation.

    Motivation

    Nonlinear expressions created using operator overloading can be deeply nested and unbalanced. For example, prod(x for i in 1:4) creates *(x, *(x, *(x, x))) instead of the more preferable *(x, x, x, x).

    Example

    julia> model = Model();
    +1.0
    source

    flatten!

    JuMP.flatten!Function
    flatten!(expr::GenericNonlinearExpr)

    Flatten a nonlinear expression in-place by lifting nested + and * nodes into a single n-ary operation.

    Motivation

    Nonlinear expressions created using operator overloading can be deeply nested and unbalanced. For example, prod(x for i in 1:4) creates *(x, *(x, *(x, x))) instead of the more preferable *(x, x, x, x).

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -990,7 +990,7 @@
     (x²) * x * x
     
     julia> flatten!(sin(prod(x for i in 1:4)))
    -sin((x²) * x * x)
    source

    function_string

    function_string

    JuMP.function_stringFunction
    function_string(
         mode::MIME,
         func::Union{JuMP.AbstractJuMPScalar,Vector{<:JuMP.AbstractJuMPScalar}},
     )

    Return a String representing the function func using print mode mode.

    Example

    julia> model = Model();
    @@ -998,7 +998,7 @@
     julia> @variable(model, x);
     
     julia> function_string(MIME("text/plain"), 2 * x + 1)
    -"2 x + 1"
    source

    get_attribute

    get_attribute

    JuMP.get_attributeFunction
    get_attribute(model::GenericModel, attr::MOI.AbstractModelAttribute)
     get_attribute(x::GenericVariableRef, attr::MOI.AbstractVariableAttribute)
     get_attribute(cr::ConstraintRef, attr::MOI.AbstractConstraintAttribute)

    Get the value of a solver-specifc attribute attr.

    This is equivalent to calling MOI.get with the associated MOI model and, for variables and constraints, with the associated MOI.VariableIndex or MOI.ConstraintIndex.

    Example

    julia> model = Model();
     
    @@ -1015,7 +1015,7 @@
     "x"
     
     julia> get_attribute(c, MOI.ConstraintName())
    -"c"
    source
    get_attribute(
    +"c"
    source
    get_attribute(
         model::Union{GenericModel,MOI.OptimizerWithAttributes},
         attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
     )

    Get the value of a solver-specifc attribute attr.

    This is equivalent to calling MOI.get with the associated MOI model.

    If attr is an AbstractString, it is converted to MOI.RawOptimizerAttribute.

    Example

    julia> import HiGHS
    @@ -1034,7 +1034,7 @@
     true
     
     julia> get_attribute(opt, MOI.RawOptimizerAttribute("output_flag"))
    -true
    source

    has_duals

    JuMP.has_dualsFunction
    has_duals(model::GenericModel; result::Int = 1)

    Return true if the solver has a dual solution in result index result available to query, otherwise return false.

    See also dual, shadow_price, and result_count.

    Example

    julia> import HiGHS
    +true
    source

    has_duals

    JuMP.has_dualsFunction
    has_duals(model::GenericModel; result::Int = 1)

    Return true if the solver has a dual solution in result index result available to query, otherwise return false.

    See also dual, shadow_price, and result_count.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1053,12 +1053,12 @@
     julia> optimize!(model)
     
     julia> has_duals(model)
    -true
    source

    has_lower_bound

    has_lower_bound

    has_start_value

    has_start_value

    JuMP.has_start_valueFunction
    has_start_value(variable::AbstractVariableRef)

    Return true if the variable has a start value set, otherwise return false.

    See also: start_value, set_start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 1.5);
     
    @@ -1079,12 +1079,12 @@
     true
     
     julia> start_value(y)
    -2.0
    source

    has_upper_bound

    has_upper_bound

    has_values

    JuMP.has_valuesFunction
    has_values(model::GenericModel; result::Int = 1)

    Return true if the solver has a primal solution in result index result available to query, otherwise return false.

    See also value and result_count.

    Example

    julia> import HiGHS
    +true
    source

    has_values

    JuMP.has_valuesFunction
    has_values(model::GenericModel; result::Int = 1)

    Return true if the solver has a primal solution in result index result available to query, otherwise return false.

    See also value and result_count.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1103,25 +1103,25 @@
     julia> optimize!(model)
     
     julia> has_values(model)
    -true
    source

    in_set_string

    JuMP.in_set_stringFunction
    in_set_string(mode::MIME, set)

    Return a String representing the membership to the set set using print mode mode.

    Extensions

    JuMP extensions may extend this method for new set types to improve the legibility of their printing.

    Example

    julia> in_set_string(MIME("text/plain"), MOI.Interval(1.0, 2.0))
    -"∈ [1, 2]"
    source

    index

    JuMP.indexFunction
    index(cr::ConstraintRef)::MOI.ConstraintIndex

    Return the index of the constraint that corresponds to cr in the MOI backend.

    Example

    julia> model = Model();
    +true
    source

    in_set_string

    JuMP.in_set_stringFunction
    in_set_string(mode::MIME, set)

    Return a String representing the membership to the set set using print mode mode.

    Extensions

    JuMP extensions may extend this method for new set types to improve the legibility of their printing.

    Example

    julia> in_set_string(MIME("text/plain"), MOI.Interval(1.0, 2.0))
    +"∈ [1, 2]"
    source

    index

    JuMP.indexFunction
    index(cr::ConstraintRef)::MOI.ConstraintIndex

    Return the index of the constraint that corresponds to cr in the MOI backend.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> @constraint(model, c, x >= 0);
     
     julia> index(c)
    -MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.GreaterThan{Float64}}(1)
    source
    index(v::GenericVariableRef)::MOI.VariableIndex

    Return the index of the variable that corresponds to v in the MOI backend.

    Example

    julia> model = Model();
    +MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.GreaterThan{Float64}}(1)
    source
    index(v::GenericVariableRef)::MOI.VariableIndex

    Return the index of the variable that corresponds to v in the MOI backend.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> index(x)
    -MOI.VariableIndex(1)
    source

    is_binary

    is_binary

    is_fixed

    is_fixed

    JuMP.is_fixedFunction
    is_fixed(v::GenericVariableRef)

    Return true if v is a fixed variable. If true, the fixed value can be queried with fix_value.

    See also FixRef, fix_value, fix, unfix.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1131,7 +1131,7 @@
     julia> fix(x, 1.0)
     
     julia> is_fixed(x)
    -true
    source

    is_integer

    is_integer

    JuMP.is_integerFunction
    is_integer(v::GenericVariableRef)

    Return true if v is constrained to be integer.

    See also IntegerRef, set_integer, unset_integer.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1141,7 +1141,7 @@
     julia> set_integer(x)
     
     julia> is_integer(x)
    -true
    source

    is_parameter

    is_parameter

    is_solved_and_feasible

    is_solved_and_feasible

    JuMP.is_solved_and_feasibleFunction
    is_solved_and_feasible(
         model::GenericModel;
         allow_local::Bool = true,
         allow_almost::Bool = false,
    @@ -1164,7 +1164,7 @@
     julia> model = Model(Ipopt.Optimizer);
     
     julia> is_solved_and_feasible(model)
    -false
    source

    is_valid

    JuMP.is_validFunction
    is_valid(model::GenericModel, con_ref::ConstraintRef{<:AbstractModel})

    Return true if con_ref refers to a valid constraint in model.

    Example

    julia> model = Model();
    +false
    source

    is_valid

    JuMP.is_validFunction
    is_valid(model::GenericModel, con_ref::ConstraintRef{<:AbstractModel})

    Return true if con_ref refers to a valid constraint in model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1176,7 +1176,7 @@
     julia> model_2 = Model();
     
     julia> is_valid(model_2, c)
    -false
    source
    is_valid(model::GenericModel, variable_ref::GenericVariableRef)

    Return true if variable refers to a valid variable in model.

    Example

    julia> model = Model();
    +false
    source
    is_valid(model::GenericModel, variable_ref::GenericVariableRef)

    Return true if variable refers to a valid variable in model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1186,7 +1186,7 @@
     julia> model_2 = Model();
     
     julia> is_valid(model_2, x)
    -false
    source

    isequal_canonical

    isequal_canonical

    JuMP.isequal_canonicalFunction
    isequal_canonical(
         x::T,
         y::T
     ) where {T<:AbstractJuMPScalar,AbstractArray{<:AbstractJuMPScalar}}

    Return true if x is equal to y after dropping zeros and disregarding the order.

    This method is mainly useful for testing, because fallbacks like x == y do not account for valid mathematical comparisons like x[1] + 0 x[2] + 1 == x[1] + 1.

    Example

    julia> model = Model();
    @@ -1206,7 +1206,7 @@
     false
     
     julia> isequal_canonical(a, b)
    -true
    source

    jump_function

    JuMP.jump_functionFunction
    jump_function(model::AbstractModel, x::MOI.AbstractFunction)

    Given an MathOptInterface object x, return the JuMP equivalent.

    See also: moi_function.

    Example

    julia> model = Model();
    +true
    source

    jump_function

    JuMP.jump_functionFunction
    jump_function(model::AbstractModel, x::MOI.AbstractFunction)

    Given an MathOptInterface object x, return the JuMP equivalent.

    See also: moi_function.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1214,10 +1214,10 @@
     1.0 + 2.0 MOI.VariableIndex(1)
     
     julia> jump_function(model, f)
    -2 x + 1
    source

    jump_function_type

    JuMP.jump_function_typeFunction
    jump_function_type(model::AbstractModel, ::Type{T}) where {T}

    Given an MathOptInterface object type T, return the JuMP equivalent.

    See also: moi_function_type.

    Example

    julia> model = Model();
    +2 x + 1
    source

    jump_function_type

    JuMP.jump_function_typeFunction
    jump_function_type(model::AbstractModel, ::Type{T}) where {T}

    Given an MathOptInterface object type T, return the JuMP equivalent.

    See also: moi_function_type.

    Example

    julia> model = Model();
     
     julia> jump_function_type(model, MOI.ScalarAffineFunction{Float64})
    -AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
    source

    latex_formulation

    JuMP.latex_formulationFunction
    latex_formulation(model::AbstractModel)

    Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

    To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

    source

    linear_terms

    JuMP.linear_termsFunction
    linear_terms(aff::GenericAffExpr{C,V})

    Provides an iterator over coefficient-variable tuples (a_i::C, x_i::V) in the linear part of the affine expression.

    source
    linear_terms(quad::GenericQuadExpr{C,V})

    Provides an iterator over tuples (coefficient::C, variable::V) in the linear part of the quadratic expression.

    source

    list_of_constraint_types

    JuMP.list_of_constraint_typesFunction
    list_of_constraint_types(model::GenericModel)::Vector{Tuple{Type,Type}}

    Return a list of tuples of the form (F, S) where F is a JuMP function type and S is an MOI set type such that all_constraints(model, F, S) returns a nonempty list.

    Example

    julia> model = Model();
    +AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
    source

    latex_formulation

    JuMP.latex_formulationFunction
    latex_formulation(model::AbstractModel)

    Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

    To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

    source

    linear_terms

    JuMP.linear_termsFunction
    linear_terms(aff::GenericAffExpr{C,V})

    Provides an iterator over coefficient-variable tuples (a_i::C, x_i::V) in the linear part of the affine expression.

    source
    linear_terms(quad::GenericQuadExpr{C,V})

    Provides an iterator over tuples (coefficient::C, variable::V) in the linear part of the quadratic expression.

    source

    list_of_constraint_types

    JuMP.list_of_constraint_typesFunction
    list_of_constraint_types(model::GenericModel)::Vector{Tuple{Type,Type}}

    Return a list of tuples of the form (F, S) where F is a JuMP function type and S is an MOI set type such that all_constraints(model, F, S) returns a nonempty list.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0, Bin);
     
    @@ -1227,12 +1227,12 @@
     3-element Vector{Tuple{Type, Type}}:
      (AffExpr, MathOptInterface.LessThan{Float64})
      (VariableRef, MathOptInterface.GreaterThan{Float64})
    - (VariableRef, MathOptInterface.ZeroOne)

    Performance considerations

    Iterating over the list of function and set types is a type-unstable operation. Consider using a function barrier. See the Performance tips for extensions section of the documentation for more details.

    source

    lower_bound

    JuMP.lower_boundFunction
    lower_bound(v::GenericVariableRef)

    Return the lower bound of a variable. Error if one does not exist.

    See also LowerBoundRef, has_lower_bound, set_lower_bound, delete_lower_bound.

    Example

    julia> model = Model();
    + (VariableRef, MathOptInterface.ZeroOne)

    Performance considerations

    Iterating over the list of function and set types is a type-unstable operation. Consider using a function barrier. See the Performance tips for extensions section of the documentation for more details.

    source

    lower_bound

    lp_matrix_data

    JuMP.lp_matrix_dataFunction
    lp_matrix_data(model::GenericModel{T})

    Given a JuMP model of a linear program, return an LPMatrixData{T} struct storing data for an equivalent linear program in the form:

    \[\begin{aligned} +1.0

    source

    lp_matrix_data

    JuMP.lp_matrix_dataFunction
    lp_matrix_data(model::GenericModel{T})

    Given a JuMP model of a linear program, return an LPMatrixData{T} struct storing data for an equivalent linear program in the form:

    \[\begin{aligned} \min & c^\top x + c_0 \\ & b_l \le A x \le b_u \\ & x_l \le x \le x_u @@ -1277,7 +1277,7 @@ 0.0 julia> data.sense -MAX_SENSE::OptimizationSense = 1

    source

    lp_sensitivity_report

    JuMP.lp_sensitivity_reportFunction
    lp_sensitivity_report(model::GenericModel{T}; atol::T = Base.rtoldefault(T))::SensitivityReport{T} where {T}

    Given a linear program model with a current optimal basis, return a SensitivityReport object, which maps:

    • Every variable reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
    • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

    Both tuples are relative, rather than absolute. So given a objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

    atol is the primal/dual optimality tolerance, and should match the tolerance of the solver used to compute the basis.

    Note: interval constraints are NOT supported.

    Example

    julia> import HiGHS
    +MAX_SENSE::OptimizationSense = 1
    source

    lp_sensitivity_report

    JuMP.lp_sensitivity_reportFunction
    lp_sensitivity_report(model::GenericModel{T}; atol::T = Base.rtoldefault(T))::SensitivityReport{T} where {T}

    Given a linear program model with a current optimal basis, return a SensitivityReport object, which maps:

    • Every variable reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
    • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{T,T}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

    Both tuples are relative, rather than absolute. So given a objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

    atol is the primal/dual optimality tolerance, and should match the tolerance of the solver used to compute the basis.

    Note: interval constraints are NOT supported.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1309,7 +1309,7 @@
                "The lower bound of `x` can decrease by $dRHS_lo or increase " *
                "by $dRHS_hi."
            )
    -The lower bound of `x` can decrease by -Inf or increase by 3.0.
    source

    map_coefficients

    map_coefficients

    JuMP.map_coefficientsFunction
    map_coefficients(f::Function, a::GenericAffExpr)

    Apply f to the coefficients and constant term of an GenericAffExpr a and return a new expression.

    See also: map_coefficients_inplace!

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1320,7 +1320,7 @@
     2 x + 2
     
     julia> a
    -x + 1
    source
    map_coefficients(f::Function, a::GenericQuadExpr)

    Apply f to the coefficients and constant term of an GenericQuadExpr a and return a new expression.

    See also: map_coefficients_inplace!

    Example

    julia> model = Model();
    +x + 1
    source
    map_coefficients(f::Function, a::GenericQuadExpr)

    Apply f to the coefficients and constant term of an GenericQuadExpr a and return a new expression.

    See also: map_coefficients_inplace!

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1331,7 +1331,7 @@
     2 x² + 2 x + 2
     
     julia> a
    -x² + x + 1
    source

    map_coefficients_inplace!

    map_coefficients_inplace!

    JuMP.map_coefficients_inplace!Function
    map_coefficients_inplace!(f::Function, a::GenericAffExpr)

    Apply f to the coefficients and constant term of an GenericAffExpr a and update them in-place.

    See also: map_coefficients

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1342,7 +1342,7 @@
     2 x + 2
     
     julia> a
    -2 x + 2
    source
    map_coefficients_inplace!(f::Function, a::GenericQuadExpr)

    Apply f to the coefficients and constant term of an GenericQuadExpr a and update them in-place.

    See also: map_coefficients

    Example

    julia> model = Model();
    +2 x + 2
    source
    map_coefficients_inplace!(f::Function, a::GenericQuadExpr)

    Apply f to the coefficients and constant term of an GenericQuadExpr a and update them in-place.

    See also: map_coefficients

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1353,10 +1353,10 @@
     2 x² + 2 x + 2
     
     julia> a
    -2 x² + 2 x + 2
    source

    mode

    JuMP.modeFunction
    mode(model::GenericModel)

    Return the ModelMode of model.

    Example

    julia> model = Model();
    +2 x² + 2 x + 2
    source

    mode

    JuMP.modeFunction
    mode(model::GenericModel)

    Return the ModelMode of model.

    Example

    julia> model = Model();
     
     julia> mode(model)
    -AUTOMATIC::ModelMode = 0
    source

    model_convert

    model_convert

    JuMP.model_convertFunction
    model_convert(
         model::AbstractModel,
         rhs::Union{
             AbstractConstraint,
    @@ -1364,14 +1364,14 @@
             AbstractJuMPScalar,
             MOI.AbstractSet,
         },
    -)

    Convert the coefficients and constants of functions and sets in the rhs to the coefficient type value_type(typeof(model)).

    Purpose

    Creating and adding a constraint is a two-step process. The first step calls build_constraint, and the result of that is passed to add_constraint.

    However, because build_constraint does not take the model as an argument, the coefficients and constants of the function or set might be different than value_type(typeof(model)).

    Therefore, the result of build_constraint is converted in a call to model_convert before the result is passed to add_constraint.

    source

    model_string

    JuMP.model_stringFunction
    model_string(mode::MIME, model::AbstractModel)

    Return a String representation of model given the mode.

    Example

    julia> model = Model();
    +)

    Convert the coefficients and constants of functions and sets in the rhs to the coefficient type value_type(typeof(model)).

    Purpose

    Creating and adding a constraint is a two-step process. The first step calls build_constraint, and the result of that is passed to add_constraint.

    However, because build_constraint does not take the model as an argument, the coefficients and constants of the function or set might be different than value_type(typeof(model)).

    Therefore, the result of build_constraint is converted in a call to model_convert before the result is passed to add_constraint.

    source

    model_string

    JuMP.model_stringFunction
    model_string(mode::MIME, model::AbstractModel)

    Return a String representation of model given the mode.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0);
     
     julia> print(model_string(MIME("text/plain"), model))
     Feasibility
     Subject to
    - x ≥ 0
    source

    moi_function

    moi_function

    JuMP.moi_functionFunction
    moi_function(x::AbstractJuMPScalar)
     moi_function(x::AbstractArray{<:AbstractJuMPScalar})

    Given a JuMP object x, return the MathOptInterface equivalent.

    See also: jump_function.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
    @@ -1380,8 +1380,8 @@
     2 x + 1
     
     julia> moi_function(f)
    -1.0 + 2.0 MOI.VariableIndex(1)
    source

    moi_function_type

    JuMP.moi_function_typeFunction
    moi_function_type(::Type{T}) where {T}

    Given a JuMP object type T, return the MathOptInterface equivalent.

    See also: jump_function_type.

    Example

    julia> moi_function_type(AffExpr)
    -MathOptInterface.ScalarAffineFunction{Float64}
    source

    moi_set

    JuMP.moi_setFunction
    moi_set(constraint::AbstractConstraint)

    Return the set of the constraint constraint in the function-in-set form as a MathOptInterface.AbstractSet.

    moi_set(s::AbstractVectorSet, dim::Int)

    Returns the MOI set of dimension dim corresponding to the JuMP set s.

    moi_set(s::AbstractScalarSet)

    Returns the MOI set corresponding to the JuMP set s.

    source

    name

    JuMP.nameFunction
    name(con_ref::ConstraintRef)

    Get a constraint's name attribute.

    Example

    julia> model = Model();
    +1.0 + 2.0 MOI.VariableIndex(1)
    source

    moi_function_type

    JuMP.moi_function_typeFunction
    moi_function_type(::Type{T}) where {T}

    Given a JuMP object type T, return the MathOptInterface equivalent.

    See also: jump_function_type.

    Example

    julia> moi_function_type(AffExpr)
    +MathOptInterface.ScalarAffineFunction{Float64}
    source

    moi_set

    JuMP.moi_setFunction
    moi_set(constraint::AbstractConstraint)

    Return the set of the constraint constraint in the function-in-set form as a MathOptInterface.AbstractSet.

    moi_set(s::AbstractVectorSet, dim::Int)

    Returns the MOI set of dimension dim corresponding to the JuMP set s.

    moi_set(s::AbstractScalarSet)

    Returns the MOI set corresponding to the JuMP set s.

    source

    name

    JuMP.nameFunction
    name(con_ref::ConstraintRef)

    Get a constraint's name attribute.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1389,7 +1389,7 @@
     c : [2 x] ∈ Nonnegatives()
     
     julia> name(c)
    -"c"
    source
    name(v::GenericVariableRef)::String

    Get a variable's name attribute.

    Example

    julia> model = Model();
    +"c"
    source
    name(v::GenericVariableRef)::String

    Get a variable's name attribute.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2])
     2-element Vector{VariableRef}:
    @@ -1397,10 +1397,10 @@
      x[2]
     
     julia> name(x[1])
    -"x[1]"
    source
    name(model::AbstractModel)

    Return the MOI.Name attribute of model's backend, or a default if empty.

    Example

    julia> model = Model();
    +"x[1]"
    source
    name(model::AbstractModel)

    Return the MOI.Name attribute of model's backend, or a default if empty.

    Example

    julia> model = Model();
     
     julia> name(model)
    -"A JuMP Model"
    source

    node_count

    JuMP.node_countFunction
    node_count(model::GenericModel)

    If available, returns the total number of branch-and-bound nodes explored during the most recent optimization in a Mixed Integer Program (the MOI.NodeCount attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
    +"A JuMP Model"
    source

    node_count

    JuMP.node_countFunction
    node_count(model::GenericModel)

    If available, returns the total number of branch-and-bound nodes explored during the most recent optimization in a Mixed Integer Program (the MOI.NodeCount attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1409,7 +1409,7 @@
     julia> optimize!(model)
     
     julia> node_count(model)
    -0
    source

    normalized_coefficient

    normalized_coefficient

    JuMP.normalized_coefficientFunction
    normalized_coefficient(
         constraint::ConstraintRef,
         variable::GenericVariableRef,
     )

    Return the coefficient associated with variable in constraint after JuMP has normalized the constraint into its standard form.

    See also set_normalized_coefficient.

    Example

    julia> model = Model();
    @@ -1429,7 +1429,7 @@
     julia> normalized_coefficient(con_vec, x)
     2-element Vector{Tuple{Int64, Float64}}:
      (1, 1.0)
    - (2, 2.0)
    source
    normalized_coefficient(
    + (2, 2.0)
    source
    normalized_coefficient(
         constraint::ConstraintRef,
         variable_1::GenericVariableRef,
         variable_2::GenericVariableRef,
    @@ -1454,7 +1454,7 @@
      (1, 1.0)
     
     julia> normalized_coefficient(con_vec, x[1], x[2])
    -Tuple{Int64, Float64}[]
    source

    normalized_rhs

    JuMP.normalized_rhsFunction
    normalized_rhs(constraint::ConstraintRef)

    Return the right-hand side term of constraint after JuMP has converted the constraint into its normalized form.

    See also set_normalized_rhs.

    Example

    julia> model = Model();
    +Tuple{Int64, Float64}[]
    source

    normalized_rhs

    JuMP.normalized_rhsFunction
    normalized_rhs(constraint::ConstraintRef)

    Return the right-hand side term of constraint after JuMP has converted the constraint into its normalized form.

    See also set_normalized_rhs.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1462,7 +1462,7 @@
     con : 2 x ≤ 1
     
     julia> normalized_rhs(con)
    -1.0
    source

    num_constraints

    num_constraints

    JuMP.num_constraintsFunction
    num_constraints(model::GenericModel, function_type, set_type)::Int64

    Return the number of constraints currently in the model where the function has type function_type and the set has type set_type.

    See also list_of_constraint_types and all_constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0, Bin);
     
    @@ -1481,7 +1481,7 @@
     1
     
     julia> num_constraints(model, AffExpr, MOI.LessThan{Float64})
    -2
    source
    num_constraints(model::GenericModel; count_variable_in_set_constraints::Bool)

    Return the number of constraints in model.

    If count_variable_in_set_constraints == true, then VariableRef constraints such as VariableRef-in-Integer are included. To count only the number of structural constraints (for example, the rows in the constraint matrix of a linear program), pass count_variable_in_set_constraints = false.

    Example

    julia> model = Model();
    +2
    source
    num_constraints(model::GenericModel; count_variable_in_set_constraints::Bool)

    Return the number of constraints in model.

    If count_variable_in_set_constraints == true, then VariableRef constraints such as VariableRef-in-Integer are included. To count only the number of structural constraints (for example, the rows in the constraint matrix of a linear program), pass count_variable_in_set_constraints = false.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0, Int);
     
    @@ -1491,18 +1491,18 @@
     3
     
     julia> num_constraints(model; count_variable_in_set_constraints = false)
    -1
    source

    num_variables

    JuMP.num_variablesFunction
    num_variables(model::GenericModel)::Int64

    Returns number of variables in model.

    Example

    julia> model = Model();
    +1
    source

    num_variables

    JuMP.num_variablesFunction
    num_variables(model::GenericModel)::Int64

    Returns number of variables in model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
     julia> num_variables(model)
    -2
    source

    object_dictionary

    JuMP.object_dictionaryFunction
    object_dictionary(model::GenericModel)

    Return the dictionary that maps the symbol name of a variable, constraint, or expression to the corresponding object.

    Objects are registered to a specific symbol in the macros. For example, @variable(model, x[1:2, 1:2]) registers the array of variables x to the symbol :x.

    This method should be defined for any subtype of AbstractModel.

    See also: unregister.

    Example

    julia> model = Model();
    +2
    source

    object_dictionary

    JuMP.object_dictionaryFunction
    object_dictionary(model::GenericModel)

    Return the dictionary that maps the symbol name of a variable, constraint, or expression to the corresponding object.

    Objects are registered to a specific symbol in the macros. For example, @variable(model, x[1:2, 1:2]) registers the array of variables x to the symbol :x.

    This method should be defined for any subtype of AbstractModel.

    See also: unregister.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
     julia> object_dictionary(model)
     Dict{Symbol, Any} with 1 entry:
    -  :x => VariableRef[x[1], x[2]]
    source

    objective_bound

    JuMP.objective_boundFunction
    objective_bound(model::GenericModel)

    Return the best known bound on the optimal objective value after a call to optimize!(model).

    For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

    In the case of a vector-valued objective, this returns the ideal point, that is, the point obtained if each objective was optimized independently.

    This function is equivalent to querying the MOI.ObjectiveBound attribute.

    Example

    julia> import HiGHS
    +  :x => VariableRef[x[1], x[2]]
    source

    objective_bound

    JuMP.objective_boundFunction
    objective_bound(model::GenericModel)

    Return the best known bound on the optimal objective value after a call to optimize!(model).

    For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

    In the case of a vector-valued objective, this returns the ideal point, that is, the point obtained if each objective was optimized independently.

    This function is equivalent to querying the MOI.ObjectiveBound attribute.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1515,7 +1515,7 @@
     julia> optimize!(model)
     
     julia> objective_bound(model)
    -3.0
    source

    objective_function

    objective_function

    JuMP.objective_functionFunction
    objective_function(
         model::GenericModel,
         ::Type{F} = objective_function_type(model),
     ) where {F}

    Return an object of type F representing the objective function.

    Errors if the objective is not convertible to type F.

    This function is equivalent to querying the MOI.ObjectiveFunction{F} attribute.

    Example

    julia> model = Model();
    @@ -1535,21 +1535,21 @@
     julia> typeof(objective_function(model, QuadExpr))
     QuadExpr (alias for GenericQuadExpr{Float64, GenericVariableRef{Float64}})

    We see with the last two commands that even if the objective function is affine, as it is convertible to a quadratic function, it can be queried as a quadratic function and the result is quadratic.

    However, it is not convertible to a variable:

    julia> objective_function(model, VariableRef)
     ERROR: InexactError: convert(MathOptInterface.VariableIndex, 1.0 + 2.0 MOI.VariableIndex(1))
    -[...]
    source

    objective_function_string

    JuMP.objective_function_stringFunction
    objective_function_string(mode, model::AbstractModel)::String

    Return a String describing the objective function of the model.

    Example

    julia> model = Model();
    +[...]
    source

    objective_function_string

    JuMP.objective_function_stringFunction
    objective_function_string(mode, model::AbstractModel)::String

    Return a String describing the objective function of the model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> @objective(model, Min, 2 * x);
     
     julia> objective_function_string(MIME("text/plain"), model)
    -"2 x"
    source

    objective_function_type

    objective_function_type

    JuMP.objective_function_typeFunction
    objective_function_type(model::GenericModel)::AbstractJuMPScalar

    Return the type of the objective function.

    This function is equivalent to querying the MOI.ObjectiveFunctionType attribute.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> @objective(model, Min, 2 * x + 1);
     
     julia> objective_function_type(model)
    -AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
    source

    objective_sense

    JuMP.objective_senseFunction
    objective_sense(model::GenericModel)::MOI.OptimizationSense

    Return the objective sense.

    This function is equivalent to querying the MOI.ObjectiveSense attribute.

    Example

    julia> model = Model();
    +AffExpr (alias for GenericAffExpr{Float64, GenericVariableRef{Float64}})
    source

    objective_sense

    JuMP.objective_senseFunction
    objective_sense(model::GenericModel)::MOI.OptimizationSense

    Return the objective sense.

    This function is equivalent to querying the MOI.ObjectiveSense attribute.

    Example

    julia> model = Model();
     
     julia> objective_sense(model)
     FEASIBILITY_SENSE::OptimizationSense = 2
    @@ -1560,7 +1560,7 @@
     x
     
     julia> objective_sense(model)
    -MAX_SENSE::OptimizationSense = 1
    source

    objective_value

    JuMP.objective_valueFunction
    objective_value(model::GenericModel; result::Int = 1)

    Return the objective value associated with result index result of the most-recent solution returned by the solver.

    For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

    This function is equivalent to querying the MOI.ObjectiveValue attribute.

    See also: result_count.

    Example

    julia> import HiGHS
    +MAX_SENSE::OptimizationSense = 1
    source

    objective_value

    JuMP.objective_valueFunction
    objective_value(model::GenericModel; result::Int = 1)

    Return the objective value associated with result index result of the most-recent solution returned by the solver.

    For scalar-valued objectives, this function returns a Float64. For vector-valued objectives, it returns a Vector{Float64}.

    This function is equivalent to querying the MOI.ObjectiveValue attribute.

    See also: result_count.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1578,7 +1578,7 @@
     julia> objective_value(model; result = 2)
     ERROR: Result index of attribute MathOptInterface.ObjectiveValue(2) out of bounds. There are currently 1 solution(s) in the model.
     Stacktrace:
    -[...]
    source

    op_ifelse

    JuMP.op_ifelseFunction
    op_ifelse(a, x, y)

    A function that falls back to ifelse(a, x, y), but when called with a JuMP variables or expression in the first argument, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
    +[...]
    source

    op_ifelse

    JuMP.op_ifelseFunction
    op_ifelse(a, x, y)

    A function that falls back to ifelse(a, x, y), but when called with a JuMP variables or expression in the first argument, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1589,14 +1589,14 @@
     ifelse(x, 1.0, 2.0)
     
     julia> op_ifelse(true, x, 2.0)
    -x
    source

    op_string

    JuMP.op_stringFunction
    op_string(mime::MIME, x::GenericNonlinearExpr, ::Val{op}) where {op}

    Return the string that should be printed for the operator op when function_string is called with mime and x.

    Example

    julia> model = Model();
    +x
    source

    op_string

    JuMP.op_stringFunction
    op_string(mime::MIME, x::GenericNonlinearExpr, ::Val{op}) where {op}

    Return the string that should be printed for the operator op when function_string is called with mime and x.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2], Bin);
     
     julia> f = @expression(model, x[1] || x[2]);
     
     julia> op_string(MIME("text/plain"), f, Val(:||))
    -"||"
    source

    operator_to_set

    JuMP.operator_to_setFunction
    operator_to_set(error_fn::Function, ::Val{sense_symbol})

    Converts a sense symbol to a set set such that @constraint(model, func sense_symbol 0) is equivalent to @constraint(model, func in set) for any func::AbstractJuMPScalar.

    Example

    Once a custom set is defined you can directly create a JuMP constraint with it:

    julia> struct CustomSet{T} <: MOI.AbstractScalarSet
    +"||"
    source

    operator_to_set

    JuMP.operator_to_setFunction
    operator_to_set(error_fn::Function, ::Val{sense_symbol})

    Converts a sense symbol to a set set such that @constraint(model, func sense_symbol 0) is equivalent to @constraint(model, func in set) for any func::AbstractJuMPScalar.

    Example

    Once a custom set is defined you can directly create a JuMP constraint with it:

    julia> struct CustomSet{T} <: MOI.AbstractScalarSet
                value::T
            end
     
    @@ -1615,8 +1615,8 @@
     julia> MOIU.shift_constant(set::CustomSet, value) = CustomSet(set.value + value)
     
     julia> cref = @constraint(model, x ⊰ 1)
    -x ∈ CustomSet{Float64}(1.0)

    Note that the whole function is first moved to the right-hand side, then the sign is transformed into a set with zero constant and finally the constant is moved to the set with MOIU.shift_constant.

    source

    operator_warn

    JuMP.operator_warnFunction
    operator_warn(model::AbstractModel)
    -operator_warn(model::GenericModel)

    This function is called on the model whenever two affine expressions are added together without using destructive_add!, and at least one of the two expressions has more than 50 terms.

    For the case of Model, if this function is called more than 20,000 times then a warning is generated once.

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    optimize!

    JuMP.optimize!Function
    optimize!(
    +x ∈ CustomSet{Float64}(1.0)

    Note that the whole function is first moved to the right-hand side, then the sign is transformed into a set with zero constant and finally the constant is moved to the set with MOIU.shift_constant.

    source

    operator_warn

    JuMP.operator_warnFunction
    operator_warn(model::AbstractModel)
    +operator_warn(model::GenericModel)

    This function is called on the model whenever two affine expressions are added together without using destructive_add!, and at least one of the two expressions has more than 50 terms.

    For the case of Model, if this function is called more than 20,000 times then a warning is generated once.

    This method should only be implemented by developers creating JuMP extensions. It should never be called by users of JuMP.

    source

    optimize!

    JuMP.optimize!Function
    optimize!(
         model::GenericModel;
         ignore_optimize_hook = (model.optimize_hook === nothing),
         kwargs...,
    @@ -1636,7 +1636,7 @@
     my_optimize_hook (generic function with 1 method)
     
     julia> optimize!(model; foo = 2)
    -Hook called with foo = 2
    source

    optimizer_index

    optimizer_index

    JuMP.optimizer_indexFunction
    optimizer_index(x::GenericVariableRef)::MOI.VariableIndex
     optimizer_index(x::ConstraintRef{<:GenericModel})::MOI.ConstraintIndex

    Return the variable or constraint index that corresponds to x in the associated model unsafe_backend(owner_model(x)).

    This function should be used with unsafe_backend.

    As a safer alternative, use backend and index. See the docstrings of backend and unsafe_backend for more details.

    Throws

    • Throws NoOptimizer if no optimizer is set.
    • Throws an ErrorException if the optimizer is set but is not attached.
    • Throws an ErrorException if the index is bridged.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
    @@ -1652,7 +1652,7 @@
     A HiGHS model with 1 columns and 0 rows.
     
     julia> optimizer_index(x)
    -MOI.VariableIndex(1)
    source

    optimizer_with_attributes

    JuMP.optimizer_with_attributesFunction
    optimizer_with_attributes(optimizer_constructor, attrs::Pair...)

    Groups an optimizer constructor with the list of attributes attrs. Note that it is equivalent to MOI.OptimizerWithAttributes.

    When provided to the Model constructor or to set_optimizer, it creates an optimizer by calling optimizer_constructor(), and then sets the attributes using set_attribute.

    See also: set_attribute, get_attribute.

    Note

    The string names of the attributes are specific to each solver. One should consult the solver's documentation to find the attributes of interest.

    Example

    julia> import HiGHS
    +MOI.VariableIndex(1)
    source

    optimizer_with_attributes

    JuMP.optimizer_with_attributesFunction
    optimizer_with_attributes(optimizer_constructor, attrs::Pair...)

    Groups an optimizer constructor with the list of attributes attrs. Note that it is equivalent to MOI.OptimizerWithAttributes.

    When provided to the Model constructor or to set_optimizer, it creates an optimizer by calling optimizer_constructor(), and then sets the attributes using set_attribute.

    See also: set_attribute, get_attribute.

    Note

    The string names of the attributes are specific to each solver. One should consult the solver's documentation to find the attributes of interest.

    Example

    julia> import HiGHS
     
     julia> optimizer = optimizer_with_attributes(
                HiGHS.Optimizer, "presolve" => "off", MOI.Silent() => true,
    @@ -1664,12 +1664,12 @@
     
     julia> set_attribute(model, "presolve", "off")
     
    -julia> set_attribute(model, MOI.Silent(), true)
    source

    owner_model

    JuMP.owner_modelFunction
    owner_model(s::AbstractJuMPScalar)

    Return the model owning the scalar s.

    Example

    julia> model = Model();
    +julia> set_attribute(model, MOI.Silent(), true)
    source

    owner_model

    JuMP.owner_modelFunction
    owner_model(s::AbstractJuMPScalar)

    Return the model owning the scalar s.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> owner_model(x) === model
    -true
    source

    parameter_value

    parameter_value

    JuMP.parameter_valueFunction
    parameter_value(x::GenericVariableRef)

    Return the value of the parameter x.

    Errors if x is not a parameter.

    See also ParameterRef, is_parameter, set_parameter_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, p in Parameter(2))
     p
    @@ -1680,23 +1680,23 @@
     julia> set_parameter_value(p, 2.5)
     
     julia> parameter_value(p)
    -2.5
    source

    parse_constraint

    JuMP.parse_constraintFunction
    parse_constraint(error_fn::Function, expr::Expr)

    The entry-point for all constraint-related parsing.

    Arguments

    • The error_fn function is passed everywhere to provide better error messages
    • expr comes from the @constraint macro. There are two possibilities:
      • @constraint(model, expr)
      • @constraint(model, name[args], expr)
      In both cases, expr is the main component of the constraint.

    Supported syntax

    JuMP currently supports the following expr objects:

    • lhs <= rhs
    • lhs == rhs
    • lhs >= rhs
    • l <= body <= u
    • u >= body >= l
    • lhs ⟂ rhs
    • lhs in rhs
    • lhs ∈ rhs
    • z --> {constraint}
    • !z --> {constraint}
    • z <--> {constraint}
    • !z <--> {constraint}
    • z => {constraint}
    • !z => {constraint}

    as well as all broadcasted variants.

    Extensions

    The infrastructure behind parse_constraint is extendable. See parse_constraint_head and parse_constraint_call for details.

    source

    parse_constraint_call

    parse_constraint

    JuMP.parse_constraintFunction
    parse_constraint(error_fn::Function, expr::Expr)

    The entry-point for all constraint-related parsing.

    Arguments

    • The error_fn function is passed everywhere to provide better error messages
    • expr comes from the @constraint macro. There are two possibilities:
      • @constraint(model, expr)
      • @constraint(model, name[args], expr)
      In both cases, expr is the main component of the constraint.

    Supported syntax

    JuMP currently supports the following expr objects:

    • lhs <= rhs
    • lhs == rhs
    • lhs >= rhs
    • l <= body <= u
    • u >= body >= l
    • lhs ⟂ rhs
    • lhs in rhs
    • lhs ∈ rhs
    • z --> {constraint}
    • !z --> {constraint}
    • z <--> {constraint}
    • !z <--> {constraint}
    • z => {constraint}
    • !z => {constraint}

    as well as all broadcasted variants.

    Extensions

    The infrastructure behind parse_constraint is extendable. See parse_constraint_head and parse_constraint_call for details.

    source

    parse_constraint_call

    JuMP.parse_constraint_callFunction
    parse_constraint_call(
         error_fn::Function,
         is_vectorized::Bool,
         ::Val{op},
         args...,
    -)

    Implement this method to intercept the parsing of a :call expression with operator op.

    Warning

    Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

    Arguments

    • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
    • is_vectorized: a boolean to indicate if op should be broadcast or not
    • op: the first element of the .args field of the Expr to intercept
    • args...: the .args field of the Expr.

    Returns

    This function must return:

    • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
    • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

    See also: parse_constraint_head, build_constraint

    source
    parse_constraint_call(
    +)

    Implement this method to intercept the parsing of a :call expression with operator op.

    Warning

    Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

    Arguments

    • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
    • is_vectorized: a boolean to indicate if op should be broadcast or not
    • op: the first element of the .args field of the Expr to intercept
    • args...: the .args field of the Expr.

    Returns

    This function must return:

    • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
    • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

    See also: parse_constraint_head, build_constraint

    source
    parse_constraint_call(
         error_fn::Function,
         vectorized::Bool,
         ::Val{op},
         lhs,
         rhs,
    -) where {op}

    Fallback handler for binary operators. These might be infix operators like @constraint(model, lhs op rhs), or normal operators like @constraint(model, op(lhs, rhs)).

    In both cases, we rewrite as lhs - rhs in operator_to_set(error_fn, op).

    See operator_to_set for details.

    source

    parse_constraint_head

    JuMP.parse_constraint_headFunction
    parse_constraint_head(error_fn::Function, ::Val{head}, args...)

    Implement this method to intercept the parsing of an expression with head head.

    Warning

    Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

    Arguments

    • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
    • head: the .head field of the Expr to intercept
    • args...: the .args field of the Expr.

    Returns

    This function must return:

    • is_vectorized::Bool: whether the expression represents a broadcasted expression like x .<= 1
    • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
    • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

    Existing implementations

    JuMP currently implements:

    • ::Val{:call}, which forwards calls to parse_constraint_call
    • ::Val{:comparison}, which handles the special case of l <= body <= u.

    See also: parse_constraint_call, build_constraint

    source

    parse_one_operator_variable

    JuMP.parse_one_operator_variableFunction
    parse_one_operator_variable(
    +) where {op}

    Fallback handler for binary operators. These might be infix operators like @constraint(model, lhs op rhs), or normal operators like @constraint(model, op(lhs, rhs)).

    In both cases, we rewrite as lhs - rhs in operator_to_set(error_fn, op).

    See operator_to_set for details.

    source

    parse_constraint_head

    JuMP.parse_constraint_headFunction
    parse_constraint_head(error_fn::Function, ::Val{head}, args...)

    Implement this method to intercept the parsing of an expression with head head.

    Warning

    Extending the constraint macro at parse time is an advanced operation and has the potential to interfere with existing JuMP syntax. Please discuss with the developer chatroom before publishing any code that implements these methods.

    Arguments

    • error_fn: a function that accepts a String and throws the string as an error, along with some descriptive information of the macro from which it was thrown.
    • head: the .head field of the Expr to intercept
    • args...: the .args field of the Expr.

    Returns

    This function must return:

    • is_vectorized::Bool: whether the expression represents a broadcasted expression like x .<= 1
    • parse_code::Expr: an expression containing any setup or rewriting code that needs to be called before build_constraint
    • build_code::Expr: an expression that calls build_constraint( or build_constraint.( depending on is_vectorized.

    Existing implementations

    JuMP currently implements:

    • ::Val{:call}, which forwards calls to parse_constraint_call
    • ::Val{:comparison}, which handles the special case of l <= body <= u.

    See also: parse_constraint_call, build_constraint

    source

    parse_one_operator_variable

    JuMP.parse_one_operator_variableFunction
    parse_one_operator_variable(
         error_fn::Function,
         info_expr::_VariableInfoExpr,
         sense::Val{S},
         value,
    -) where {S}

    Update infoexr for a variable expression in the @variable macro of the form variable name S value.

    source

    parse_ternary_variable

    JuMP.parse_ternary_variableFunction
    parse_ternary_variable(error_fn, info_expr, lhs_sense, lhs, rhs_sense, rhs)

    A hook for JuMP extensions to intercept the parsing of a :comparison expression, which has the form lhs lhs_sense variable rhs_sense rhs.

    source

    parse_variable

    JuMP.parse_variableFunction
    parse_variable(error_fn::Function, ::_VariableInfoExpr, args...)

    A hook for extensions to intercept the parsing of inequality constraints in the @variable macro.

    source

    primal_feasibility_report

    JuMP.primal_feasibility_reportFunction
    primal_feasibility_report(
    +) where {S}

    Update infoexr for a variable expression in the @variable macro of the form variable name S value.

    source

    parse_ternary_variable

    JuMP.parse_ternary_variableFunction
    parse_ternary_variable(error_fn, info_expr, lhs_sense, lhs, rhs_sense, rhs)

    A hook for JuMP extensions to intercept the parsing of a :comparison expression, which has the form lhs lhs_sense variable rhs_sense rhs.

    source

    parse_variable

    JuMP.parse_variableFunction
    parse_variable(error_fn::Function, ::_VariableInfoExpr, args...)

    A hook for extensions to intercept the parsing of inequality constraints in the @variable macro.

    source

    primal_feasibility_report

    JuMP.primal_feasibility_reportFunction
    primal_feasibility_report(
         model::GenericModel{T},
         point::AbstractDict{GenericVariableRef{T},T} = _last_primal_solution(model),
         atol::T = zero(T),
    @@ -1707,7 +1707,7 @@
     
     julia> primal_feasibility_report(model, Dict(x => 0.2))
     Dict{Any, Float64} with 1 entry:
    -  x ≥ 0.5 => 0.3
    source
    primal_feasibility_report(
    +  x ≥ 0.5 => 0.3
    source
    primal_feasibility_report(
         point::Function,
         model::GenericModel{T};
         atol::T = zero(T),
    @@ -1720,30 +1720,30 @@
                return start_value(v)
            end
     Dict{Any, Float64} with 1 entry:
    -  x ≤ 1 => 0.3
    source

    primal_status

    primal_status

    JuMP.primal_statusFunction
    primal_status(model::GenericModel; result::Int = 1)

    Return a MOI.ResultStatusCode describing the status of the most recent primal solution of the solver (that is, the MOI.PrimalStatus attribute) associated with the result index result.

    See also: result_count.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
     julia> primal_status(model; result = 2)
    -NO_SOLUTION::ResultStatusCode = 0
    source
    JuMP.print_active_bridgesFunction
    print_active_bridges([io::IO = stdout,] model::GenericModel)

    Print a list of the variable, constraint, and objective bridges that are currently used in the model.

    source
    print_active_bridges([io::IO = stdout,] model::GenericModel, ::Type{F}) where {F}

    Print a list of bridges required for an objective function of type F.

    source
    print_active_bridges(
    +NO_SOLUTION::ResultStatusCode = 0
    source
    JuMP.print_active_bridgesFunction
    print_active_bridges([io::IO = stdout,] model::GenericModel)

    Print a list of the variable, constraint, and objective bridges that are currently used in the model.

    source
    print_active_bridges([io::IO = stdout,] model::GenericModel, ::Type{F}) where {F}

    Print a list of bridges required for an objective function of type F.

    source
    print_active_bridges(
         [io::IO = stdout,]
         model::GenericModel,
         F::Type,
         S::Type{<:MOI.AbstractSet},
    -)

    Print a list of bridges required for a constraint of type F-in-S.

    source
    print_active_bridges(
    +)

    Print a list of bridges required for a constraint of type F-in-S.

    source
    print_active_bridges(
         [io::IO = stdout,]
         model::GenericModel,
         S::Type{<:MOI.AbstractSet},
    -)

    Print a list of bridges required to add a variable constrained to the set S.

    source
    JuMP.print_bridge_graphFunction
     print_bridge_graph([io::IO,] model::GenericModel)

    Print the hyper-graph containing all variable, constraint, and objective types that could be obtained by bridging the variables, constraints, and objectives that are present in the model.

    Warning

    This function is intended for advanced users. If you want to see only the bridges that are currently used, use print_active_bridges instead.

    Explanation of output

    Each node in the hyper-graph corresponds to a variable, constraint, or objective type.

    • Variable nodes are indicated by [ ]
    • Constraint nodes are indicated by ( )
    • Objective nodes are indicated by | |

    The number inside each pair of brackets is an index of the node in the hyper-graph.

    Note that this hyper-graph is the full list of possible transformations. When the bridged model is created, we select the shortest hyper-path(s) from this graph, so many nodes may be un-used.

    For more information, see Legat, B., Dowson, O., Garcia, J., and Lubin, M. (2020). "MathOptInterface: a data structure for mathematical optimization problems." URL: https://arxiv.org/abs/2002.03447

    source

    quad_terms

    JuMP.quad_termsFunction
    quad_terms(quad::GenericQuadExpr{C,V})

    Provides an iterator over tuples (coefficient::C, var_1::V, var_2::V) in the quadratic part of the quadratic expression.

    source

    raw_status

    JuMP.raw_statusFunction
    raw_status(model::GenericModel)

    Return the reason why the solver stopped in its own words (that is, the MathOptInterface model attribute MOI.RawStatusString).

    Example

    julia> import Ipopt
    +)

    Print a list of bridges required to add a variable constrained to the set S.

    source
    JuMP.print_bridge_graphFunction
     print_bridge_graph([io::IO,] model::GenericModel)

    Print the hyper-graph containing all variable, constraint, and objective types that could be obtained by bridging the variables, constraints, and objectives that are present in the model.

    Warning

    This function is intended for advanced users. If you want to see only the bridges that are currently used, use print_active_bridges instead.

    Explanation of output

    Each node in the hyper-graph corresponds to a variable, constraint, or objective type.

    • Variable nodes are indicated by [ ]
    • Constraint nodes are indicated by ( )
    • Objective nodes are indicated by | |

    The number inside each pair of brackets is an index of the node in the hyper-graph.

    Note that this hyper-graph is the full list of possible transformations. When the bridged model is created, we select the shortest hyper-path(s) from this graph, so many nodes may be un-used.

    For more information, see Legat, B., Dowson, O., Garcia, J., and Lubin, M. (2020). "MathOptInterface: a data structure for mathematical optimization problems." URL: https://arxiv.org/abs/2002.03447

    source

    quad_terms

    JuMP.quad_termsFunction
    quad_terms(quad::GenericQuadExpr{C,V})

    Provides an iterator over tuples (coefficient::C, var_1::V, var_2::V) in the quadratic part of the quadratic expression.

    source

    raw_status

    JuMP.raw_statusFunction
    raw_status(model::GenericModel)

    Return the reason why the solver stopped in its own words (that is, the MathOptInterface model attribute MOI.RawStatusString).

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
     julia> raw_status(model)
    -"optimize not called"
    source

    read_from_file

    read_from_file

    JuMP.read_from_fileFunction
    read_from_file(
         filename::String;
         format::MOI.FileFormats.FileFormat = MOI.FileFormats.FORMAT_AUTOMATIC,
         kwargs...,
    -)

    Return a JuMP model read from filename in the format format.

    If the filename ends in .gz, it will be uncompressed using GZip. If the filename ends in .bz2, it will be uncompressed using BZip2.

    Other kwargs are passed to the Model constructor of the chosen format.

    source

    reduced_cost

    JuMP.reduced_costFunction
    reduced_cost(x::GenericVariableRef{T})::T where {T}

    Return the reduced cost associated with variable x.

    One interpretation of the reduced cost is that it is the change in the objective from an infinitesimal relaxation of the variable bounds.

    This method is equivalent to querying the shadow price of the active variable bound (if one exists and is active).

    See also: shadow_price.

    Example

    julia> import HiGHS
    +)

    Return a JuMP model read from filename in the format format.

    If the filename ends in .gz, it will be uncompressed using GZip. If the filename ends in .bz2, it will be uncompressed using BZip2.

    Other kwargs are passed to the Model constructor of the chosen format.

    source

    reduced_cost

    JuMP.reduced_costFunction
    reduced_cost(x::GenericVariableRef{T})::T where {T}

    Return the reduced cost associated with variable x.

    One interpretation of the reduced cost is that it is the change in the objective from an infinitesimal relaxation of the variable bounds.

    This method is equivalent to querying the shadow price of the active variable bound (if one exists and is active).

    See also: shadow_price.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1759,7 +1759,7 @@
     true
     
     julia> reduced_cost(x)
    -2.0
    source

    relative_gap

    JuMP.relative_gapFunction
    relative_gap(model::GenericModel)

    Return the final relative optimality gap after a call to optimize!(model).

    Exact value depends upon implementation of MOI.RelativeGap by the particular solver used for optimization.

    This function is equivalent to querying the MOI.RelativeGap attribute.

    Example

    julia> import HiGHS
    +2.0
    source

    relative_gap

    JuMP.relative_gapFunction
    relative_gap(model::GenericModel)

    Return the final relative optimality gap after a call to optimize!(model).

    Exact value depends upon implementation of MOI.RelativeGap by the particular solver used for optimization.

    This function is equivalent to querying the MOI.RelativeGap attribute.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -1772,7 +1772,7 @@
     julia> optimize!(model)
     
     julia> relative_gap(model)
    -0.0
    source

    relax_integrality

    JuMP.relax_integralityFunction
    relax_integrality(model::GenericModel)

    Modifies model to "relax" all binary and integrality constraints on variables. Specifically,

    • Binary constraints are deleted, and variable bounds are tightened if necessary to ensure the variable is constrained to the interval $[0, 1]$.
    • Integrality constraints are deleted without modifying variable bounds.
    • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
    • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

    Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

    Example

    julia> model = Model();
    +0.0
    source

    relax_integrality

    JuMP.relax_integralityFunction
    relax_integrality(model::GenericModel)

    Modifies model to "relax" all binary and integrality constraints on variables. Specifically,

    • Binary constraints are deleted, and variable bounds are tightened if necessary to ensure the variable is constrained to the interval $[0, 1]$.
    • Integrality constraints are deleted without modifying variable bounds.
    • An error is thrown if semi-continuous or semi-integer constraints are present (support may be added for these in the future).
    • All other constraints are ignored (left in place). This includes discrete constraints like SOS and indicator constraints.

    Returns a function that can be called without any arguments to restore the original model. The behavior of this function is undefined if additional changes are made to the affected variables in the meantime.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, Bin);
     
    @@ -1798,7 +1798,7 @@
      y ≥ 1
      y ≤ 10
      y integer
    - x binary
    source

    relax_with_penalty!

    relax_with_penalty!

    JuMP.relax_with_penalty!Function
    relax_with_penalty!(
         model::GenericModel{T},
         [penalties::Dict{ConstraintRef,T}];
         [default::Union{Nothing,Real} = nothing,]
    @@ -1841,7 +1841,7 @@
     Subject to
      c2 : 3 x + _[2] ≥ 0
      c1 : 2 x ≤ -1
    - _[2] ≥ 0
    source

    remove_bridge

    remove_bridge

    JuMP.remove_bridgeFunction
    remove_bridge(
         model::GenericModel{S},
         BT::Type{<:MOI.Bridges.AbstractBridge};
         coefficient_type::Type{T} = S,
    @@ -1861,17 +1861,17 @@
                model,
                MOI.Bridges.Constraint.NumberConversionBridge;
                coefficient_type = Complex{Float64},
    -       )
    source

    reshape_set

    JuMP.reshape_setFunction
    reshape_set(vectorized_set::MOI.AbstractSet, shape::AbstractShape)

    Return a set in its original shape shape given its vectorized form vectorized_form.

    Example

    Given a SymmetricMatrixShape of vectorized form [1, 2, 3] in MOI.PositiveSemidefinieConeTriangle(2), the following code returns the set of the original constraint Symmetric(Matrix[1 2; 2 3]) in PSDCone():

    julia> reshape_set(MOI.PositiveSemidefiniteConeTriangle(2), SymmetricMatrixShape(2))
    -PSDCone()
    source

    reshape_vector

    JuMP.reshape_vectorFunction
    reshape_vector(vectorized_form::Vector, shape::AbstractShape)

    Return an object in its original shape shape given its vectorized form vectorized_form.

    Example

    Given a SymmetricMatrixShape of vectorized form [1, 2, 3], the following code returns the matrix Symmetric(Matrix[1 2; 2 3]):

    julia> reshape_vector([1, 2, 3], SymmetricMatrixShape(2))
    +       )
    source

    reshape_set

    JuMP.reshape_setFunction
    reshape_set(vectorized_set::MOI.AbstractSet, shape::AbstractShape)

    Return a set in its original shape shape given its vectorized form vectorized_form.

    Example

    Given a SymmetricMatrixShape of vectorized form [1, 2, 3] in MOI.PositiveSemidefinieConeTriangle(2), the following code returns the set of the original constraint Symmetric(Matrix[1 2; 2 3]) in PSDCone():

    julia> reshape_set(MOI.PositiveSemidefiniteConeTriangle(2), SymmetricMatrixShape(2))
    +PSDCone()
    source

    reshape_vector

    JuMP.reshape_vectorFunction
    reshape_vector(vectorized_form::Vector, shape::AbstractShape)

    Return an object in its original shape shape given its vectorized form vectorized_form.

    Example

    Given a SymmetricMatrixShape of vectorized form [1, 2, 3], the following code returns the matrix Symmetric(Matrix[1 2; 2 3]):

    julia> reshape_vector([1, 2, 3], SymmetricMatrixShape(2))
     2×2 LinearAlgebra.Symmetric{Int64, Matrix{Int64}}:
      1  2
    - 2  3
    source

    result_count

    JuMP.result_countFunction
    result_count(model::GenericModel)

    Return the number of results available to query after a call to optimize!.

    Example

    julia> import Ipopt
    + 2  3
    source

    result_count

    JuMP.result_countFunction
    result_count(model::GenericModel)

    Return the number of results available to query after a call to optimize!.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
     julia> result_count(model)
    -0
    source

    reverse_sense

    JuMP.reverse_senseFunction
    reverse_sense(::Val{T}) where {T}

    Given an (in)equality symbol T, return a new Val object with the opposite (in)equality symbol.

    This function is intended for use in JuMP extensions.

    Example

    julia> reverse_sense(Val(:>=))
    -Val{:<=}()
    source

    set_attribute

    reverse_sense

    JuMP.reverse_senseFunction
    reverse_sense(::Val{T}) where {T}

    Given an (in)equality symbol T, return a new Val object with the opposite (in)equality symbol.

    This function is intended for use in JuMP extensions.

    Example

    julia> reverse_sense(Val(:>=))
    +Val{:<=}()
    source

    set_attribute

    JuMP.set_attributeFunction
    set_attribute(model::GenericModel, attr::MOI.AbstractModelAttribute, value)
     set_attribute(x::GenericVariableRef, attr::MOI.AbstractVariableAttribute, value)
     set_attribute(cr::ConstraintRef, attr::MOI.AbstractConstraintAttribute, value)

    Set the value of a solver-specifc attribute attr to value.

    This is equivalent to calling MOI.set with the associated MOI model and, for variables and constraints, with the associated MOI.VariableIndex or MOI.ConstraintIndex.

    Example

    julia> model = Model();
     
    @@ -1885,7 +1885,7 @@
     
     julia> set_attribute(x, MOI.VariableName(), "x_new")
     
    -julia> set_attribute(c, MOI.ConstraintName(), "c_new")
    source
    set_attribute(
    +julia> set_attribute(c, MOI.ConstraintName(), "c_new")
    source
    set_attribute(
         model::Union{GenericModel,MOI.OptimizerWithAttributes},
         attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
         value,
    @@ -1901,7 +1901,7 @@
     
     julia> set_attribute(opt, "output_flag", true)
     
    -julia> set_attribute(opt, MOI.RawOptimizerAttribute("output_flag"), false)
    source

    set_attributes

    JuMP.set_attributesFunction
    set_attributes(
    +julia> set_attribute(opt, MOI.RawOptimizerAttribute("output_flag"), false)
    source

    set_attributes

    JuMP.set_attributesFunction
    set_attributes(
         destination::Union{
             GenericModel,
             MOI.OptimizerWithAttributes,
    @@ -1919,7 +1919,7 @@
     
     julia> set_attribute(model, "tol", 1e-4)
     
    -julia> set_attribute(model, "max_iter", 100)
    source

    set_binary

    JuMP.set_binaryFunction
    set_binary(v::GenericVariableRef)

    Add a constraint on the variable v that it must take values in the set $\{0,1\}$.

    See also BinaryRef, is_binary, unset_binary.

    Example

    julia> model = Model();
    +julia> set_attribute(model, "max_iter", 100)
    source

    set_binary

    JuMP.set_binaryFunction
    set_binary(v::GenericVariableRef)

    Add a constraint on the variable v that it must take values in the set $\{0,1\}$.

    See also BinaryRef, is_binary, unset_binary.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1929,7 +1929,7 @@
     julia> set_binary(x)
     
     julia> is_binary(x)
    -true
    source

    set_dual_start_value

    JuMP.set_dual_start_valueFunction
    set_dual_start_value(con_ref::ConstraintRef, value)

    Set the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref to value.

    To remove a dual start value set it to nothing.

    See also dual_start_value.

    Example

    julia> model = Model();
    +true
    source

    set_dual_start_value

    JuMP.set_dual_start_valueFunction
    set_dual_start_value(con_ref::ConstraintRef, value)

    Set the dual start value (MOI attribute ConstraintDualStart) of the constraint con_ref to value.

    To remove a dual start value set it to nothing.

    See also dual_start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 2.0);
     
    @@ -1944,7 +1944,7 @@
     
     julia> set_dual_start_value(c, nothing)
     
    -julia> dual_start_value(c)
    source

    set_integer

    set_integer

    JuMP.set_integerFunction
    set_integer(variable_ref::GenericVariableRef)

    Add an integrality constraint on the variable variable_ref.

    See also IntegerRef, is_integer, unset_integer.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1954,7 +1954,7 @@
     julia> set_integer(x)
     
     julia> is_integer(x)
    -true
    source

    set_lower_bound

    set_lower_bound

    set_name

    JuMP.set_nameFunction
    set_name(con_ref::ConstraintRef, s::AbstractString)

    Set a constraint's name attribute.

    Example

    julia> model = Model();
    +2.0
    source

    set_name

    JuMP.set_nameFunction
    set_name(con_ref::ConstraintRef, s::AbstractString)

    Set a constraint's name attribute.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -1977,7 +1977,7 @@
     "my_constraint"
     
     julia> c
    -my_constraint : [2 x] ∈ Nonnegatives()
    source
    set_name(v::GenericVariableRef, s::AbstractString)

    Set a variable's name attribute.

    Example

    julia> model = Model();
    +my_constraint : [2 x] ∈ Nonnegatives()
    source
    set_name(v::GenericVariableRef, s::AbstractString)

    Set a variable's name attribute.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -1988,7 +1988,7 @@
     x_foo
     
     julia> name(x)
    -"x_foo"
    source

    set_normalized_coefficient

    set_normalized_coefficient

    JuMP.set_normalized_coefficientFunction
    set_normalized_coefficient(
         constraint::ConstraintRef,
         variable::GenericVariableRef,
         value::Number,
    @@ -2003,7 +2003,7 @@
     julia> set_normalized_coefficient(con, x, 4)
     
     julia> con
    -con : 4 x ≤ 2
    source
    set_normalized_coefficient(
    +con : 4 x ≤ 2
    source
    set_normalized_coefficient(
         constraints::AbstractVector{<:ConstraintRef},
         variables::AbstractVector{<:GenericVariableRef},
         values::AbstractVector{<:Number},
    @@ -2021,7 +2021,7 @@
     julia> set_normalized_coefficient([con, con], [x, y], [6, 7])
     
     julia> con
    -con : 6 x + 7 y ≤ 2
    source
    set_normalized_coefficient(
    +con : 6 x + 7 y ≤ 2
    source
    set_normalized_coefficient(
         con_ref::ConstraintRef,
         variable::AbstractVariableRef,
         new_coefficients::Vector{Tuple{Int64,T}},
    @@ -2036,7 +2036,7 @@
     julia> set_normalized_coefficient(con, x, [(1, 2.0), (2, 5.0)])
     
     julia> con
    -con : [2 x, 5 x] ∈ MathOptInterface.Nonnegatives(2)
    source
    set_normalized_coefficient(
    +con : [2 x, 5 x] ∈ MathOptInterface.Nonnegatives(2)
    source
    set_normalized_coefficient(
         constraint::ConstraintRef,
         variable_1:GenericVariableRef,
         variable_2:GenericVariableRef,
    @@ -2053,7 +2053,7 @@
     julia> set_normalized_coefficient(con, x[1], x[2], 5)
     
     julia> con
    -con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
    source
    set_normalized_coefficient(
    +con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
    source
    set_normalized_coefficient(
         constraints::AbstractVector{<:ConstraintRef},
         variables_1:AbstractVector{<:GenericVariableRef},
         variables_2:AbstractVector{<:GenericVariableRef},
    @@ -2068,7 +2068,7 @@
     julia> set_normalized_coefficient([con, con], [x[1], x[1]], [x[1], x[2]], [4, 5])
     
     julia> con
    -con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
    source

    set_normalized_rhs

    JuMP.set_normalized_rhsFunction
    set_normalized_rhs(constraint::ConstraintRef, value::Number)

    Set the right-hand side term of constraint to value.

    Note that prior to this step, JuMP will aggregate all constant terms onto the right-hand side of the constraint. For example, given a constraint 2x + 1 <= 2, set_normalized_rhs(con, 4) will create the constraint 2x <= 4, not 2x + 1 <= 4.

    Example

    julia> model = Model();
    +con : 4 x[1]² + 5 x[1]*x[2] + x[2] ≤ 2
    source

    set_normalized_rhs

    JuMP.set_normalized_rhsFunction
    set_normalized_rhs(constraint::ConstraintRef, value::Number)

    Set the right-hand side term of constraint to value.

    Note that prior to this step, JuMP will aggregate all constant terms onto the right-hand side of the constraint. For example, given a constraint 2x + 1 <= 2, set_normalized_rhs(con, 4) will create the constraint 2x <= 4, not 2x + 1 <= 4.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -2078,7 +2078,7 @@
     julia> set_normalized_rhs(con, 4)
     
     julia> con
    -con : 2 x ≤ 4
    source
    set_normalized_rhs(
    +con : 2 x ≤ 4
    source
    set_normalized_rhs(
         constraints::AbstractVector{<:ConstraintRef},
         values::AbstractVector{<:Number}
     )

    Set the right-hand side terms of all constraints to values.

    Note that prior to this step, JuMP will aggregate all constant terms onto the right-hand side of the constraint. For example, given a constraint 2x + 1 <= 2, set_normalized_rhs([con], [4]) will create the constraint 2x <= 4, not 2x + 1 <= 4.

    Example

    julia> model = Model();
    @@ -2097,12 +2097,12 @@
     con1 : 2 x ≤ 4
     
     julia> con2
    -con2 : 3 x ≤ 5
    source

    set_objective

    set_objective

    JuMP.set_objectiveFunction
    set_objective(model::AbstractModel, sense::MOI.OptimizationSense, func)

    The functional equivalent of the @objective macro.

    Sets the objective sense and objective function simultaneously, and is equivalent to calling set_objective_sense and set_objective_function separately.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
     
    -julia> set_objective(model, MIN_SENSE, x)
    source

    set_objective_coefficient

    set_objective_coefficient

    JuMP.set_objective_coefficientFunction
    set_objective_coefficient(
         model::GenericModel,
         variable::GenericVariableRef,
         coefficient::Real,
    @@ -2116,7 +2116,7 @@
     julia> set_objective_coefficient(model, x, 3)
     
     julia> objective_function(model)
    -3 x + 1
    source
    set_objective_coefficient(
    +3 x + 1
    source
    set_objective_coefficient(
         model::GenericModel,
         variables::Vector{<:GenericVariableRef},
         coefficients::Vector{<:Real},
    @@ -2132,7 +2132,7 @@
     julia> set_objective_coefficient(model, [x, y], [5, 4])
     
     julia> objective_function(model)
    -5 x + 4 y + 1
    source
    set_objective_coefficient(
    +5 x + 4 y + 1
    source
    set_objective_coefficient(
         model::GenericModel{T},
         variable_1::GenericVariableRef{T},
         variable_2::GenericVariableRef{T},
    @@ -2149,7 +2149,7 @@
     julia> set_objective_coefficient(model, x[1], x[2], 3)
     
     julia> objective_function(model)
    -2 x[1]² + 3 x[1]*x[2]
    source
    set_objective_coefficient(
    +2 x[1]² + 3 x[1]*x[2]
    source
    set_objective_coefficient(
         model::GenericModel{T},
         variables_1::AbstractVector{<:GenericVariableRef{T}},
         variables_2::AbstractVector{<:GenericVariableRef{T}},
    @@ -2164,7 +2164,7 @@
     julia> set_objective_coefficient(model, [x[1], x[1]], [x[1], x[2]], [2, 3])
     
     julia> objective_function(model)
    -2 x[1]² + 3 x[1]*x[2]
    source

    set_objective_function

    set_objective_function

    JuMP.set_objective_functionFunction
    set_objective_function(model::GenericModel, func::MOI.AbstractFunction)
     set_objective_function(model::GenericModel, func::AbstractJuMPScalar)
     set_objective_function(model::GenericModel, func::Real)
     set_objective_function(model::GenericModel, func::Vector{<:AbstractJuMPScalar})

    Sets the objective function of the model to the given function.

    See set_objective_sense to set the objective sense.

    These are low-level functions; the recommended way to set the objective is with the @objective macro.

    Example

    julia> model = Model();
    @@ -2179,7 +2179,7 @@
     julia> set_objective_function(model, 2 * x + 1)
     
     julia> objective_function(model)
    -2 x + 1
    source

    set_objective_sense

    JuMP.set_objective_senseFunction
    set_objective_sense(model::GenericModel, sense::MOI.OptimizationSense)

    Sets the objective sense of the model to the given sense.

    See set_objective_function to set the objective function.

    These are low-level functions; the recommended way to set the objective is with the @objective macro.

    Example

    julia> model = Model();
    +2 x + 1
    source

    set_objective_sense

    JuMP.set_objective_senseFunction
    set_objective_sense(model::GenericModel, sense::MOI.OptimizationSense)

    Sets the objective sense of the model to the given sense.

    See set_objective_function to set the objective function.

    These are low-level functions; the recommended way to set the objective is with the @objective macro.

    Example

    julia> model = Model();
     
     julia> objective_sense(model)
     FEASIBILITY_SENSE::OptimizationSense = 2
    @@ -2187,7 +2187,7 @@
     julia> set_objective_sense(model, MOI.MAX_SENSE)
     
     julia> objective_sense(model)
    -MAX_SENSE::OptimizationSense = 1
    source

    set_optimize_hook

    JuMP.set_optimize_hookFunction
    set_optimize_hook(model::GenericModel, f::Union{Function,Nothing})

    Set the function f as the optimize hook for model.

    f should have a signature f(model::GenericModel; kwargs...), where the kwargs are those passed to optimize!.

    Notes

    • The optimize hook should generally modify the model, or some external state in some way, and then call optimize!(model; ignore_optimize_hook = true) to optimize the problem, bypassing the hook.
    • Use set_optimize_hook(model, nothing) to unset an optimize hook.

    Example

    julia> model = Model();
    +MAX_SENSE::OptimizationSense = 1
    source

    set_optimize_hook

    JuMP.set_optimize_hookFunction
    set_optimize_hook(model::GenericModel, f::Union{Function,Nothing})

    Set the function f as the optimize hook for model.

    f should have a signature f(model::GenericModel; kwargs...), where the kwargs are those passed to optimize!.

    Notes

    • The optimize hook should generally modify the model, or some external state in some way, and then call optimize!(model; ignore_optimize_hook = true) to optimize the problem, bypassing the hook.
    • Use set_optimize_hook(model, nothing) to unset an optimize hook.

    Example

    julia> model = Model();
     
     julia> function my_hook(model::Model; kwargs...)
                println(kwargs)
    @@ -2204,7 +2204,7 @@
     Base.Pairs{Symbol, Bool, Tuple{Symbol}, @NamedTuple{test_arg::Bool}}(:test_arg => 1)
     Calling with `ignore_optimize_hook = true`
     ERROR: NoOptimizer()
    -[...]
    source

    set_optimizer

    set_optimizer

    JuMP.set_optimizerFunction
    set_optimizer(
         model::GenericModel,
         optimizer_factory;
         add_bridges::Bool = true,
    @@ -2214,7 +2214,7 @@
     
     julia> set_optimizer(model, () -> HiGHS.Optimizer())
     
    -julia> set_optimizer(model, HiGHS.Optimizer; add_bridges = false)
    source

    set_parameter_value

    set_parameter_value

    JuMP.set_parameter_valueFunction
    set_parameter_value(x::GenericVariableRef, value)

    Update the parameter constraint on the variable x to value.

    Errors if x is not a parameter.

    See also ParameterRef, is_parameter, parameter_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, p in Parameter(2))
     p
    @@ -2225,7 +2225,7 @@
     julia> set_parameter_value(p, 2.5)
     
     julia> parameter_value(p)
    -2.5
    source

    set_silent

    JuMP.set_silentFunction
    set_silent(model::GenericModel)

    Takes precedence over any other attribute controlling verbosity and requires the solver to produce no output.

    See also: unset_silent.

    Example

    julia> import Ipopt
    +2.5
    source

    set_silent

    JuMP.set_silentFunction
    set_silent(model::GenericModel)

    Takes precedence over any other attribute controlling verbosity and requires the solver to produce no output.

    See also: unset_silent.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -2237,7 +2237,7 @@
     julia> unset_silent(model)
     
     julia> get_attribute(model, MOI.Silent())
    -false
    source

    set_start_value

    set_start_value

    JuMP.set_start_valueFunction
    set_start_value(con_ref::ConstraintRef, value)

    Set the primal start value (MOI.ConstraintPrimalStart) of the constraint con_ref to value.

    To remove a primal start value set it to nothing.

    See also start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 2.0);
     
    @@ -2252,7 +2252,7 @@
     
     julia> set_start_value(c, nothing)
     
    -julia> start_value(c)
    source
    set_start_value(variable::GenericVariableRef, value::Union{Real,Nothing})

    Set the start value (MOI.VariablePrimalStart) of the variable to value.

    Pass nothing to unset the start value.

    Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

    See also: has_start_value, start_value.

    Example

    julia> model = Model();
    +julia> start_value(c)
    source
    set_start_value(variable::GenericVariableRef, value::Union{Real,Nothing})

    Set the start value (MOI.VariablePrimalStart) of the variable to value.

    Pass nothing to unset the start value.

    Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

    See also: has_start_value, start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 1.5);
     
    @@ -2278,13 +2278,13 @@
     true
     
     julia> start_value(y)
    -2.0
    source

    set_start_values

    set_start_values

    JuMP.set_start_valuesFunction
    set_start_values(
         model::GenericModel;
         variable_primal_start::Union{Nothing,Function} = value,
         constraint_primal_start::Union{Nothing,Function} = value,
         constraint_dual_start::Union{Nothing,Function} = dual,
         nonlinear_dual_start::Union{Nothing,Function} = nonlinear_dual_start_value,
    -)

    Set the primal and dual starting values in model using the functions provided.

    If any keyword argument is nothing, the corresponding start value is skipped.

    If the optimizer does not support setting the starting value, the value will be skipped.

    variable_primal_start

    This function controls the primal starting solution for the variables. It is equivalent to calling set_start_value for each variable, or setting the MOI.VariablePrimalStart attribute.

    If it is a function, it must have the form variable_primal_start(x::VariableRef) that maps each variable x to the starting primal value.

    The default is value.

    constraint_primal_start

    This function controls the primal starting solution for the constraints. It is equivalent to calling set_start_value for each constraint, or setting the MOI.ConstraintPrimalStart attribute.

    If it is a function, it must have the form constraint_primal_start(ci::ConstraintRef) that maps each constraint ci to the starting primal value.

    The default is value.

    constraint_dual_start

    This function controls the dual starting solution for the constraints. It is equivalent to calling set_dual_start_value for each constraint, or setting the MOI.ConstraintDualStart attribute.

    If it is a function, it must have the form constraint_dual_start(ci::ConstraintRef) that maps each constraint ci to the starting dual value.

    The default is dual.

    nonlinear_dual_start

    This function controls the dual starting solution for the nonlinear constraints It is equivalent to calling set_nonlinear_dual_start_value.

    If it is a function, it must have the form nonlinear_dual_start(model::GenericModel) that returns a vector corresponding to the dual start of the constraints.

    The default is nonlinear_dual_start_value.

    source

    set_string_names_on_creation

    JuMP.set_string_names_on_creationFunction
    set_string_names_on_creation(model::GenericModel, value::Bool)

    Set the default argument of the set_string_name keyword in the @variable and @constraint macros to value.

    The set_string_name keyword is used to determine whether to assign String names to all variables and constraints in model.

    By default, value is true. However, for larger models calling set_string_names_on_creation(model, false) can improve performance at the cost of reducing the readability of printing and solver log messages.

    Example

    julia> import HiGHS
    +)

    Set the primal and dual starting values in model using the functions provided.

    If any keyword argument is nothing, the corresponding start value is skipped.

    If the optimizer does not support setting the starting value, the value will be skipped.

    variable_primal_start

    This function controls the primal starting solution for the variables. It is equivalent to calling set_start_value for each variable, or setting the MOI.VariablePrimalStart attribute.

    If it is a function, it must have the form variable_primal_start(x::VariableRef) that maps each variable x to the starting primal value.

    The default is value.

    constraint_primal_start

    This function controls the primal starting solution for the constraints. It is equivalent to calling set_start_value for each constraint, or setting the MOI.ConstraintPrimalStart attribute.

    If it is a function, it must have the form constraint_primal_start(ci::ConstraintRef) that maps each constraint ci to the starting primal value.

    The default is value.

    constraint_dual_start

    This function controls the dual starting solution for the constraints. It is equivalent to calling set_dual_start_value for each constraint, or setting the MOI.ConstraintDualStart attribute.

    If it is a function, it must have the form constraint_dual_start(ci::ConstraintRef) that maps each constraint ci to the starting dual value.

    The default is dual.

    nonlinear_dual_start

    This function controls the dual starting solution for the nonlinear constraints It is equivalent to calling set_nonlinear_dual_start_value.

    If it is a function, it must have the form nonlinear_dual_start(model::GenericModel) that returns a vector corresponding to the dual start of the constraints.

    The default is nonlinear_dual_start_value.

    source

    set_string_names_on_creation

    JuMP.set_string_names_on_creationFunction
    set_string_names_on_creation(model::GenericModel, value::Bool)

    Set the default argument of the set_string_name keyword in the @variable and @constraint macros to value.

    The set_string_name keyword is used to determine whether to assign String names to all variables and constraints in model.

    By default, value is true. However, for larger models calling set_string_names_on_creation(model, false) can improve performance at the cost of reducing the readability of printing and solver log messages.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -2294,7 +2294,7 @@
     julia> set_string_names_on_creation(model, false)
     
     julia> set_string_names_on_creation(model)
    -false
    source

    set_time_limit_sec

    set_time_limit_sec

    set_upper_bound

    set_upper_bound

    shadow_price

    JuMP.shadow_priceFunction
    shadow_price(con_ref::ConstraintRef)

    Return the change in the objective from an infinitesimal relaxation of the constraint.

    The shadow price is computed from dual and can be queried only when has_duals is true and the objective sense is MIN_SENSE or MAX_SENSE (not FEASIBILITY_SENSE).

    See also reduced_cost.

    Comparison to dual

    The shadow prices differ at most in sign from the dual value depending on the objective sense. The differences are summarized in the table:

    MinMax
    f(x) <= b+1-1
    f(x) >= b-1+1

    Notes

    • The function simply translates signs from dual and does not validate the conditions needed to guarantee the sensitivity interpretation of the shadow price. The caller is responsible, for example, for checking whether the solver converged to an optimal primal-dual pair or a proof of infeasibility.
    • The computation is based on the current objective sense of the model. If this has changed since the last solve, the results will be incorrect.
    • Relaxation of equality constraints (and hence the shadow price) is defined based on which sense of the equality constraint is active.

    Example

    julia> import HiGHS
    +2.0
    source

    shadow_price

    JuMP.shadow_priceFunction
    shadow_price(con_ref::ConstraintRef)

    Return the change in the objective from an infinitesimal relaxation of the constraint.

    The shadow price is computed from dual and can be queried only when has_duals is true and the objective sense is MIN_SENSE or MAX_SENSE (not FEASIBILITY_SENSE).

    See also reduced_cost.

    Comparison to dual

    The shadow prices differ at most in sign from the dual value depending on the objective sense. The differences are summarized in the table:

    MinMax
    f(x) <= b+1-1
    f(x) >= b-1+1

    Notes

    • The function simply translates signs from dual and does not validate the conditions needed to guarantee the sensitivity interpretation of the shadow price. The caller is responsible, for example, for checking whether the solver converged to an optimal primal-dual pair or a proof of infeasibility.
    • The computation is based on the current objective sense of the model. If this has changed since the last solve, the results will be incorrect.
    • Relaxation of equality constraints (and hence the shadow price) is defined based on which sense of the equality constraint is active.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -2336,7 +2336,7 @@
     true
     
     julia> shadow_price(c)
    -2.0
    source

    shape

    JuMP.shapeFunction
    shape(c::AbstractConstraint)::AbstractShape

    Return the shape of the constraint c.

    Example

    julia> model = Model();
    +2.0
    source

    shape

    JuMP.shapeFunction
    shape(c::AbstractConstraint)::AbstractShape

    Return the shape of the constraint c.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -2348,20 +2348,20 @@
     julia> d = @constraint(model, x in SOS1());
     
     julia> shape(constraint_object(d))
    -VectorShape()
    source

    show_backend_summary

    JuMP.show_backend_summaryFunction
    show_backend_summary(io::IO, model::GenericModel)

    Print a summary of the optimizer backing model.

    Extensions

    AbstractModels should implement this method.

    Example

    julia> model = Model();
    +VectorShape()
    source

    show_backend_summary

    JuMP.show_backend_summaryFunction
    show_backend_summary(io::IO, model::GenericModel)

    Print a summary of the optimizer backing model.

    Extensions

    AbstractModels should implement this method.

    Example

    julia> model = Model();
     
     julia> show_backend_summary(stdout, model)
     Model mode: AUTOMATIC
     CachingOptimizer state: NO_OPTIMIZER
    -Solver name: No optimizer attached.
    source

    show_constraints_summary

    JuMP.show_constraints_summaryFunction
    show_constraints_summary(io::IO, model::AbstractModel)

    Write to io a summary of the number of constraints.

    Extensions

    AbstractModels should implement this method.

    Example

    julia> model = Model();
    +Solver name: No optimizer attached.
    source

    show_constraints_summary

    JuMP.show_constraints_summaryFunction
    show_constraints_summary(io::IO, model::AbstractModel)

    Write to io a summary of the number of constraints.

    Extensions

    AbstractModels should implement this method.

    Example

    julia> model = Model();
     
     julia> @variable(model, x >= 0);
     
     julia> show_constraints_summary(stdout, model)
    -`VariableRef`-in-`MathOptInterface.GreaterThan{Float64}`: 1 constraint
    source

    show_objective_function_summary

    JuMP.show_objective_function_summaryFunction
    show_objective_function_summary(io::IO, model::AbstractModel)

    Write to io a summary of the objective function type.

    Extensions

    AbstractModels should implement this method.

    Example

    julia> model = Model();
    +`VariableRef`-in-`MathOptInterface.GreaterThan{Float64}`: 1 constraint
    source

    show_objective_function_summary

    JuMP.show_objective_function_summaryFunction
    show_objective_function_summary(io::IO, model::AbstractModel)

    Write to io a summary of the objective function type.

    Extensions

    AbstractModels should implement this method.

    Example

    julia> model = Model();
     
     julia> show_objective_function_summary(stdout, model)
    -Objective function type: AffExpr
    source

    simplex_iterations

    JuMP.simplex_iterationsFunction
    simplex_iterations(model::GenericModel)

    If available, returns the cumulative number of simplex iterations during the most-recent optimization (the MOI.SimplexIterations attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
    +Objective function type: AffExpr
    source

    simplex_iterations

    JuMP.simplex_iterationsFunction
    simplex_iterations(model::GenericModel)

    If available, returns the cumulative number of simplex iterations during the most-recent optimization (the MOI.SimplexIterations attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -2370,7 +2370,7 @@
     julia> optimize!(model)
     
     julia> simplex_iterations(model)
    -0
    source

    solution_summary

    JuMP.solution_summaryFunction
    solution_summary(model::GenericModel; result::Int = 1, verbose::Bool = false)

    Return a struct that can be used print a summary of the solution in result result.

    If verbose=true, write out the primal solution for every variable and the dual solution for every constraint, excluding those with empty names.

    Example

    When called at the REPL, the summary is automatically printed:

    julia> model = Model();
    +0
    source

    solution_summary

    JuMP.solution_summaryFunction
    solution_summary(model::GenericModel; result::Int = 1, verbose::Bool = false)

    Return a struct that can be used print a summary of the solution in result result.

    If verbose=true, write out the primal solution for every variable and the dual solution for every constraint, excluding those with empty names.

    Example

    When called at the REPL, the summary is automatically printed:

    julia> model = Model();
     
     julia> solution_summary(model)
     * Solver : No optimizer attached.
    @@ -2406,7 +2406,7 @@
       Primal status      : NO_SOLUTION
       Dual status        : NO_SOLUTION
     
    -* Work counters
    source

    solve_time

    JuMP.solve_timeFunction
    solve_time(model::GenericModel)

    If available, returns the solve time in wall-clock seconds reported by the solver (the MOI.SolveTimeSec attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
    +* Work counters
    source

    solve_time

    JuMP.solve_timeFunction
    solve_time(model::GenericModel)

    If available, returns the solve time in wall-clock seconds reported by the solver (the MOI.SolveTimeSec attribute).

    Throws a MOI.GetAttributeNotAllowed error if the attribute is not implemented by the solver.

    Example

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer);
     
    @@ -2415,7 +2415,7 @@
     julia> optimize!(model)
     
     julia> solve_time(model)
    -1.0488089174032211e-5
    source

    solver_name

    JuMP.solver_nameFunction
    solver_name(model::GenericModel)

    If available, returns the MOI.SolverName property of the underlying optimizer.

    Returns "No optimizer attached." in AUTOMATIC or MANUAL modes when no optimizer is attached.

    Returns "SolverName() attribute not implemented by the optimizer." if the attribute is not implemented.

    Example

    julia> import Ipopt
    +1.0488089174032211e-5
    source

    solver_name

    JuMP.solver_nameFunction
    solver_name(model::GenericModel)

    If available, returns the MOI.SolverName property of the underlying optimizer.

    Returns "No optimizer attached." in AUTOMATIC or MANUAL modes when no optimizer is attached.

    Returns "SolverName() attribute not implemented by the optimizer." if the attribute is not implemented.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -2430,7 +2430,7 @@
     julia> model = Model(MOI.FileFormats.MPS.Model);
     
     julia> solver_name(model)
    -"SolverName() attribute not implemented by the optimizer."
    source

    start_value

    JuMP.start_valueFunction
    start_value(con_ref::ConstraintRef)

    Return the primal start value (MOI.ConstraintPrimalStart) of the constraint con_ref.

    If no primal start value has been set, start_value will return nothing.

    See also set_start_value.

    Example

    julia> model = Model();
    +"SolverName() attribute not implemented by the optimizer."
    source

    start_value

    JuMP.start_valueFunction
    start_value(con_ref::ConstraintRef)

    Return the primal start value (MOI.ConstraintPrimalStart) of the constraint con_ref.

    If no primal start value has been set, start_value will return nothing.

    See also set_start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 2.0);
     
    @@ -2445,7 +2445,7 @@
     
     julia> set_start_value(c, nothing)
     
    -julia> start_value(c)
    source
    start_value(v::GenericVariableRef)

    Return the start value (MOI.VariablePrimalStart) of the variable v.

    Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

    See also: has_start_value, set_start_value.

    Example

    julia> model = Model();
    +julia> start_value(c)
    source
    start_value(v::GenericVariableRef)

    Return the start value (MOI.VariablePrimalStart) of the variable v.

    Note: VariablePrimalStarts are sometimes called "MIP-starts" or "warmstarts".

    See also: has_start_value, set_start_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, start = 1.5);
     
    @@ -2466,12 +2466,12 @@
     true
     
     julia> start_value(y)
    -2.0
    source

    termination_status

    termination_status

    time_limit_sec

    time_limit_sec

    JuMP.time_limit_secFunction
    time_limit_sec(model::GenericModel)

    Return the time limit (in seconds) of the model.

    Returns nothing if unset.

    See also: set_time_limit_sec, unset_time_limit_sec.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -2484,7 +2484,7 @@
     
     julia> unset_time_limit_sec(model)
     
    -julia> time_limit_sec(model)
    source

    triangle_vec

    JuMP.triangle_vecFunction
    triangle_vec(matrix::Matrix)

    Return the upper triangle of a matrix concatenated into a vector in the order required by JuMP and MathOptInterface for Triangle sets.

    Example

    julia> model = Model();
    +julia> time_limit_sec(model)
    source

    triangle_vec

    JuMP.triangle_vecFunction
    triangle_vec(matrix::Matrix)

    Return the upper triangle of a matrix concatenated into a vector in the order required by JuMP and MathOptInterface for Triangle sets.

    Example

    julia> model = Model();
     
     julia> @variable(model, X[1:3, 1:3], Symmetric);
     
    @@ -2492,7 +2492,7 @@
     t
     
     julia> @constraint(model, [t; triangle_vec(X)] in MOI.RootDetConeTriangle(3))
    -[t, X[1,1], X[1,2], X[2,2], X[1,3], X[2,3], X[3,3]] ∈ MathOptInterface.RootDetConeTriangle(3)
    source

    unfix

    JuMP.unfixFunction
    unfix(v::GenericVariableRef)

    Delete the fixing constraint of a variable.

    Error if one does not exist.

    See also FixRef, is_fixed, fix_value, fix.

    Example

    julia> model = Model();
    +[t, X[1,1], X[1,2], X[2,2], X[1,3], X[2,3], X[3,3]] ∈ MathOptInterface.RootDetConeTriangle(3)
    source

    unfix

    JuMP.unfixFunction
    unfix(v::GenericVariableRef)

    Delete the fixing constraint of a variable.

    Error if one does not exist.

    See also FixRef, is_fixed, fix_value, fix.

    Example

    julia> model = Model();
     
     julia> @variable(model, x == 1);
     
    @@ -2502,7 +2502,7 @@
     julia> unfix(x)
     
     julia> is_fixed(x)
    -false
    source

    unregister

    JuMP.unregisterFunction
    unregister(model::GenericModel, key::Symbol)

    Unregister the name key from model so that a new variable, constraint, or expression can be created with the same key.

    Note that this will not delete the object model[key]; it will just remove the reference at model[key]. To delete the object, use delete as well.

    See also: delete, object_dictionary.

    Example

    julia> model = Model();
    +false
    source

    unregister

    JuMP.unregisterFunction
    unregister(model::GenericModel, key::Symbol)

    Unregister the name key from model so that a new variable, constraint, or expression can be created with the same key.

    Note that this will not delete the object model[key]; it will just remove the reference at model[key]. To delete the object, use delete as well.

    See also: delete, object_dictionary.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -2529,7 +2529,7 @@
     x
     
     julia> num_variables(model)
    -2
    source

    unsafe_backend

    JuMP.unsafe_backendFunction
    unsafe_backend(model::GenericModel)

    Return the innermost optimizer associated with the JuMP model model.

    This function should only be used by advanced users looking to access low-level solver-specific functionality. It has a high-risk of incorrect usage. We strongly suggest you use the alternative suggested below.

    See also: backend.

    To obtain the index of a variable or constraint in the unsafe backend, use optimizer_index.

    Unsafe behavior

    This function is unsafe for two main reasons.

    First, the formulation and order of variables and constraints in the unsafe backend may be different to the variables and constraints in model. This can happen because of bridges, or because the solver requires the variables or constraints in a specific order. In addition, the variable or constraint index returned by index at the JuMP level may be different to the index of the corresponding variable or constraint in the unsafe_backend. There is no solution to this. Use the alternative suggested below instead.

    Second, the unsafe_backend may be empty, or lack some modifications made to the JuMP model. Thus, before calling unsafe_backend you should first call MOI.Utilities.attach_optimizer to ensure that the backend is synchronized with the JuMP model.

    julia> import HiGHS
    +2
    source

    unsafe_backend

    JuMP.unsafe_backendFunction
    unsafe_backend(model::GenericModel)

    Return the innermost optimizer associated with the JuMP model model.

    This function should only be used by advanced users looking to access low-level solver-specific functionality. It has a high-risk of incorrect usage. We strongly suggest you use the alternative suggested below.

    See also: backend.

    To obtain the index of a variable or constraint in the unsafe backend, use optimizer_index.

    Unsafe behavior

    This function is unsafe for two main reasons.

    First, the formulation and order of variables and constraints in the unsafe backend may be different to the variables and constraints in model. This can happen because of bridges, or because the solver requires the variables or constraints in a specific order. In addition, the variable or constraint index returned by index at the JuMP level may be different to the index of the corresponding variable or constraint in the unsafe_backend. There is no solution to this. Use the alternative suggested below instead.

    Second, the unsafe_backend may be empty, or lack some modifications made to the JuMP model. Thus, before calling unsafe_backend you should first call MOI.Utilities.attach_optimizer to ensure that the backend is synchronized with the JuMP model.

    julia> import HiGHS
     
     julia> model = Model(HiGHS.Optimizer)
     A JuMP Model
    @@ -2570,7 +2570,7 @@
     A HiGHS model with 1 columns and 0 rows.
     
     julia> index(x)
    -MOI.VariableIndex(1)
    source

    unset_binary

    unset_binary

    JuMP.unset_binaryFunction
    unset_binary(variable_ref::GenericVariableRef)

    Remove the binary constraint on the variable variable_ref.

    See also BinaryRef, is_binary, set_binary.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, Bin);
     
    @@ -2580,7 +2580,7 @@
     julia> unset_binary(x)
     
     julia> is_binary(x)
    -false
    source

    unset_integer

    unset_integer

    JuMP.unset_integerFunction
    unset_integer(variable_ref::GenericVariableRef)

    Remove the integrality constraint on the variable variable_ref.

    Errors if one does not exist.

    See also IntegerRef, is_integer, set_integer.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, Int);
     
    @@ -2590,7 +2590,7 @@
     julia> unset_integer(x)
     
     julia> is_integer(x)
    -false
    source

    unset_silent

    JuMP.unset_silentFunction
    unset_silent(model::GenericModel)

    Neutralize the effect of the set_silent function and let the solver attributes control the verbosity.

    See also: set_silent.

    Example

    julia> import Ipopt
    +false
    source

    unset_silent

    JuMP.unset_silentFunction
    unset_silent(model::GenericModel)

    Neutralize the effect of the set_silent function and let the solver attributes control the verbosity.

    See also: set_silent.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -2602,7 +2602,7 @@
     julia> unset_silent(model)
     
     julia> get_attribute(model, MOI.Silent())
    -false
    source

    unset_time_limit_sec

    unset_time_limit_sec

    JuMP.unset_time_limit_secFunction
    unset_time_limit_sec(model::GenericModel)

    Unset the time limit of the solver.

    See also: set_time_limit_sec, time_limit_sec.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -2615,19 +2615,19 @@
     
     julia> unset_time_limit_sec(model)
     
    -julia> time_limit_sec(model)
    source

    upper_bound

    upper_bound

    value

    JuMP.valueFunction
    value(con_ref::ConstraintRef; result::Int = 1)

    Return the primal value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

    That is, if con_ref is the reference of a constraint func-in-set, it returns the value of func evaluated at the value of the variables (given by value(::GenericVariableRef)).

    Use has_values to check if a result exists before asking for values.

    See also: result_count.

    Note

    For scalar constraints, the constant is moved to the set so it is not taken into account in the primal value of the constraint. For instance, the constraint @constraint(model, 2x + 3y + 1 == 5) is transformed into 2x + 3y-in-MOI.EqualTo(4) so the value returned by this function is the evaluation of 2x + 3y.

    source
    value(var_value::Function, con_ref::ConstraintRef)

    Evaluate the primal value of the constraint con_ref using var_value(v) as the value for each variable v.

    source
    value(v::GenericVariableRef; result = 1)

    Return the value of variable v associated with result index result of the most-recent returned by the solver.

    Use has_values to check if a result exists before asking for values.

    See also: result_count.

    source
    value(var_value::Function, v::GenericVariableRef)

    Evaluate the value of the variable v as var_value(v).

    source
    value(var_value::Function, ex::GenericAffExpr)

    Evaluate ex using var_value(v) as the value for each variable v.

    source
    value(v::GenericAffExpr; result::Int = 1)

    Return the value of the GenericAffExpr v associated with result index result of the most-recent solution returned by the solver.

    See also: result_count.

    source
    value(var_value::Function, ex::GenericQuadExpr)

    Evaluate ex using var_value(v) as the value for each variable v.

    source
    value(v::GenericQuadExpr; result::Int = 1)

    Return the value of the GenericQuadExpr v associated with result index result of the most-recent solution returned by the solver.

    Replaces getvalue for most use cases.

    See also: result_count.

    source
    value(p::NonlinearParameter)

    Return the current value stored in the nonlinear parameter p.

    Example

    julia> model = Model();
    +1.0
    source

    value

    JuMP.valueFunction
    value(con_ref::ConstraintRef; result::Int = 1)

    Return the primal value of constraint con_ref associated with result index result of the most-recent solution returned by the solver.

    That is, if con_ref is the reference of a constraint func-in-set, it returns the value of func evaluated at the value of the variables (given by value(::GenericVariableRef)).

    Use has_values to check if a result exists before asking for values.

    See also: result_count.

    Note

    For scalar constraints, the constant is moved to the set so it is not taken into account in the primal value of the constraint. For instance, the constraint @constraint(model, 2x + 3y + 1 == 5) is transformed into 2x + 3y-in-MOI.EqualTo(4) so the value returned by this function is the evaluation of 2x + 3y.

    source
    value(var_value::Function, con_ref::ConstraintRef)

    Evaluate the primal value of the constraint con_ref using var_value(v) as the value for each variable v.

    source
    value(v::GenericVariableRef; result = 1)

    Return the value of variable v associated with result index result of the most-recent returned by the solver.

    Use has_values to check if a result exists before asking for values.

    See also: result_count.

    source
    value(var_value::Function, v::GenericVariableRef)

    Evaluate the value of the variable v as var_value(v).

    source
    value(var_value::Function, ex::GenericAffExpr)

    Evaluate ex using var_value(v) as the value for each variable v.

    source
    value(v::GenericAffExpr; result::Int = 1)

    Return the value of the GenericAffExpr v associated with result index result of the most-recent solution returned by the solver.

    See also: result_count.

    source
    value(var_value::Function, ex::GenericQuadExpr)

    Evaluate ex using var_value(v) as the value for each variable v.

    source
    value(v::GenericQuadExpr; result::Int = 1)

    Return the value of the GenericQuadExpr v associated with result index result of the most-recent solution returned by the solver.

    Replaces getvalue for most use cases.

    See also: result_count.

    source
    value(p::NonlinearParameter)

    Return the current value stored in the nonlinear parameter p.

    Example

    julia> model = Model();
     
     julia> @NLparameter(model, p == 10)
     p == 10.0
     
     julia> value(p)
    -10.0
    source
    value(ex::NonlinearExpression; result::Int = 1)

    Return the value of the NonlinearExpression ex associated with result index result of the most-recent solution returned by the solver.

    See also: result_count.

    source
    value(var_value::Function, ex::NonlinearExpression)

    Evaluate ex using var_value(v) as the value for each variable v.

    source
    value(c::NonlinearConstraintRef; result::Int = 1)

    Return the value of the NonlinearConstraintRef c associated with result index result of the most-recent solution returned by the solver.

    See also: result_count.

    source
    value(var_value::Function, c::NonlinearConstraintRef)

    Evaluate c using var_value(v) as the value for each variable v.

    source

    value_type

    JuMP.value_typeFunction
    value_type(::Type{<:Union{AbstractModel,AbstractVariableRef}})

    Return the return type of value for variables of that model. It defaults to Float64 if it is not implemented.

    Example

    julia> value_type(GenericModel{BigFloat})
    -BigFloat
    source

    variable_by_name

    JuMP.variable_by_nameFunction
    variable_by_name(
    +10.0
    source
    value(ex::NonlinearExpression; result::Int = 1)

    Return the value of the NonlinearExpression ex associated with result index result of the most-recent solution returned by the solver.

    See also: result_count.

    source
    value(var_value::Function, ex::NonlinearExpression)

    Evaluate ex using var_value(v) as the value for each variable v.

    source
    value(c::NonlinearConstraintRef; result::Int = 1)

    Return the value of the NonlinearConstraintRef c associated with result index result of the most-recent solution returned by the solver.

    See also: result_count.

    source
    value(var_value::Function, c::NonlinearConstraintRef)

    Evaluate c using var_value(v) as the value for each variable v.

    source

    value_type

    JuMP.value_typeFunction
    value_type(::Type{<:Union{AbstractModel,AbstractVariableRef}})

    Return the return type of value for variables of that model. It defaults to Float64 if it is not implemented.

    Example

    julia> value_type(GenericModel{BigFloat})
    +BigFloat
    source

    variable_by_name

    JuMP.variable_by_nameFunction
    variable_by_name(
         model::AbstractModel,
         name::String,
     )::Union{AbstractVariableRef,Nothing}

    Returns the reference of the variable with name attribute name or Nothing if no variable has this name attribute. Throws an error if several variables have name as their name attribute.

    Example

    julia> model = Model();
    @@ -2670,12 +2670,12 @@
      u[2]
     
     julia> variable_by_name(model, "u[2]")
    -u[2]
    source

    variable_ref_type

    JuMP.variable_ref_typeFunction
    variable_ref_type(::Union{F,Type{F}}) where {F}

    A helper function used internally by JuMP and some JuMP extensions. Returns the variable type associated with the model or expression type F.

    source

    vectorize

    JuMP.vectorizeFunction
    vectorize(matrix::AbstractMatrix, ::Shape)

    Convert the matrix into a vector according to Shape.

    source

    write_to_file

    variable_ref_type

    JuMP.variable_ref_typeFunction
    variable_ref_type(::Union{F,Type{F}}) where {F}

    A helper function used internally by JuMP and some JuMP extensions. Returns the variable type associated with the model or expression type F.

    source

    vectorize

    JuMP.vectorizeFunction
    vectorize(matrix::AbstractMatrix, ::Shape)

    Convert the matrix into a vector according to Shape.

    source

    write_to_file

    JuMP.write_to_fileFunction
    write_to_file(
         model::GenericModel,
         filename::String;
         format::MOI.FileFormats.FileFormat = MOI.FileFormats.FORMAT_AUTOMATIC,
         kwargs...,
    -)

    Write the JuMP model model to filename in the format format.

    If the filename ends in .gz, it will be compressed using GZip. If the filename ends in .bz2, it will be compressed using BZip2.

    Other kwargs are passed to the Model constructor of the chosen format.

    source

    AbstractConstraint

    JuMP.AbstractConstraintType
    abstract type AbstractConstraint

    An abstract base type for all constraint types. AbstractConstraints store the function and set directly, unlike ConstraintRefs that are merely references to constraints stored in a model. AbstractConstraints do not need to be attached to a model.

    source

    AbstractJuMPScalar

    JuMP.AbstractJuMPScalarType
    AbstractJuMPScalar <: MutableArithmetics.AbstractMutable

    Abstract base type for all scalar types

    The subtyping of AbstractMutable will allow calls of some Base functions to be redirected to a method in MA that handles type promotion more carefully (for example the promotion in sparse matrix products in SparseArrays usually does not work for JuMP types) and exploits the mutability of AffExpr and QuadExpr.

    source

    AbstractModel

    JuMP.AbstractModelType
    AbstractModel

    An abstract type that should be subtyped for users creating JuMP extensions.

    source

    AbstractScalarSet

    JuMP.AbstractScalarSetType
    AbstractScalarSet

    An abstract type for defining new scalar sets in JuMP.

    Implement moi_set(::AbstractScalarSet) to convert the type into an MOI set.

    See also: moi_set.

    source

    AbstractShape

    AbstractVariable

    AbstractVariableRef

    JuMP.AbstractVariableRefType
    AbstractVariableRef

    Variable returned by add_variable. Affine (resp. quadratic) operations with variables of type V<:AbstractVariableRef and coefficients of type T create a GenericAffExpr{T,V} (resp. GenericQuadExpr{T,V}).

    source

    AbstractVectorSet

    JuMP.AbstractVectorSetType
    AbstractVectorSet

    An abstract type for defining new sets in JuMP.

    Implement moi_set(::AbstractVectorSet, dim::Int) to convert the type into an MOI set.

    See also: moi_set.

    source

    AffExpr

    ArrayShape

    JuMP.ArrayShapeType
    ArrayShape{N}(dims::NTuple{N,Int}) where {N}

    An AbstractShape that represents array-valued constraints.

    Example

    julia> model = Model();
    +)

    Write the JuMP model model to filename in the format format.

    If the filename ends in .gz, it will be compressed using GZip. If the filename ends in .bz2, it will be compressed using BZip2.

    Other kwargs are passed to the Model constructor of the chosen format.

    source

    AbstractConstraint

    JuMP.AbstractConstraintType
    abstract type AbstractConstraint

    An abstract base type for all constraint types. AbstractConstraints store the function and set directly, unlike ConstraintRefs that are merely references to constraints stored in a model. AbstractConstraints do not need to be attached to a model.

    source

    AbstractJuMPScalar

    JuMP.AbstractJuMPScalarType
    AbstractJuMPScalar <: MutableArithmetics.AbstractMutable

    Abstract base type for all scalar types

    The subtyping of AbstractMutable will allow calls of some Base functions to be redirected to a method in MA that handles type promotion more carefully (for example the promotion in sparse matrix products in SparseArrays usually does not work for JuMP types) and exploits the mutability of AffExpr and QuadExpr.

    source

    AbstractModel

    JuMP.AbstractModelType
    AbstractModel

    An abstract type that should be subtyped for users creating JuMP extensions.

    source

    AbstractScalarSet

    JuMP.AbstractScalarSetType
    AbstractScalarSet

    An abstract type for defining new scalar sets in JuMP.

    Implement moi_set(::AbstractScalarSet) to convert the type into an MOI set.

    See also: moi_set.

    source

    AbstractShape

    AbstractVariable

    AbstractVariableRef

    JuMP.AbstractVariableRefType
    AbstractVariableRef

    Variable returned by add_variable. Affine (resp. quadratic) operations with variables of type V<:AbstractVariableRef and coefficients of type T create a GenericAffExpr{T,V} (resp. GenericQuadExpr{T,V}).

    source

    AbstractVectorSet

    JuMP.AbstractVectorSetType
    AbstractVectorSet

    An abstract type for defining new sets in JuMP.

    Implement moi_set(::AbstractVectorSet, dim::Int) to convert the type into an MOI set.

    See also: moi_set.

    source

    AffExpr

    ArrayShape

    JuMP.ArrayShapeType
    ArrayShape{N}(dims::NTuple{N,Int}) where {N}

    An AbstractShape that represents array-valued constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2, 1:3]);
     
    @@ -2684,12 +2684,12 @@
      x[2,1]  x[2,2]  x[2,3]] ∈ Nonnegatives()
     
     julia> shape(constraint_object(c))
    -ArrayShape{2}((2, 3))
    source

    BinaryRef

    JuMP.BinaryRefFunction
    BinaryRef(v::GenericVariableRef)

    Return a constraint reference to the constraint constraining v to be binary. Errors if one does not exist.

    See also is_binary, set_binary, unset_binary.

    Example

    julia> model = Model();
    +ArrayShape{2}((2, 3))
    source

    BinaryRef

    JuMP.BinaryRefFunction
    BinaryRef(v::GenericVariableRef)

    Return a constraint reference to the constraint constraining v to be binary. Errors if one does not exist.

    See also is_binary, set_binary, unset_binary.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, Bin);
     
     julia> BinaryRef(x)
    -x binary
    source

    BridgeableConstraint

    BridgeableConstraint

    JuMP.BridgeableConstraintType
    BridgeableConstraint(
         constraint::C,
         bridge_type::B;
         coefficient_type::Type{T} = Float64,
    @@ -2704,7 +2704,7 @@
     )
         constraint = ScalarConstraint(func, set)
         return BridgeableConstraint(constraint, CustomBridge)
    -end

    Note

    JuMP extensions should extend JuMP.build_constraint only if they also defined CustomSet, for three reasons:

    1. It is problematic if multiple extensions overload the same JuMP method.
    2. A missing method will not inform the users that they forgot to load the extension module defining the build_constraint method.
    3. Defining a method where neither the function nor any of the argument types are defined in the package is called type piracy and is discouraged in the Julia style guide.
    source

    ComplexPlane

    JuMP.ComplexPlaneType
    ComplexPlane

    Complex plane object that can be used to create a complex variable in the @variable macro.

    Example

    Consider the following example:

    julia> model = Model();
    +end

    Note

    JuMP extensions should extend JuMP.build_constraint only if they also defined CustomSet, for three reasons:

    1. It is problematic if multiple extensions overload the same JuMP method.
    2. A missing method will not inform the users that they forgot to load the extension module defining the build_constraint method.
    3. Defining a method where neither the function nor any of the argument types are defined in the package is called type piracy and is discouraged in the Julia style guide.
    source

    ComplexPlane

    JuMP.ComplexPlaneType
    ComplexPlane

    Complex plane object that can be used to create a complex variable in the @variable macro.

    Example

    Consider the following example:

    julia> model = Model();
     
     julia> @variable(model, x in ComplexPlane())
     real(x) + imag(x) im
    @@ -2712,7 +2712,7 @@
     julia> all_variables(model)
     2-element Vector{VariableRef}:
      real(x)
    - imag(x)

    We see in the output of the last command that two real variables were created. The Julia variable x binds to an affine expression in terms of these two variables that parametrize the complex plane.

    source

    ComplexVariable

    ConstraintNotOwned

    JuMP.ConstraintNotOwnedType
    struct ConstraintNotOwned{C<:ConstraintRef} <: Exception
    + imag(x)

    We see in the output of the last command that two real variables were created. The Julia variable x binds to an affine expression in terms of these two variables that parametrize the complex plane.

    source

    ComplexVariable

    ConstraintNotOwned

    JuMP.ConstraintNotOwnedType
    struct ConstraintNotOwned{C<:ConstraintRef} <: Exception
         constraint_ref::C
     end

    An error thrown when the constraint constraint_ref was used in a model different to owner_model(constraint_ref).

    Example

    julia> model = Model();
     
    @@ -2726,12 +2726,12 @@
     julia> MOI.get(model_new, MOI.ConstraintName(), c)
     ERROR: ConstraintNotOwned{ConstraintRef{Model, MathOptInterface.ConstraintIndex{MathOptInterface.ScalarAffineFunction{Float64}, MathOptInterface.GreaterThan{Float64}}, ScalarShape}}(c : x ≥ 0)
     Stacktrace:
    -[...]
    source

    ConstraintRef

    FixRef

    JuMP.FixRefFunction
    FixRef(v::GenericVariableRef)

    Return a constraint reference to the constraint fixing the value of v.

    Errors if one does not exist.

    See also is_fixed, fix_value, fix, unfix.

    Example

    julia> model = Model();
    +[...]
    source

    ConstraintRef

    FixRef

    JuMP.FixRefFunction
    FixRef(v::GenericVariableRef)

    Return a constraint reference to the constraint fixing the value of v.

    Errors if one does not exist.

    See also is_fixed, fix_value, fix, unfix.

    Example

    julia> model = Model();
     
     julia> @variable(model, x == 1);
     
     julia> FixRef(x)
    -x = 1
    source

    GenericAffExpr

    GenericAffExpr

    JuMP.GenericAffExprType
    mutable struct GenericAffExpr{CoefType,VarType} <: AbstractJuMPScalar
         constant::CoefType
         terms::OrderedDict{VarType,CoefType}
     end

    An expression type representing an affine expression of the form: $\sum a_i x_i + c$.

    Fields

    • .constant: the constant c in the expression.
    • .terms: an OrderedDict, with keys of VarType and values of CoefType describing the sparse vector a.

    Example

    julia> model = Model();
    @@ -2747,13 +2747,13 @@
     julia> expr.terms
     OrderedCollections.OrderedDict{VariableRef, Float64} with 2 entries:
       x[2] => 1.0
    -  x[1] => 3.0
    source

    GenericModel

    GenericModel

    JuMP.GenericModelType
    GenericModel{T}(
         [optimizer_factory;]
         add_bridges::Bool = true,
     ) where {T<:Real}

    Create a new instance of a JuMP model.

    If optimizer_factory is provided, the model is initialized with the optimizer returned by MOI.instantiate(optimizer_factory).

    If optimizer_factory is not provided, use set_optimizer to set the optimizer before calling optimize!.

    If add_bridges, JuMP adds a MOI.Bridges.LazyBridgeOptimizer to automatically reformulate the problem into a form supported by the optimizer.

    Value type T

    Passing a type other than Float64 as the value type T is an advanced operation. The value type must match that expected by the chosen optimizer. Consult the optimizers documentation for details.

    If not documented, assume that the optimizer supports only Float64.

    Choosing an unsupported value type will throw an MOI.UnsupportedConstraint or an MOI.UnsupportedAttribute error, the timing of which (during the model construction or during a call to optimize!) depends on how the solver is interfaced to JuMP.

    Example

    julia> model = GenericModel{BigFloat}();
     
     julia> typeof(model)
    -GenericModel{BigFloat}
    source

    GenericNonlinearExpr

    GenericNonlinearExpr

    JuMP.GenericNonlinearExprType
    GenericNonlinearExpr{V}(head::Symbol, args::Vector{Any})
     GenericNonlinearExpr{V}(head::Symbol, args::Any...)

    The scalar-valued nonlinear function head(args...), represented as a symbolic expression tree, with the call operator head and ordered arguments in args.

    V is the type of AbstractVariableRef present in the expression, and is used to help dispatch JuMP extensions.

    head

    The head::Symbol must be an operator supported by the model.

    The default list of supported univariate operators is given by:

    and the default list of supported multivariate operators is given by:

    Additional operators can be add using @operator.

    See the full list of operators supported by a MOI.ModelLike by querying the MOI.ListOfSupportedNonlinearOperators attribute.

    args

    The vector args contains the arguments to the nonlinear function. If the operator is univariate, it must contain one element. Otherwise, it may contain multiple elements.

    Given a subtype of AbstractVariableRef, V, for GenericNonlinearExpr{V}, each element must be one of the following:

    where T<:Real and T == value_type(V).

    Unsupported operators

    If the optimizer does not support head, an MOI.UnsupportedNonlinearOperator error will be thrown.

    There is no guarantee about when this error will be thrown; it may be thrown when the function is first added to the model, or it may be thrown when optimize! is called.

    Example

    To represent the function $f(x) = sin(x)^2$, do:

    julia> model = Model();
     
     julia> @variable(model, x)
    @@ -2767,7 +2767,7 @@
                GenericNonlinearExpr{VariableRef}(:sin, x),
                2.0,
            )
    -sin(x) ^ 2.0
    source

    GenericQuadExpr

    GenericQuadExpr

    JuMP.GenericQuadExprType
    mutable struct GenericQuadExpr{CoefType,VarType} <: AbstractJuMPScalar
         aff::GenericAffExpr{CoefType,VarType}
         terms::OrderedDict{UnorderedPair{VarType}, CoefType}
     end

    An expression type representing an quadratic expression of the form: $\sum q_{i,j} x_i x_j + \sum a_i x_i + c$.

    Fields

    • .aff: an GenericAffExpr representing the affine portion of the expression.
    • .terms: an OrderedDict, with keys of UnorderedPair{VarType} and values of CoefType, describing the sparse list of terms q.

    Example

    julia> model = Model();
    @@ -2783,16 +2783,16 @@
     julia> expr.terms
     OrderedCollections.OrderedDict{UnorderedPair{VariableRef}, Float64} with 2 entries:
       UnorderedPair{VariableRef}(x[1], x[1]) => 2.0
    -  UnorderedPair{VariableRef}(x[1], x[2]) => 1.0
    source

    GenericReferenceMap

    JuMP.GenericReferenceMapType
    GenericReferenceMap{T}

    Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

    source

    GenericVariableRef

    JuMP.GenericVariableRefType
    GenericVariableRef{T} <: AbstractVariableRef

    Holds a reference to the model and the corresponding MOI.VariableIndex.

    source

    GreaterThanZero

    JuMP.GreaterThanZeroType
    GreaterThanZero()

    A struct used to intercept when >= or is used in a macro via operator_to_set.

    This struct is not the same as Nonnegatives so that we can disambiguate x >= y and x - y in Nonnegatives().

    This struct is not intended for general usage, but it may be useful to some JuMP extensions.

    Example

    julia> operator_to_set(error, Val(:>=))
    -GreaterThanZero()
    source

    HermitianMatrixAdjointShape

    HermitianMatrixShape

    GenericReferenceMap

    JuMP.GenericReferenceMapType
    GenericReferenceMap{T}

    Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

    source

    GenericVariableRef

    JuMP.GenericVariableRefType
    GenericVariableRef{T} <: AbstractVariableRef

    Holds a reference to the model and the corresponding MOI.VariableIndex.

    source

    GreaterThanZero

    JuMP.GreaterThanZeroType
    GreaterThanZero()

    A struct used to intercept when >= or is used in a macro via operator_to_set.

    This struct is not the same as Nonnegatives so that we can disambiguate x >= y and x - y in Nonnegatives().

    This struct is not intended for general usage, but it may be useful to some JuMP extensions.

    Example

    julia> operator_to_set(error, Val(:>=))
    +GreaterThanZero()
    source

    HermitianMatrixAdjointShape

    HermitianMatrixShape

    JuMP.HermitianMatrixShapeType
    HermitianMatrixShape(
         side_dimension::Int;
         needs_adjoint_dual::Bool = false,
    -)

    The shape object for a Hermitian square matrix of side_dimension rows and columns.

    The vectorized form corresponds to MOI.HermitianPositiveSemidefiniteConeTriangle.

    needs_adjoint_dual

    By default, the dual_shape of HermitianMatrixShape is also HermitianMatrixShape. This is true for cases such as a LinearAlgebra.Hermitian matrix in HermitianPSDCone.

    However, JuMP also supports LinearAlgebra.Hermitian matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

    source

    HermitianMatrixSpace

    JuMP.HermitianMatrixSpaceType
    HermitianMatrixSpace()

    Use in the @variable macro to constrain a matrix of variables to be hermitian.

    Example

    julia> model = Model();
    +)

    The shape object for a Hermitian square matrix of side_dimension rows and columns.

    The vectorized form corresponds to MOI.HermitianPositiveSemidefiniteConeTriangle.

    needs_adjoint_dual

    By default, the dual_shape of HermitianMatrixShape is also HermitianMatrixShape. This is true for cases such as a LinearAlgebra.Hermitian matrix in HermitianPSDCone.

    However, JuMP also supports LinearAlgebra.Hermitian matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

    source

    HermitianMatrixSpace

    JuMP.HermitianMatrixSpaceType
    HermitianMatrixSpace()

    Use in the @variable macro to constrain a matrix of variables to be hermitian.

    Example

    julia> model = Model();
     
     julia> @variable(model, Q[1:2, 1:2] in HermitianMatrixSpace())
     2×2 LinearAlgebra.Hermitian{GenericAffExpr{ComplexF64, VariableRef}, Matrix{GenericAffExpr{ComplexF64, VariableRef}}}:
      real(Q[1,1])                    real(Q[1,2]) + imag(Q[1,2]) im
    - real(Q[1,2]) - imag(Q[1,2]) im  real(Q[2,2])
    source

    HermitianPSDCone

    JuMP.HermitianPSDConeType
    HermitianPSDCone

    Hermitian positive semidefinite cone object that can be used to create a Hermitian positive semidefinite square matrix in the @variable and @constraint macros.

    Example

    Consider the following example:

    julia> model = Model();
    + real(Q[1,2]) - imag(Q[1,2]) im  real(Q[2,2])
    source

    HermitianPSDCone

    JuMP.HermitianPSDConeType
    HermitianPSDCone

    Hermitian positive semidefinite cone object that can be used to create a Hermitian positive semidefinite square matrix in the @variable and @constraint macros.

    Example

    Consider the following example:

    julia> model = Model();
     
     julia> @variable(model, H[1:3, 1:3] in HermitianPSDCone())
     3×3 LinearAlgebra.Hermitian{GenericAffExpr{ComplexF64, VariableRef}, Matrix{GenericAffExpr{ComplexF64, VariableRef}}}:
    @@ -2814,18 +2814,18 @@
     
     julia> all_constraints(model, Vector{VariableRef}, MOI.HermitianPositiveSemidefiniteConeTriangle)
     1-element Vector{ConstraintRef{Model, MathOptInterface.ConstraintIndex{MathOptInterface.VectorOfVariables, MathOptInterface.HermitianPositiveSemidefiniteConeTriangle}}}:
    - [real(H[1,1]), real(H[1,2]), real(H[2,2]), real(H[1,3]), real(H[2,3]), real(H[3,3]), imag(H[1,2]), imag(H[1,3]), imag(H[2,3])] ∈ MathOptInterface.HermitianPositiveSemidefiniteConeTriangle(3)

    We see in the output of the last commands that 9 real variables were created. The matrix H constrains affine expressions in terms of these 9 variables that parametrize a Hermitian matrix.

    source

    IntegerRef

    JuMP.IntegerRefFunction
    IntegerRef(v::GenericVariableRef)

    Return a constraint reference to the constraint constraining v to be integer.

    Errors if one does not exist.

    See also is_integer, set_integer, unset_integer.

    Example

    julia> model = Model();
    + [real(H[1,1]), real(H[1,2]), real(H[2,2]), real(H[1,3]), real(H[2,3]), real(H[3,3]), imag(H[1,2]), imag(H[1,3]), imag(H[2,3])] ∈ MathOptInterface.HermitianPositiveSemidefiniteConeTriangle(3)

    We see in the output of the last commands that 9 real variables were created. The matrix H constrains affine expressions in terms of these 9 variables that parametrize a Hermitian matrix.

    source

    IntegerRef

    JuMP.IntegerRefFunction
    IntegerRef(v::GenericVariableRef)

    Return a constraint reference to the constraint constraining v to be integer.

    Errors if one does not exist.

    See also is_integer, set_integer, unset_integer.

    Example

    julia> model = Model();
     
     julia> @variable(model, x, Int);
     
     julia> IntegerRef(x)
    -x integer
    source

    LPMatrixData

    LessThanZero

    JuMP.LessThanZeroType
    GreaterThanZero()

    A struct used to intercept when <= or is used in a macro via operator_to_set.

    This struct is not the same as Nonpositives so that we can disambiguate x <= y and x - y in Nonpositives().

    This struct is not intended for general usage, but it may be useful to some JuMP extensions.

    Example

    julia> operator_to_set(error, Val(:<=))
    -LessThanZero()
    source

    LinearTermIterator

    JuMP.LinearTermIteratorType
    LinearTermIterator{GAE<:GenericAffExpr}

    A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable) in the GenericAffExpr.

    source

    LowerBoundRef

    LPMatrixData

    LessThanZero

    JuMP.LessThanZeroType
    GreaterThanZero()

    A struct used to intercept when <= or is used in a macro via operator_to_set.

    This struct is not the same as Nonpositives so that we can disambiguate x <= y and x - y in Nonpositives().

    This struct is not intended for general usage, but it may be useful to some JuMP extensions.

    Example

    julia> operator_to_set(error, Val(:<=))
    +LessThanZero()
    source

    LinearTermIterator

    JuMP.LinearTermIteratorType
    LinearTermIterator{GAE<:GenericAffExpr}

    A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable) in the GenericAffExpr.

    source

    LowerBoundRef

    Model

    JuMP.ModelType
    Model([optimizer_factory;] add_bridges::Bool = true)

    Create a new instance of a JuMP model.

    If optimizer_factory is provided, the model is initialized with thhe optimizer returned by MOI.instantiate(optimizer_factory).

    If optimizer_factory is not provided, use set_optimizer to set the optimizer before calling optimize!.

    If add_bridges, JuMP adds a MOI.Bridges.LazyBridgeOptimizer to automatically reformulate the problem into a form supported by the optimizer.

    Example

    julia> import Ipopt
    +x ≥ 1
    source

    Model

    JuMP.ModelType
    Model([optimizer_factory;] add_bridges::Bool = true)

    Create a new instance of a JuMP model.

    If optimizer_factory is provided, the model is initialized with thhe optimizer returned by MOI.instantiate(optimizer_factory).

    If optimizer_factory is not provided, use set_optimizer to set the optimizer before calling optimize!.

    If add_bridges, JuMP adds a MOI.Bridges.LazyBridgeOptimizer to automatically reformulate the problem into a form supported by the optimizer.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
    @@ -2836,16 +2836,16 @@
     
     julia> import MultiObjectiveAlgorithms as MOA
     
    -julia> model = Model(() -> MOA.Optimizer(HiGHS.Optimizer); add_bridges = false);
    source

    ModelMode

    JuMP.ModelModeType
    ModelMode

    An enum to describe the state of the CachingOptimizer inside a JuMP model.

    See also: mode.

    Values

    Possible values are:

    • [AUTOMATIC]: moi_backend field holds a CachingOptimizer in AUTOMATIC mode.
    • [MANUAL]: moi_backend field holds a CachingOptimizer in MANUAL mode.
    • [DIRECT]: moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.
    source

    NLPEvaluator

    JuMP.NLPEvaluatorFunction
    NLPEvaluator(
    +julia> model = Model(() -> MOA.Optimizer(HiGHS.Optimizer); add_bridges = false);
    source

    ModelMode

    JuMP.ModelModeType
    ModelMode

    An enum to describe the state of the CachingOptimizer inside a JuMP model.

    See also: mode.

    Values

    Possible values are:

    • [AUTOMATIC]: moi_backend field holds a CachingOptimizer in AUTOMATIC mode.
    • [MANUAL]: moi_backend field holds a CachingOptimizer in MANUAL mode.
    • [DIRECT]: moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.
    source

    NLPEvaluator

    JuMP.NLPEvaluatorFunction
    NLPEvaluator(
         model::Model,
         _differentiation_backend::MOI.Nonlinear.AbstractAutomaticDifferentiation =
             MOI.Nonlinear.SparseReverseMode(),
    -)

    Return an MOI.AbstractNLPEvaluator constructed from model

    Warning

    Before using, you must initialize the evaluator using MOI.initialize.

    Experimental

    These features may change or be removed in any future version of JuMP.

    Pass _differentiation_backend to specify the differentiation backend used to compute derivatives.

    source

    NoOptimizer

    JuMP.NoOptimizerType
    struct NoOptimizer <: Exception end

    An error thrown when no optimizer is set and one is required.

    The optimizer can be provided to the Model constructor or by calling set_optimizer.

    Example

    julia> model = Model();
    +)

    Return an MOI.AbstractNLPEvaluator constructed from model

    Warning

    Before using, you must initialize the evaluator using MOI.initialize.

    Experimental

    These features may change or be removed in any future version of JuMP.

    Pass _differentiation_backend to specify the differentiation backend used to compute derivatives.

    source

    NoOptimizer

    JuMP.NoOptimizerType
    struct NoOptimizer <: Exception end

    An error thrown when no optimizer is set and one is required.

    The optimizer can be provided to the Model constructor or by calling set_optimizer.

    Example

    julia> model = Model();
     
     julia> optimize!(model)
     ERROR: NoOptimizer()
     Stacktrace:
    -[...]
    source

    NonlinearExpr

    NonlinearOperator

    JuMP.NonlinearOperatorType
    NonlinearOperator(func::Function, head::Symbol)

    A callable struct (functor) representing a function named head.

    When called with AbstractJuMPScalars, the struct returns a GenericNonlinearExpr.

    When called with non-JuMP types, the struct returns the evaluation of func(args...).

    Unless head is special-cased by the optimizer, the operator must have already been added to the model using add_nonlinear_operator or @operator.

    Example

    julia> model = Model();
    +[...]
    source

    NonlinearExpr

    NonlinearOperator

    JuMP.NonlinearOperatorType
    NonlinearOperator(func::Function, head::Symbol)

    A callable struct (functor) representing a function named head.

    When called with AbstractJuMPScalars, the struct returns a GenericNonlinearExpr.

    When called with non-JuMP types, the struct returns the evaluation of func(args...).

    Unless head is special-cased by the optimizer, the operator must have already been added to the model using add_nonlinear_operator or @operator.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -2869,7 +2869,7 @@
     op_f(x)
     
     julia> bar(2.0)
    -4.0
    source

    Nonnegatives

    JuMP.NonnegativesType
    Nonnegatives()

    The JuMP equivalent of the MOI.Nonnegatives set, in which the dimension is inferred from the corresponding function.

    Example

    julia> model = Model();
    +4.0
    source

    Nonnegatives

    JuMP.NonnegativesType
    Nonnegatives()

    The JuMP equivalent of the MOI.Nonnegatives set, in which the dimension is inferred from the corresponding function.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2])
     2-element Vector{VariableRef}:
    @@ -2884,7 +2884,7 @@
     julia> b = [5, 6];
     
     julia> @constraint(model, A * x >= b)
    -[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonnegatives()
    source

    Nonpositives

    JuMP.NonpositivesType
    Nonpositives()

    The JuMP equivalent of the MOI.Nonpositives set, in which the dimension is inferred from the corresponding function.

    Example

    julia> model = Model();
    +[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonnegatives()
    source

    Nonpositives

    JuMP.NonpositivesType
    Nonpositives()

    The JuMP equivalent of the MOI.Nonpositives set, in which the dimension is inferred from the corresponding function.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2])
     2-element Vector{VariableRef}:
    @@ -2899,14 +2899,14 @@
     julia> b = [5, 6];
     
     julia> @constraint(model, A * x <= b)
    -[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonpositives()
    source

    OptimizationSense

    OptimizeNotCalled

    JuMP.OptimizeNotCalledType
    struct OptimizeNotCalled <: Exception end

    An error thrown when a result attribute cannot be queried before optimize! is called.

    Example

    julia> import Ipopt
    +[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Nonpositives()
    source

    OptimizationSense

    OptimizeNotCalled

    JuMP.OptimizeNotCalledType
    struct OptimizeNotCalled <: Exception end

    An error thrown when a result attribute cannot be queried before optimize! is called.

    Example

    julia> import Ipopt
     
     julia> model = Model(Ipopt.Optimizer);
     
     julia> objective_value(model)
     ERROR: OptimizeNotCalled()
     Stacktrace:
    -[...]
    source

    PSDCone

    JuMP.PSDConeType
    PSDCone

    Positive semidefinite cone object that can be used to constrain a square matrix to be positive semidefinite in the @constraint macro.

    If the matrix has type Symmetric then the columns vectorization (the vector obtained by concatenating the columns) of its upper triangular part is constrained to belong to the MOI.PositiveSemidefiniteConeTriangle set, otherwise its column vectorization is constrained to belong to the MOI.PositiveSemidefiniteConeSquare set.

    Example

    Non-symmetric case:

    julia> model = Model();
    +[...]
    source

    PSDCone

    JuMP.PSDConeType
    PSDCone

    Positive semidefinite cone object that can be used to constrain a square matrix to be positive semidefinite in the @constraint macro.

    If the matrix has type Symmetric then the columns vectorization (the vector obtained by concatenating the columns) of its upper triangular part is constrained to belong to the MOI.PositiveSemidefiniteConeTriangle set, otherwise its column vectorization is constrained to belong to the MOI.PositiveSemidefiniteConeSquare set.

    Example

    Non-symmetric case:

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -2947,7 +2947,7 @@
      x - 4
     
     julia> moi_set(constraint_object(cref))
    -MathOptInterface.PositiveSemidefiniteConeTriangle(2)
    source

    Parameter

    JuMP.ParameterType
    Parameter(value)

    A short-cut for the MOI.Parameter set.

    Example

    julia> model = Model();
    +MathOptInterface.PositiveSemidefiniteConeTriangle(2)
    source

    Parameter

    JuMP.ParameterType
    Parameter(value)

    A short-cut for the MOI.Parameter set.

    Example

    julia> model = Model();
     
     julia> @variable(model, x in Parameter(2))
     x
    @@ -2955,7 +2955,7 @@
     julia> print(model)
     Feasibility
     Subject to
    - x ∈ MathOptInterface.Parameter{Float64}(2.0)
    source

    ParameterRef

    ParameterRef

    JuMP.ParameterRefFunction
    ParameterRef(x::GenericVariableRef)

    Return a constraint reference to the constraint constraining x to be a parameter.

    Errors if one does not exist.

    See also is_parameter, set_parameter_value, parameter_value.

    Example

    julia> model = Model();
     
     julia> @variable(model, p in Parameter(2))
     p
    @@ -2968,7 +2968,7 @@
     julia> ParameterRef(x)
     ERROR: Variable x is not a parameter.
     Stacktrace:
    -[...]
    source

    QuadExpr

    QuadTermIterator

    JuMP.QuadTermIteratorType
    QuadTermIterator{GQE<:GenericQuadExpr}

    A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable, variable) in the GenericQuadExpr.

    source

    ReferenceMap

    JuMP.ReferenceMapType
    GenericReferenceMap{T}

    Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

    source

    ResultStatusCode

    JuMP.ResultStatusCodeType
    ResultStatusCode

    An Enum of possible values for the PrimalStatus and DualStatus attributes.

    The values indicate how to interpret the result vector.

    Values

    Possible values are:

    • NO_SOLUTION: the result vector is empty.
    • FEASIBLE_POINT: the result vector is a feasible point.
    • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
    • INFEASIBLE_POINT: the result vector is an infeasible point.
    • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
    • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
    • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
    • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
    • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
    • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
    source

    RotatedSecondOrderCone

    JuMP.RotatedSecondOrderConeType
    RotatedSecondOrderCone

    Rotated second order cone object that can be used to constrain the square of the euclidean norm of a vector x to be less than or equal to $2tu$ where t and u are nonnegative scalars. This is a shortcut for the MOI.RotatedSecondOrderCone.

    Example

    The following constrains $\|(x-1, x-2)\|^2_2 \le 2tx$ and $t, x \ge 0$:

    julia> model = Model();
    +[...]
    source

    QuadExpr

    QuadTermIterator

    JuMP.QuadTermIteratorType
    QuadTermIterator{GQE<:GenericQuadExpr}

    A struct that implements the iterate protocol in order to iterate over tuples of (coefficient, variable, variable) in the GenericQuadExpr.

    source

    ReferenceMap

    JuMP.ReferenceMapType
    GenericReferenceMap{T}

    Mapping between variable and constraint reference of a model and its copy. The reference of the copied model can be obtained by indexing the map with the reference of the corresponding reference of the original model.

    source

    ResultStatusCode

    JuMP.ResultStatusCodeType
    ResultStatusCode

    An Enum of possible values for the PrimalStatus and DualStatus attributes.

    The values indicate how to interpret the result vector.

    Values

    Possible values are:

    • NO_SOLUTION: the result vector is empty.
    • FEASIBLE_POINT: the result vector is a feasible point.
    • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
    • INFEASIBLE_POINT: the result vector is an infeasible point.
    • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
    • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
    • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
    • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
    • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
    • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
    source

    RotatedSecondOrderCone

    JuMP.RotatedSecondOrderConeType
    RotatedSecondOrderCone

    Rotated second order cone object that can be used to constrain the square of the euclidean norm of a vector x to be less than or equal to $2tu$ where t and u are nonnegative scalars. This is a shortcut for the MOI.RotatedSecondOrderCone.

    Example

    The following constrains $\|(x-1, x-2)\|^2_2 \le 2tx$ and $t, x \ge 0$:

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -2977,7 +2977,7 @@
     t
     
     julia> @constraint(model, [t, x, x-1, x-2] in RotatedSecondOrderCone())
    -[t, x, x - 1, x - 2] ∈ MathOptInterface.RotatedSecondOrderCone(4)
    source

    SOS1

    JuMP.SOS1Type
    SOS1(weights = Real[])

    The SOS1 (Special Ordered Set of Type 1) set constrains a vector x to the set where at most one variable can take a non-zero value, and all other elements are zero.

    The weights vector, if specified, induces an ordering of the variables; as such, it should contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

    This is a shortcut for the MOI.SOS1 set.

    Example

    julia> model = Model();
    +[t, x, x - 1, x - 2] ∈ MathOptInterface.RotatedSecondOrderCone(4)
    source

    SOS1

    JuMP.SOS1Type
    SOS1(weights = Real[])

    The SOS1 (Special Ordered Set of Type 1) set constrains a vector x to the set where at most one variable can take a non-zero value, and all other elements are zero.

    The weights vector, if specified, induces an ordering of the variables; as such, it should contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

    This is a shortcut for the MOI.SOS1 set.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:3] in SOS1([4.1, 3.2, 5.0]))
     3-element Vector{VariableRef}:
    @@ -2988,7 +2988,7 @@
     julia> print(model)
     Feasibility
     Subject to
    - [x[1], x[2], x[3]] ∈ MathOptInterface.SOS1{Float64}([4.1, 3.2, 5.0])
    source

    SOS2

    JuMP.SOS2Type
    SOS2(weights = Real[])

    The SOS2 (Special Ordered Set of Type 2) set constrains a vector x to the set where at most two variables can take a non-zero value, and all other elements are zero. In addition, the two non-zero values must be consecutive given the ordering of the x vector induced by weights.

    The weights vector, if specified, induces an ordering of the variables; as such, it must contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

    This is a shortcut for the MOI.SOS2 set.

    Example

    julia> model = Model();
    + [x[1], x[2], x[3]] ∈ MathOptInterface.SOS1{Float64}([4.1, 3.2, 5.0])
    source

    SOS2

    JuMP.SOS2Type
    SOS2(weights = Real[])

    The SOS2 (Special Ordered Set of Type 2) set constrains a vector x to the set where at most two variables can take a non-zero value, and all other elements are zero. In addition, the two non-zero values must be consecutive given the ordering of the x vector induced by weights.

    The weights vector, if specified, induces an ordering of the variables; as such, it must contain unique values. The weights vector must have the same number of elements as the vector x, and the element weights[i] corresponds to element x[i]. If not provided, the weights vector defaults to weights[i] = i.

    This is a shortcut for the MOI.SOS2 set.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:3] in SOS2([4.1, 3.2, 5.0]))
     3-element Vector{VariableRef}:
    @@ -2999,7 +2999,7 @@
     julia> print(model)
     Feasibility
     Subject to
    - [x[1], x[2], x[3]] ∈ MathOptInterface.SOS2{Float64}([4.1, 3.2, 5.0])
    source

    ScalarConstraint

    JuMP.ScalarConstraintType
    struct ScalarConstraint

    The data for a scalar constraint.

    See also the documentation on JuMP's representation of constraints for more background.

    Fields

    • .func: field contains a JuMP object representing the function
    • .set: field contains the MOI set

    Example

    A scalar constraint:

    julia> model = Model();
    + [x[1], x[2], x[3]] ∈ MathOptInterface.SOS2{Float64}([4.1, 3.2, 5.0])
    source

    ScalarConstraint

    JuMP.ScalarConstraintType
    struct ScalarConstraint

    The data for a scalar constraint.

    See also the documentation on JuMP's representation of constraints for more background.

    Fields

    • .func: field contains a JuMP object representing the function
    • .set: field contains the MOI set

    Example

    A scalar constraint:

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3016,14 +3016,14 @@
     2 x
     
     julia> object.set
    -MathOptInterface.LessThan{Float64}(1.0)
    source

    ScalarShape

    ScalarShape

    JuMP.ScalarShapeType
    ScalarShape()

    An AbstractShape that represents scalar constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
     julia> c = @constraint(model, x[2] <= 1);
     
     julia> shape(constraint_object(c))
    -ScalarShape()
    source

    ScalarVariable

    SecondOrderCone

    JuMP.SecondOrderConeType
    SecondOrderCone

    Second order cone object that can be used to constrain the euclidean norm of a vector x to be less than or equal to a nonnegative scalar t. This is a shortcut for the MOI.SecondOrderCone.

    Example

    The following constrains $\|(x-1, x-2)\|_2 \le t$ and $t \ge 0$:

    julia> model = Model();
    +ScalarShape()
    source

    ScalarVariable

    SecondOrderCone

    JuMP.SecondOrderConeType
    SecondOrderCone

    Second order cone object that can be used to constrain the euclidean norm of a vector x to be less than or equal to a nonnegative scalar t. This is a shortcut for the MOI.SecondOrderCone.

    Example

    The following constrains $\|(x-1, x-2)\|_2 \le t$ and $t \ge 0$:

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -3032,7 +3032,7 @@
     t
     
     julia> @constraint(model, [t, x-1, x-2] in SecondOrderCone())
    -[t, x - 1, x - 2] ∈ MathOptInterface.SecondOrderCone(3)
    source

    Semicontinuous

    JuMP.SemicontinuousType
    Semicontinuous(lower, upper)

    A short-cut for the MOI.Semicontinuous set.

    This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

    Example

    julia> model = Model();
    +[t, x - 1, x - 2] ∈ MathOptInterface.SecondOrderCone(3)
    source

    Semicontinuous

    JuMP.SemicontinuousType
    Semicontinuous(lower, upper)

    A short-cut for the MOI.Semicontinuous set.

    This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x in Semicontinuous(1, 2))
     x
    @@ -3040,7 +3040,7 @@
     julia> print(model)
     Feasibility
     Subject to
    - x ∈ MathOptInterface.Semicontinuous{Int64}(1, 2)
    source

    Semiinteger

    JuMP.SemiintegerType
    Semiinteger(lower, upper)

    A short-cut for the MOI.Semiinteger set.

    This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

    Example

    julia> model = Model();
    + x ∈ MathOptInterface.Semicontinuous{Int64}(1, 2)
    source

    Semiinteger

    JuMP.SemiintegerType
    Semiinteger(lower, upper)

    A short-cut for the MOI.Semiinteger set.

    This short-cut is useful because it automatically promotes lower and upper to the same type, and converts them into the element type supported by the JuMP model.

    Example

    julia> model = Model();
     
     julia> @variable(model, x in Semiinteger(3, 5))
     x
    @@ -3048,12 +3048,12 @@
     julia> print(model)
     Feasibility
     Subject to
    - x ∈ MathOptInterface.Semiinteger{Int64}(3, 5)
    source

    SensitivityReport

    SkewSymmetricMatrixShape

    JuMP.SkewSymmetricMatrixShapeType
    SkewSymmetricMatrixShape

    Shape object for a skew symmetric square matrix of side_dimension rows and columns. The vectorized form contains the entries of the upper-right triangular part of the matrix (without the diagonal) given column by column (or equivalently, the entries of the lower-left triangular part given row by row). The diagonal is zero.

    source

    SkewSymmetricMatrixSpace

    JuMP.SkewSymmetricMatrixSpaceType
    SkewSymmetricMatrixSpace()

    Use in the @variable macro to constrain a matrix of variables to be skew-symmetric.

    Example

    julia> model = Model();
    + x ∈ MathOptInterface.Semiinteger{Int64}(3, 5)
    source

    SensitivityReport

    SkewSymmetricMatrixShape

    JuMP.SkewSymmetricMatrixShapeType
    SkewSymmetricMatrixShape

    Shape object for a skew symmetric square matrix of side_dimension rows and columns. The vectorized form contains the entries of the upper-right triangular part of the matrix (without the diagonal) given column by column (or equivalently, the entries of the lower-left triangular part given row by row). The diagonal is zero.

    source

    SkewSymmetricMatrixSpace

    JuMP.SkewSymmetricMatrixSpaceType
    SkewSymmetricMatrixSpace()

    Use in the @variable macro to constrain a matrix of variables to be skew-symmetric.

    Example

    julia> model = Model();
     
     julia> @variable(model, Q[1:2, 1:2] in SkewSymmetricMatrixSpace())
     2×2 Matrix{AffExpr}:
      0        Q[1,2]
    - -Q[1,2]  0
    source

    SkipModelConvertScalarSetWrapper

    JuMP.SkipModelConvertScalarSetWrapperType
    SkipModelConvertScalarSetWrapper(set::MOI.AbstractScalarSet)

    JuMP uses model_convert to automatically promote MOI.AbstractScalarSet sets to the same value_type as the model.

    In cases there this is undesirable, wrap the set in SkipModelConvertScalarSetWrapper to pass the set un-changed to the solver.

    Warning

    This struct is intended for use internally by JuMP extensions. You should not need to use it in regular JuMP code.

    Example

    julia> model = Model();
    + -Q[1,2]  0
    source

    SkipModelConvertScalarSetWrapper

    JuMP.SkipModelConvertScalarSetWrapperType
    SkipModelConvertScalarSetWrapper(set::MOI.AbstractScalarSet)

    JuMP uses model_convert to automatically promote MOI.AbstractScalarSet sets to the same value_type as the model.

    In cases there this is undesirable, wrap the set in SkipModelConvertScalarSetWrapper to pass the set un-changed to the solver.

    Warning

    This struct is intended for use internally by JuMP extensions. You should not need to use it in regular JuMP code.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3061,15 +3061,15 @@
     x = 0.5
     
     julia> @constraint(model, x in SkipModelConvertScalarSetWrapper(MOI.EqualTo(1 // 2)))
    -x = 1//2
    source

    SquareMatrixShape

    JuMP.SquareMatrixShapeType
    SquareMatrixShape

    Shape object for a square matrix of side_dimension rows and columns. The vectorized form contains the entries of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

    source

    SymmetricMatrixAdjointShape

    SymmetricMatrixShape

    SquareMatrixShape

    JuMP.SquareMatrixShapeType
    SquareMatrixShape

    Shape object for a square matrix of side_dimension rows and columns. The vectorized form contains the entries of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

    source

    SymmetricMatrixAdjointShape

    SymmetricMatrixShape

    JuMP.SymmetricMatrixShapeType
    SymmetricMatrixShape(
         side_dimension::Int;
         needs_adjoint_dual::Bool = false,
    -)

    The shape object for a symmetric square matrix of side_dimension rows and columns.

    The vectorized form contains the entries of the upper-right triangular part of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

    needs_adjoint_dual

    By default, the dual_shape of SymmetricMatrixShape is also SymmetricMatrixShape. This is true for cases such as a LinearAlgebra.Symmetric matrix in PSDCone.

    However, JuMP also supports LinearAlgebra.Symmetric matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

    source

    SymmetricMatrixSpace

    JuMP.SymmetricMatrixSpaceType
    SymmetricMatrixSpace()

    Use in the @variable macro to constrain a matrix of variables to be symmetric.

    Example

    julia> model = Model();
    +)

    The shape object for a symmetric square matrix of side_dimension rows and columns.

    The vectorized form contains the entries of the upper-right triangular part of the matrix given column by column (or equivalently, the entries of the lower-left triangular part given row by row).

    needs_adjoint_dual

    By default, the dual_shape of SymmetricMatrixShape is also SymmetricMatrixShape. This is true for cases such as a LinearAlgebra.Symmetric matrix in PSDCone.

    However, JuMP also supports LinearAlgebra.Symmetric matrix in Zeros, which is interpreted as an element-wise equality constraint. By exploiting symmetry, we pass only the upper triangle of the equality constraints. This works for the primal, but it leads to a factor of 2 difference in the off-diagonal dual elements. (The dual value of the (i, j) element in the triangle formulation should be divided by 2 when spread across the (i, j) and (j, i) elements in the square matrix formulation.) If the constraint has this dual inconsistency, set needs_adjoint_dual = true.

    source

    SymmetricMatrixSpace

    JuMP.SymmetricMatrixSpaceType
    SymmetricMatrixSpace()

    Use in the @variable macro to constrain a matrix of variables to be symmetric.

    Example

    julia> model = Model();
     
     julia> @variable(model, Q[1:2, 1:2] in SymmetricMatrixSpace())
     2×2 LinearAlgebra.Symmetric{VariableRef, Matrix{VariableRef}}:
      Q[1,1]  Q[1,2]
    - Q[1,2]  Q[2,2]
    source

    TerminationStatusCode

    JuMP.TerminationStatusCodeType
    TerminationStatusCode

    An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

    Values

    Possible values are:

    • OPTIMIZE_NOT_CALLED: The algorithm has not started.
    • OPTIMAL: The algorithm found a globally optimal solution.
    • INFEASIBLE: The algorithm concluded that no feasible solution exists.
    • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
    • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
    • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
    • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
    • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
    • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
    • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
    • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
    • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
    • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
    • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
    • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
    • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
    • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
    • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
    • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
    • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
    • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
    • INVALID_MODEL: The algorithm stopped because the model is invalid.
    • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
    • INTERRUPTED: The algorithm stopped because of an interrupt signal.
    • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
    source

    UnorderedPair

    TerminationStatusCode

    JuMP.TerminationStatusCodeType
    TerminationStatusCode

    An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

    Values

    Possible values are:

    • OPTIMIZE_NOT_CALLED: The algorithm has not started.
    • OPTIMAL: The algorithm found a globally optimal solution.
    • INFEASIBLE: The algorithm concluded that no feasible solution exists.
    • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
    • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
    • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
    • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
    • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
    • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
    • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
    • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
    • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
    • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
    • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
    • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
    • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
    • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
    • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
    • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
    • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
    • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
    • INVALID_MODEL: The algorithm stopped because the model is invalid.
    • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
    • INTERRUPTED: The algorithm stopped because of an interrupt signal.
    • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
    source

    UnorderedPair

    JuMP.UnorderedPairType
    UnorderedPair(a::T, b::T)

    A wrapper type used by GenericQuadExpr with fields .a and .b.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -3078,12 +3078,12 @@
     
     julia> expr.terms
     OrderedCollections.OrderedDict{UnorderedPair{VariableRef}, Float64} with 1 entry:
    -  UnorderedPair{VariableRef}(x[1], x[2]) => 2.0
    source

    UpperBoundRef

    UpperBoundRef

    VariableConstrainedOnCreation

    JuMP.VariableConstrainedOnCreationType
    VariableConstrainedOnCreation <: AbstractVariable

    Variable scalar_variables constrained to belong to set.

    Adding this variable can be understood as doing:

    function JuMP.add_variable(
    +x ≤ 1
    source

    VariableConstrainedOnCreation

    JuMP.VariableConstrainedOnCreationType
    VariableConstrainedOnCreation <: AbstractVariable

    Variable scalar_variables constrained to belong to set.

    Adding this variable can be understood as doing:

    function JuMP.add_variable(
         model::GenericModel,
         variable::VariableConstrainedOnCreation,
         names,
    @@ -3091,9 +3091,9 @@
         var_ref = add_variable(model, variable.scalar_variable, name)
         add_constraint(model, VectorConstraint(var_ref, variable.set))
         return var_ref
    -end

    but adds the variables with MOI.add_constrained_variable(model, variable.set) instead.

    source

    VariableInfo

    JuMP.VariableInfoType
    VariableInfo{S,T,U,V}

    A struct by JuMP internally when creating variables. This may also be used by JuMP extensions to create new types of variables.

    See also: ScalarVariable.

    source

    VariableNotOwned

    JuMP.VariableNotOwnedType
    struct VariableNotOwned{V<:AbstractVariableRef} <: Exception
    +end

    but adds the variables with MOI.add_constrained_variable(model, variable.set) instead.

    source

    VariableInfo

    JuMP.VariableInfoType
    VariableInfo{S,T,U,V}

    A struct by JuMP internally when creating variables. This may also be used by JuMP extensions to create new types of variables.

    See also: ScalarVariable.

    source

    VariableNotOwned

    JuMP.VariableNotOwnedType
    struct VariableNotOwned{V<:AbstractVariableRef} <: Exception
         variable::V
    -end

    The variable variable was used in a model different to owner_model(variable).

    source

    VariableRef

    JuMP.VariableRefType
    GenericVariableRef{T} <: AbstractVariableRef

    Holds a reference to the model and the corresponding MOI.VariableIndex.

    source

    VariablesConstrainedOnCreation

    JuMP.VariablesConstrainedOnCreationType
    VariablesConstrainedOnCreation <: AbstractVariable

    Vector of variables scalar_variables constrained to belong to set. Adding this variable can be thought as doing:

    function JuMP.add_variable(
    +end

    The variable variable was used in a model different to owner_model(variable).

    source

    VariableRef

    JuMP.VariableRefType
    GenericVariableRef{T} <: AbstractVariableRef

    Holds a reference to the model and the corresponding MOI.VariableIndex.

    source

    VariablesConstrainedOnCreation

    JuMP.VariablesConstrainedOnCreationType
    VariablesConstrainedOnCreation <: AbstractVariable

    Vector of variables scalar_variables constrained to belong to set. Adding this variable can be thought as doing:

    function JuMP.add_variable(
         model::GenericModel,
         variable::VariablesConstrainedOnCreation,
         names,
    @@ -3102,7 +3102,7 @@
         var_refs = add_variable.(model, variable.scalar_variables, v_names)
         add_constraint(model, VectorConstraint(var_refs, variable.set))
         return reshape_vector(var_refs, variable.shape)
    -end

    but adds the variables with MOI.add_constrained_variables(model, variable.set) instead. See the MOI documentation for the difference between adding the variables with MOI.add_constrained_variables and adding them with MOI.add_variables and adding the constraint separately.

    source

    VectorConstraint

    JuMP.VectorConstraintType
    struct VectorConstraint

    The data for a vector constraint.

    See also the documentation on JuMP's representation of constraints.

    Fields

    • func: field contains a JuMP object representing the function
    • set: field contains the MOI set.
    • shape: field contains an AbstractShape matching the form in which the constraint was constructed (for example, by using matrices or flat vectors).

    Example

    julia> model = Model();
    +end

    but adds the variables with MOI.add_constrained_variables(model, variable.set) instead. See the MOI documentation for the difference between adding the variables with MOI.add_constrained_variables and adding them with MOI.add_variables and adding the constraint separately.

    source

    VectorConstraint

    JuMP.VectorConstraintType
    struct VectorConstraint

    The data for a vector constraint.

    See also the documentation on JuMP's representation of constraints.

    Fields

    • func: field contains a JuMP object representing the function
    • set: field contains the MOI set.
    • shape: field contains an AbstractShape matching the form in which the constraint was constructed (for example, by using matrices or flat vectors).

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:3]);
     
    @@ -3125,14 +3125,14 @@
     MathOptInterface.SecondOrderCone(3)
     
     julia> object.shape
    -VectorShape()
    source

    VectorShape

    VectorShape

    JuMP.VectorShapeType
    VectorShape()

    An AbstractShape that represents vector-valued constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
     julia> c = @constraint(model, x in SOS1());
     
     julia> shape(constraint_object(c))
    -VectorShape()
    source

    Zeros

    JuMP.ZerosType
    Zeros()

    The JuMP equivalent of the MOI.Zeros set, in which the dimension is inferred from the corresponding function.

    Example

    julia> model = Model();
    +VectorShape()
    source

    Zeros

    JuMP.ZerosType
    Zeros()

    The JuMP equivalent of the MOI.Zeros set, in which the dimension is inferred from the corresponding function.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2])
     2-element Vector{VariableRef}:
    @@ -3147,7 +3147,7 @@
     julia> b = [5, 6];
     
     julia> @constraint(model, A * x == b)
    -[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Zeros()
    source

    ALMOST_DUAL_INFEASIBLE

    ALMOST_INFEASIBLE

    ALMOST_LOCALLY_SOLVED

    JuMP.ALMOST_LOCALLY_SOLVEDConstant
    ALMOST_LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.

    source

    ALMOST_OPTIMAL

    AUTOMATIC

    DIRECT

    JuMP.DIRECTConstant

    moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.

    source

    DUAL_INFEASIBLE

    JuMP.DUAL_INFEASIBLEConstant
    DUAL_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

    source

    FEASIBILITY_SENSE

    FEASIBLE_POINT

    INFEASIBILITY_CERTIFICATE

    JuMP.INFEASIBILITY_CERTIFICATEConstant
    INFEASIBILITY_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

    source

    INFEASIBLE

    INFEASIBLE_OR_UNBOUNDED

    JuMP.INFEASIBLE_OR_UNBOUNDEDConstant
    INFEASIBLE_OR_UNBOUNDED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.

    source

    INFEASIBLE_POINT

    INTERRUPTED

    INVALID_MODEL

    INVALID_OPTION

    ITERATION_LIMIT

    LOCALLY_INFEASIBLE

    JuMP.LOCALLY_INFEASIBLEConstant
    LOCALLY_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

    source

    LOCALLY_SOLVED

    JuMP.LOCALLY_SOLVEDConstant
    LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

    source

    MANUAL

    JuMP.MANUALConstant

    moi_backend field holds a CachingOptimizer in MANUAL mode.

    source

    MAX_SENSE

    MEMORY_LIMIT

    MIN_SENSE

    NEARLY_FEASIBLE_POINT

    NEARLY_INFEASIBILITY_CERTIFICATE

    NEARLY_REDUCTION_CERTIFICATE

    NODE_LIMIT

    JuMP.NODE_LIMITConstant
    NODE_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.

    source

    NORM_LIMIT

    NO_SOLUTION

    NUMERICAL_ERROR

    OBJECTIVE_LIMIT

    OPTIMAL

    OPTIMIZE_NOT_CALLED

    OTHER_ERROR

    JuMP.OTHER_ERRORConstant
    OTHER_ERROR::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.

    source

    OTHER_LIMIT

    OTHER_RESULT_STATUS

    JuMP.OTHER_RESULT_STATUSConstant
    OTHER_RESULT_STATUS::ResultStatusCode

    An instance of the ResultStatusCode enum.

    OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above

    source

    REDUCTION_CERTIFICATE

    JuMP.REDUCTION_CERTIFICATEConstant
    REDUCTION_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

    source

    SLOW_PROGRESS

    JuMP.SLOW_PROGRESSConstant
    SLOW_PROGRESS::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.

    source

    SOLUTION_LIMIT

    JuMP.SOLUTION_LIMITConstant
    SOLUTION_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

    source

    TIME_LIMIT

    UNKNOWN_RESULT_STATUS

    op_and

    JuMP.op_andConstant
    op_and(x, y)

    A function that falls back to x & y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
    +[x[1] + 2 x[2] - 5, 3 x[1] + 4 x[2] - 6] ∈ Zeros()
    source

    ALMOST_DUAL_INFEASIBLE

    ALMOST_INFEASIBLE

    ALMOST_LOCALLY_SOLVED

    JuMP.ALMOST_LOCALLY_SOLVEDConstant
    ALMOST_LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.

    source

    ALMOST_OPTIMAL

    AUTOMATIC

    DIRECT

    JuMP.DIRECTConstant

    moi_backend field holds an AbstractOptimizer. No extra copy of the model is stored. The moi_backend must support add_constraint etc.

    source

    DUAL_INFEASIBLE

    JuMP.DUAL_INFEASIBLEConstant
    DUAL_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

    source

    FEASIBILITY_SENSE

    FEASIBLE_POINT

    INFEASIBILITY_CERTIFICATE

    JuMP.INFEASIBILITY_CERTIFICATEConstant
    INFEASIBILITY_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

    source

    INFEASIBLE

    INFEASIBLE_OR_UNBOUNDED

    JuMP.INFEASIBLE_OR_UNBOUNDEDConstant
    INFEASIBLE_OR_UNBOUNDED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.

    source

    INFEASIBLE_POINT

    INTERRUPTED

    INVALID_MODEL

    INVALID_OPTION

    ITERATION_LIMIT

    LOCALLY_INFEASIBLE

    JuMP.LOCALLY_INFEASIBLEConstant
    LOCALLY_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

    source

    LOCALLY_SOLVED

    JuMP.LOCALLY_SOLVEDConstant
    LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

    source

    MANUAL

    JuMP.MANUALConstant

    moi_backend field holds a CachingOptimizer in MANUAL mode.

    source

    MAX_SENSE

    MEMORY_LIMIT

    MIN_SENSE

    NEARLY_FEASIBLE_POINT

    NEARLY_INFEASIBILITY_CERTIFICATE

    NEARLY_REDUCTION_CERTIFICATE

    NODE_LIMIT

    JuMP.NODE_LIMITConstant
    NODE_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.

    source

    NORM_LIMIT

    NO_SOLUTION

    NUMERICAL_ERROR

    OBJECTIVE_LIMIT

    OPTIMAL

    OPTIMIZE_NOT_CALLED

    OTHER_ERROR

    JuMP.OTHER_ERRORConstant
    OTHER_ERROR::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.

    source

    OTHER_LIMIT

    OTHER_RESULT_STATUS

    JuMP.OTHER_RESULT_STATUSConstant
    OTHER_RESULT_STATUS::ResultStatusCode

    An instance of the ResultStatusCode enum.

    OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above

    source

    REDUCTION_CERTIFICATE

    JuMP.REDUCTION_CERTIFICATEConstant
    REDUCTION_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

    source

    SLOW_PROGRESS

    JuMP.SLOW_PROGRESSConstant
    SLOW_PROGRESS::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.

    source

    SOLUTION_LIMIT

    JuMP.SOLUTION_LIMITConstant
    SOLUTION_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

    source

    TIME_LIMIT

    UNKNOWN_RESULT_STATUS

    op_and

    JuMP.op_andConstant
    op_and(x, y)

    A function that falls back to x & y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3155,7 +3155,7 @@
     false
     
     julia> op_and(true, x)
    -true && x
    source

    op_equal_to

    JuMP.op_equal_toConstant
    op_equal_to(x, y)

    A function that falls back to x == y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
    +true && x
    source

    op_equal_to

    JuMP.op_equal_toConstant
    op_equal_to(x, y)

    A function that falls back to x == y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3163,7 +3163,7 @@
     true
     
     julia> op_equal_to(x, 2)
    -x == 2
    source

    op_greater_than_or_equal_to

    op_greater_than_or_equal_to

    JuMP.op_greater_than_or_equal_toConstant
    op_greater_than_or_equal_to(x, y)

    A function that falls back to x >= y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3171,7 +3171,7 @@
     true
     
     julia> op_greater_than_or_equal_to(x, 2)
    -x >= 2
    source

    op_less_than_or_equal_to

    op_less_than_or_equal_to

    JuMP.op_less_than_or_equal_toConstant
    op_less_than_or_equal_to(x, y)

    A function that falls back to x <= y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3179,7 +3179,7 @@
     true
     
     julia> op_less_than_or_equal_to(x, 2)
    -x <= 2
    source

    op_or

    JuMP.op_orConstant
    op_or(x, y)

    A function that falls back to x | y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
    +x <= 2
    source

    op_or

    JuMP.op_orConstant
    op_or(x, y)

    A function that falls back to x | y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3187,7 +3187,7 @@
     true
     
     julia> op_or(true, x)
    -true || x
    source

    op_strictly_greater_than

    op_strictly_greater_than

    JuMP.op_strictly_greater_thanConstant
    op_strictly_greater_than(x, y)

    A function that falls back to x > y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3195,7 +3195,7 @@
     false
     
     julia> op_strictly_greater_than(x, 2)
    -x > 2
    source

    op_strictly_less_than

    op_strictly_less_than

    JuMP.op_strictly_less_thanConstant
    op_strictly_less_than(x, y)

    A function that falls back to x < y, but when called with JuMP variables or expressions, returns a GenericNonlinearExpr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3203,7 +3203,7 @@
     true
     
     julia> op_strictly_less_than(x, 2)
    -x < 2
    source

    Base.empty!(::GenericModel)

    Base.empty!Method
    empty!(model::GenericModel)::GenericModel

    Empty the model, that is, remove all variables, constraints and model attributes but not optimizer attributes. Always return the argument.

    Note: removes extensions data.

    Example

    julia> model = Model();
    +x < 2
    source

    Base.empty!(::GenericModel)

    Base.empty!Method
    empty!(model::GenericModel)::GenericModel

    Empty the model, that is, remove all variables, constraints and model attributes but not optimizer attributes. Always return the argument.

    Note: removes extensions data.

    Example

    julia> model = Model();
     
     julia> @variable(model, x[1:2]);
     
    @@ -3223,7 +3223,7 @@
     Subject to
     
     julia> isempty(model)
    -true
    source

    Base.isempty(::GenericModel)

    Base.isemptyMethod
    isempty(model::GenericModel)

    Verifies whether the model is empty, that is, whether the MOI backend is empty and whether the model is in the same state as at its creation, apart from optimizer attributes.

    Example

    julia> model = Model();
    +true
    source

    Base.isempty(::GenericModel)

    Base.isemptyMethod
    isempty(model::GenericModel)

    Verifies whether the model is empty, that is, whether the MOI backend is empty and whether the model is in the same state as at its creation, apart from optimizer attributes.

    Example

    julia> model = Model();
     
     julia> isempty(model)
     true
    @@ -3231,7 +3231,7 @@
     julia> @variable(model, x[1:2]);
     
     julia> isempty(model)
    -false
    source

    Base.copy(::AbstractModel)

    Base.copyMethod
    copy(model::AbstractModel)

    Return a copy of the model model. It is similar to copy_model except that it does not return the mapping between the references of model and its copy.

    Note

    Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

    Example

    In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

    julia> model = Model();
    +false
    source

    Base.copy(::AbstractModel)

    Base.copyMethod
    copy(model::AbstractModel)

    Return a copy of the model model. It is similar to copy_model except that it does not return the mapping between the references of model and its copy.

    Note

    Model copy is not supported in DIRECT mode, that is, when a model is constructed using the direct_model constructor instead of the Model constructor. Moreover, independently on whether an optimizer was provided at model construction, the new model will have no optimizer, that is, an optimizer will have to be provided to the new model in the optimize! call.

    Example

    In the following example, a model model is constructed with a variable x and a constraint cref. It is then copied into a model new_model with the new references assigned to x_new and cref_new.

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -3245,12 +3245,12 @@
     x
     
     julia> cref_new = model[:cref]
    -cref : x = 2
    source

    Base.write(::IO, ::GenericModel; ::MOI.FileFormats.FileFormat)

    Base.write(::IO, ::GenericModel; ::MOI.FileFormats.FileFormat)

    Base.writeMethod
    Base.write(
         io::IO,
         model::GenericModel;
         format::MOI.FileFormats.FileFormat = MOI.FileFormats.FORMAT_MOF,
         kwargs...,
    -)

    Write the JuMP model model to io in the format format.

    Other kwargs are passed to the Model constructor of the chosen format.

    source

    MOI.Utilities.reset_optimizer(::GenericModel)

    MOI.Utilities.drop_optimizer(::GenericModel)

    MOI.Utilities.attach_optimizer(::GenericModel)

    @NLconstraint

    JuMP.@NLconstraintMacro
    @NLconstraint(model::GenericModel, expr)

    Add a constraint described by the nonlinear expression expr. See also @constraint.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraint with @constraint.

    Example

    julia> model = Model();
    +)

    Write the JuMP model model to io in the format format.

    Other kwargs are passed to the Model constructor of the chosen format.

    source

    MOI.Utilities.reset_optimizer(::GenericModel)

    MOI.Utilities.drop_optimizer(::GenericModel)

    MOI.Utilities.attach_optimizer(::GenericModel)

    @NLconstraint

    JuMP.@NLconstraintMacro
    @NLconstraint(model::GenericModel, expr)

    Add a constraint described by the nonlinear expression expr. See also @constraint.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraint with @constraint.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -3262,7 +3262,7 @@
     3-element Vector{NonlinearConstraintRef{ScalarShape}}:
      (sin(1.0 * x) - 1.0 / 1.0) - 0.0 ≤ 0
      (sin(2.0 * x) - 1.0 / 2.0) - 0.0 ≤ 0
    - (sin(3.0 * x) - 1.0 / 3.0) - 0.0 ≤ 0
    source

    @NLconstraints

    JuMP.@NLconstraintsMacro
    @NLconstraints(model, args...)

    Adds multiple nonlinear constraints to model at once, in the same fashion as the @NLconstraint macro.

    The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the constraints that were defined.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraints with @constraints.

    Example

    julia> model = Model();
    + (sin(3.0 * x) - 1.0 / 3.0) - 0.0 ≤ 0
    source

    @NLconstraints

    JuMP.@NLconstraintsMacro
    @NLconstraints(model, args...)

    Adds multiple nonlinear constraints to model at once, in the same fashion as the @NLconstraint macro.

    The model must be the first argument, and multiple constraints can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the constraints that were defined.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLconstraints with @constraints.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3278,7 +3278,7 @@
                t >= sqrt(x^2 + y^2)
                [i = 1:2], z[i] <= log(a[i])
            end)
    -((t - sqrt(x ^ 2.0 + y ^ 2.0)) - 0.0 ≥ 0, NonlinearConstraintRef{ScalarShape}[(z[1] - log(4.0)) - 0.0 ≤ 0, (z[2] - log(5.0)) - 0.0 ≤ 0])
    source

    @NLexpression

    JuMP.@NLexpressionMacro
    @NLexpression(args...)

    Efficiently build a nonlinear expression which can then be inserted in other nonlinear constraints and the objective. See also [@expression].

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpression with @expression.

    Example

    julia> model = Model();
    +((t - sqrt(x ^ 2.0 + y ^ 2.0)) - 0.0 ≥ 0, NonlinearConstraintRef{ScalarShape}[(z[1] - log(4.0)) - 0.0 ≤ 0, (z[2] - log(5.0)) - 0.0 ≤ 0])
    source

    @NLexpression

    JuMP.@NLexpressionMacro
    @NLexpression(args...)

    Efficiently build a nonlinear expression which can then be inserted in other nonlinear constraints and the objective. See also [@expression].

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpression with @expression.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -3299,7 +3299,7 @@
      subexpression[4]: sin(3.0 * x)
     
     julia> my_expr_2 = @NLexpression(model, log(1 + sum(exp(my_expr_1[i]) for i in 1:2)))
    -subexpression[5]: log(1.0 + (exp(subexpression[2]) + exp(subexpression[3])))
    source

    @NLexpressions

    JuMP.@NLexpressionsMacro
    @NLexpressions(model, args...)

    Adds multiple nonlinear expressions to model at once, in the same fashion as the @NLexpression macro.

    The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the expressions that were defined.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpressions with @expressions.

    Example

    julia> model = Model();
    +subexpression[5]: log(1.0 + (exp(subexpression[2]) + exp(subexpression[3])))
    source

    @NLexpressions

    JuMP.@NLexpressionsMacro
    @NLexpressions(model, args...)

    Adds multiple nonlinear expressions to model at once, in the same fashion as the @NLexpression macro.

    The model must be the first argument, and multiple expressions can be added on multiple lines wrapped in a begin ... end block.

    The macro returns a tuple containing the expressions that were defined.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLexpressions with @expressions.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
    @@ -3313,7 +3313,7 @@
                my_expr, sqrt(x^2 + y^2)
                my_expr_1[i = 1:2], log(a[i]) - z[i]
            end)
    -(subexpression[1]: sqrt(x ^ 2.0 + y ^ 2.0), NonlinearExpression[subexpression[2]: log(4.0) - z[1], subexpression[3]: log(5.0) - z[2]])
    source

    @NLobjective

    JuMP.@NLobjectiveMacro
    @NLobjective(model, sense, expression)

    Add a nonlinear objective to model with optimization sense sense. sense must be Max or Min.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLobjective with @objective.

    Example

    julia> model = Model();
    +(subexpression[1]: sqrt(x ^ 2.0 + y ^ 2.0), NonlinearExpression[subexpression[2]: log(4.0) - z[1], subexpression[3]: log(5.0) - z[2]])
    source

    @NLobjective

    JuMP.@NLobjectiveMacro
    @NLobjective(model, sense, expression)

    Add a nonlinear objective to model with optimization sense sense. sense must be Max or Min.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace @NLobjective with @objective.

    Example

    julia> model = Model();
     
     julia> @variable(model, x)
     x
    @@ -3322,7 +3322,7 @@
     
     julia> print(model)
     Max 2.0 * x + 1.0 + sin(x)
    -Subject to
    source

    @NLparameter

    JuMP.@NLparameterMacro
    @NLparameter(model, param == value)

    Create and return a nonlinear parameter param attached to the model model with initial value set to value. Nonlinear parameters may be used only in nonlinear expressions.

    Example

    julia> model = Model();
    +Subject to
    source

    @NLparameter

    JuMP.@NLparameterMacro
    @NLparameter(model, param == value)

    Create and return a nonlinear parameter param attached to the model model with initial value set to value. Nonlinear parameters may be used only in nonlinear expressions.

    Example

    julia> model = Model();
     
     julia> @NLparameter(model, x == 10)
     x == 10.0
    @@ -3352,7 +3352,7 @@
      parameter[3] == 6.0
     
     julia> value(y[2])
    -4.0
    source

    @NLparameters

    JuMP.@NLparametersMacro
     @NLparameters(model, args...)

    Create and return multiple nonlinear parameters attached to model model, in the same fashion as @NLparameter macro.

    The model must be the first argument, and multiple parameters can be added on multiple lines wrapped in a begin ... end block. Distinct parameters need to be placed on separate lines as in the following example.

    The macro returns a tuple containing the parameters that were defined.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace a call like

    @NLparameters(model, begin
    +4.0
    source

    @NLparameters

    JuMP.@NLparametersMacro
     @NLparameters(model, args...)

    Create and return multiple nonlinear parameters attached to model model, in the same fashion as @NLparameter macro.

    The model must be the first argument, and multiple parameters can be added on multiple lines wrapped in a begin ... end block. Distinct parameters need to be placed on separate lines as in the following example.

    The macro returns a tuple containing the parameters that were defined.

    Compat

    This macro is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling. In most cases, you can replace a call like

    @NLparameters(model, begin
         p == value
     end)

    with

    @variables(model, begin
         p in Parameter(value)
    @@ -3364,17 +3364,17 @@
            end);
     
     julia> value(x)
    -10.0
    source

    add_nonlinear_constraint

    JuMP.add_nonlinear_constraintFunction
    add_nonlinear_constraint(model::Model, expr::Expr)

    Add a nonlinear constraint described by the Julia expression ex to model.

    This function is most useful if the expression ex is generated programmatically, and you cannot use @NLconstraint.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    Notes

    • You must interpolate the variables directly into the expression expr.

    Example

    julia> model = Model();
    +10.0
    source

    add_nonlinear_constraint

    JuMP.add_nonlinear_constraintFunction
    add_nonlinear_constraint(model::Model, expr::Expr)

    Add a nonlinear constraint described by the Julia expression ex to model.

    This function is most useful if the expression ex is generated programmatically, and you cannot use @NLconstraint.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    Notes

    • You must interpolate the variables directly into the expression expr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> add_nonlinear_constraint(model, :($(x) + $(x)^2 <= 1))
    -(x + x ^ 2.0) - 1.0 ≤ 0
    source

    add_nonlinear_expression

    JuMP.add_nonlinear_expressionFunction
    add_nonlinear_expression(model::Model, expr::Expr)

    Add a nonlinear expression expr to model.

    This function is most useful if the expression expr is generated programmatically, and you cannot use @NLexpression.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    Notes

    • You must interpolate the variables directly into the expression expr.

    Example

    julia> model = Model();
    +(x + x ^ 2.0) - 1.0 ≤ 0
    source

    add_nonlinear_expression

    JuMP.add_nonlinear_expressionFunction
    add_nonlinear_expression(model::Model, expr::Expr)

    Add a nonlinear expression expr to model.

    This function is most useful if the expression expr is generated programmatically, and you cannot use @NLexpression.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    Notes

    • You must interpolate the variables directly into the expression expr.

    Example

    julia> model = Model();
     
     julia> @variable(model, x);
     
     julia> add_nonlinear_expression(model, :($(x) + $(x)^2))
    -subexpression[1]: x + x ^ 2.0
    source

    add_nonlinear_parameter

    JuMP.add_nonlinear_parameterFunction
    add_nonlinear_parameter(model::Model, value::Real)

    Add an anonymous parameter to the model.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    all_nonlinear_constraints

    get_optimizer_attribute

    add_nonlinear_parameter

    JuMP.add_nonlinear_parameterFunction
    add_nonlinear_parameter(model::Model, value::Real)

    Add an anonymous parameter to the model.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    all_nonlinear_constraints

    get_optimizer_attribute

    JuMP.get_optimizer_attributeFunction
    get_optimizer_attribute(
         model::Union{GenericModel,MOI.OptimizerWithAttributes},
         attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
     )

    Return the value associated with the solver-specific attribute attr.

    If attr is an AbstractString, this is equivalent to get_optimizer_attribute(model, MOI.RawOptimizerAttribute(name)).

    Compat

    This method will remain in all v1.X releases of JuMP, but it may be removed in a future v2.0 release. We recommend using get_attribute instead.

    See also: set_optimizer_attribute, set_optimizer_attributes.

    Example

    julia> import Ipopt
    @@ -3382,18 +3382,18 @@
     julia> model = Model(Ipopt.Optimizer);
     
     julia> get_optimizer_attribute(model, MOI.Silent())
    -false
    source

    nonlinear_constraint_string

    nonlinear_constraint_string

    JuMP.nonlinear_constraint_stringFunction
    nonlinear_constraint_string(
         model::GenericModel,
         mode::MIME,
         c::_NonlinearConstraint,
    -)

    Return a string representation of the nonlinear constraint c belonging to model, given the mode.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    nonlinear_dual_start_value

    nonlinear_expr_string

    JuMP.nonlinear_expr_stringFunction
    nonlinear_expr_string(
    +)

    Return a string representation of the nonlinear constraint c belonging to model, given the mode.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    nonlinear_dual_start_value

    nonlinear_expr_string

    JuMP.nonlinear_expr_stringFunction
    nonlinear_expr_string(
         model::GenericModel,
         mode::MIME,
         c::MOI.Nonlinear.Expression,
    -)

    Return a string representation of the nonlinear expression c belonging to model, given the mode.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    nonlinear_model

    JuMP.nonlinear_modelFunction
    nonlinear_model(
    +)

    Return a string representation of the nonlinear expression c belonging to model, given the mode.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    nonlinear_model

    JuMP.nonlinear_modelFunction
    nonlinear_model(
         model::GenericModel;
         force::Bool = false,
    -)::Union{MOI.Nonlinear.Model,Nothing}

    If model has nonlinear components, return a MOI.Nonlinear.Model, otherwise return nothing.

    If force, always return a MOI.Nonlinear.Model, and if one does not exist for the model, create an empty one.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    num_nonlinear_constraints

    register

    JuMP.registerFunction
    register(
    +)::Union{MOI.Nonlinear.Model,Nothing}

    If model has nonlinear components, return a MOI.Nonlinear.Model, otherwise return nothing.

    If force, always return a MOI.Nonlinear.Model, and if one does not exist for the model, create an empty one.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source

    num_nonlinear_constraints

    register

    JuMP.registerFunction
    register(
         model::Model,
         op::Symbol,
         dimension::Integer,
    @@ -3421,7 +3421,7 @@
     
     julia> register(model, :g, 2, g; autodiff = true)
     
    -julia> @NLobjective(model, Min, g(x[1], x[2]))
    source
    register(
    +julia> @NLobjective(model, Min, g(x[1], x[2]))
    source
    register(
         model::Model,
         s::Symbol,
         dimension::Integer,
    @@ -3460,7 +3460,7 @@
     
     julia> register(model, :g, 2, g, ∇g)
     
    -julia> @NLobjective(model, Min, g(x[1], x[2]))
    source
    register(
    +julia> @NLobjective(model, Min, g(x[1], x[2]))
    source
    register(
         model::Model,
         s::Symbol,
         dimension::Integer,
    @@ -3484,7 +3484,7 @@
     julia> register(model, :foo, 1, f, ∇f, ∇²f)
     
     julia> @NLobjective(model, Min, foo(x))
    -
    source

    set_nonlinear_dual_start_value

    set_nonlinear_dual_start_value

    JuMP.set_nonlinear_dual_start_valueFunction
    set_nonlinear_dual_start_value(
         model::Model,
         start::Union{Nothing,Vector{Float64}},
     )

    Set the value of the MOI attribute MOI.NLPBlockDualStart.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    The start vector corresponds to the Lagrangian duals of the nonlinear constraints, in the order given by all_nonlinear_constraints. That is, you must pass a single start vector corresponding to all of the nonlinear constraints in a single function call; you cannot set the dual start value of nonlinear constraints one-by-one. The example below demonstrates how to use all_nonlinear_constraints to create a mapping between the nonlinear constraint references and the start vector.

    Pass nothing to unset a previous start.

    Example

    julia> model = Model();
    @@ -3507,7 +3507,7 @@
     julia> nonlinear_dual_start_value(model)
     2-element Vector{Float64}:
      -1.0
    -  1.0
    source

    set_nonlinear_objective

    set_nonlinear_objective

    JuMP.set_nonlinear_objectiveFunction
    set_nonlinear_objective(
         model::Model,
         sense::MOI.OptimizationSense,
         expr::Expr,
    @@ -3515,17 +3515,17 @@
     
     julia> @variable(model, x);
     
    -julia> set_nonlinear_objective(model, MIN_SENSE, :($(x) + $(x)^2))
    source

    set_normalized_coefficients

    set_normalized_coefficients

    JuMP.set_normalized_coefficientsFunction
    set_normalized_coefficients(
         constraint::ConstraintRef{<:AbstractModel,<:MOI.ConstraintIndex{F}},
         variable::AbstractVariableRef,
         new_coefficients::Vector{Tuple{Int64,T}},
    -) where {T,F<:Union{MOI.VectorAffineFunction{T},MOI.VectorQuadraticFunction{T}}}

    A deprecated method that now redirects to set_normalized_coefficient.

    source

    set_optimizer_attribute

    set_optimizer_attribute

    JuMP.set_optimizer_attributeFunction
    set_optimizer_attribute(
         model::Union{GenericModel,MOI.OptimizerWithAttributes},
         attr::Union{AbstractString,MOI.AbstractOptimizerAttribute},
         value,
     )

    Set the solver-specific attribute attr in model to value.

    If attr is an AbstractString, this is equivalent to set_optimizer_attribute(model, MOI.RawOptimizerAttribute(name), value).

    Compat

    This method will remain in all v1.X releases of JuMP, but it may be removed in a future v2.0 release. We recommend using set_attribute instead.

    See also: set_optimizer_attributes, get_optimizer_attribute.

    Example

    julia> model = Model();
     
    -julia> set_optimizer_attribute(model, MOI.Silent(), true)
    source

    set_optimizer_attributes

    set_optimizer_attributes

    JuMP.set_optimizer_attributesFunction
    set_optimizer_attributes(
         model::Union{GenericModel,MOI.OptimizerWithAttributes},
         pairs::Pair...,
     )

    Given a list of attribute => value pairs, calls set_optimizer_attribute(model, attribute, value) for each pair.

    Compat

    This method will remain in all v1.X releases of JuMP, but it may be removed in a future v2.0 release. We recommend using set_attributes instead.

    See also: set_optimizer_attribute, get_optimizer_attribute.

    Example

    julia> import Ipopt
    @@ -3538,7 +3538,7 @@
     
     julia> set_optimizer_attribute(model, "tol", 1e-4)
     
    -julia> set_optimizer_attribute(model, "max_iter", 100)
    source

    set_value

    JuMP.set_valueFunction
    set_value(p::NonlinearParameter, v::Number)

    Store the value v in the nonlinear parameter p.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    Example

    julia> model = Model();
    +julia> set_optimizer_attribute(model, "max_iter", 100)
    source

    set_value

    JuMP.set_valueFunction
    set_value(p::NonlinearParameter, v::Number)

    Store the value v in the nonlinear parameter p.

    Compat

    This function is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    Example

    julia> model = Model();
     
     julia> @NLparameter(model, p == 0)
     p == 0.0
    @@ -3547,4 +3547,4 @@
     5
     
     julia> value(p)
    -5.0
    source

    NonlinearConstraintIndex

    NonlinearConstraintRef

    NonlinearExpression

    NonlinearParameter

    JuMP.NonlinearParameterType
    NonlinearParameter <: AbstractJuMPScalar

    A struct to represent a nonlinear parameter.

    Create a parameter using @NLparameter.

    Compat

    This type is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source
    +5.0source

    NonlinearConstraintIndex

    NonlinearConstraintRef

    NonlinearExpression

    NonlinearParameter

    JuMP.NonlinearParameterType
    NonlinearParameter <: AbstractJuMPScalar

    A struct to represent a nonlinear parameter.

    Create a parameter using @NLparameter.

    Compat

    This type is part of the legacy nonlinear interface. Consider using the new nonlinear interface documented in Nonlinear Modeling.

    source
    diff --git a/previews/PR3913/background/algebraic_modeling_languages/index.html b/previews/PR3913/background/algebraic_modeling_languages/index.html index 38075eb48f0..d9d94b2e34c 100644 --- a/previews/PR3913/background/algebraic_modeling_languages/index.html +++ b/previews/PR3913/background/algebraic_modeling_languages/index.html @@ -138,4 +138,4 @@ julia> highs_knapsack([1.0, 2.0], [0.5, 0.5], 1.25) 2-element Vector{Float64}: 0.0 - 2.0

    We've now gone from a algebraic model that looked identical to the mathematical model we started with, to a verbose function that uses HiGHS-specific functionality.

    The difference between algebraic_knapsack and highs_knapsack highlights the benefit that algebraic modeling languages provide to users. Moreover, if we used a different solver, the solver-specific function would be entirely different. A key benefit of an algebraic modeling language is that you can change the solver without needing to rewrite the model.

    + 2.0

    We've now gone from a algebraic model that looked identical to the mathematical model we started with, to a verbose function that uses HiGHS-specific functionality.

    The difference between algebraic_knapsack and highs_knapsack highlights the benefit that algebraic modeling languages provide to users. Moreover, if we used a different solver, the solver-specific function would be entirely different. A key benefit of an algebraic modeling language is that you can change the solver without needing to rewrite the model.

    diff --git a/previews/PR3913/background/bibliography/index.html b/previews/PR3913/background/bibliography/index.html index 49048181aaf..5699efeee17 100644 --- a/previews/PR3913/background/bibliography/index.html +++ b/previews/PR3913/background/bibliography/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Bibliography

    +

    Bibliography

    diff --git a/previews/PR3913/changelog/index.html b/previews/PR3913/changelog/index.html index 2e581b43cb5..b61e67a6033 100644 --- a/previews/PR3913/changelog/index.html +++ b/previews/PR3913/changelog/index.html @@ -12,4 +12,4 @@ new_b = backend(model)

    W~qSCt388k@naF8NNqBUozCpKb)pFfJ@FH z$4vLfPjqyW*}-)_wQwLtFgXfJxE{rd6Q1`;9gXPkXgY>mR^QBLgPBb?!H9H&{vx2&~1oNXv7 zY8A5~8B z$9mLebaGS1bZypqrt2bK+Gv~=uTZKM2W6M|Uis0?5YH&Zh-lxq-jL|aC8|Dj!J}E@ ztagf8?3(A()dfwYn%o1Fwj25eRx~CT{v@OigiaO2Xc{iin!7(uTeRYOe@^_e-B$!C zn7#05LIjzM8nDSq5?=KU0}NA6!^Ot=qNU;_&jh?UV4Mz8jQ_%Qd-~pTn5~NB|7(o= zCBhLJ!7oCSG%)>bIWfdj-rU;VsO2FmUrd=PwAaJgq(a325wSw_Wy$bY+0Ierss2wI zr7m@O%6D~da#D!&#R5#nG{?sTrDh|YoFrBqqo!Vw)pWgdj)$uCeFZGc&h%D0j1-5& ze-tGBy7Eq&po~dZvU_m`ef8Okd$B^hhjF#(!AovwJ*H2;yGo@9{T!+Ey^R?MKH#*; zO5i=|$bmI2@Z)`NOoaK_^B#^GujJRGF5;xmOWFo9Oy(1kriR6=NODAV(UWrd=WD12 z*&>qIunU=49T@2+e}w=CehHzquRd+BX-g|p{z`I|XJ|}gF4R39RVw`H$q>!p-e1we zIL01cb=3C@ldXr~$G-kT)PB6>5oYh{ruusyt2Ji*5s_C`L-}7F86{0)IEO*B%{%e~ zDn9L5Y$|tb()-`G+;^yU(f`*^Y^WDTZCB&}1$bL*b=re7H=lB%EMQf;QK1&0oNjd2 z*&I%-^XYf~Rwq8wZjC19mm=)&`1;rgXEaDNuflL~ANAc{{>N&i!9|4_9bFutgEG{t z4rAd)kV(4B?Fnw&EY;8a+{IWt{$cdgax0gfw8ZWdk%|73KfkZHF1~r3xtw+6ulaiM zH~>V|@jsmwgpKvK-*Ttg@`XvtZ zP2=yTUD@JG$FEi_!DeTW79N%nXhCktkM9zICDQyyygeSsJQE zfkF{am)xW`zX)Hc`1?HcR_0nC|EX&HvL(nj=c$(WXQjPSgtFm0>NU!t^9A>K9Grz_ z@>rC~8nWxixN|<|=|V?(7TrJoJuvs<)|dFcT1|KR7O{iwKAilpXecJQd)u0=k*lG2 zh5R-&md9|R@zq|8BYRpeMryTRV043KIB-1%1I1hovdVVQr6Lg~^1EwS=#h#4w!)Ui z8>)>sa0#Gkm2LIE+MIv5uE}ym#d5 zX#$VJc4f$nKGigs+-C2i7kMG+)k+Dm!jz?!ePL)t))i&T45i%K-bdUfLnl5@7 z3M76CaWpZyd877tpK8)a=MI7DAFT4&wOEd&gZx2G89FB~eQOn7-|6F?JdHwXYyR8i z7qq|7!4Ea$+sQZKjNc+xQ=1_7T2kYq{rB$YhlYdbltn%Tisk|`hSh#6cKxw6 z)ujl%s_qtqRE_+f>iwEK#@1*wEa`NnDrfS@x3sQcas!h)m^{Gb2_~{SL z)X?)tJJ++e5X?->%s{82N> z%s^{vS6gda!0q%7@JH`1RMP{qwXH2+QDVoPfAztL9nqQAAN4zkwE0pu@puG)X*>L!vcZt+!&6A(I-?Et1*G0sAxo8dEl4OJiTw3Rjtp3gPlbfZ$W| zJ9aU(4CteNGj^YN0X$O{1Efo|z=QRKGFGvt8F)vnZPzAQeQLy;VQ3!c>yv2_c~J}S zCigCDP5I%+E-}^QzUs+$*D@Xj;Tx!0Cumihyi0gBnr_kqW-(Pmn2WDR5&gPp_*CBa zdG5niNe=}eynf{~yU#~Y0cArh7r)oAA^+qD@Nz7Ib^GPWOPmLt&K_p#m)Kbdp(YoP zws79Osbr~-LyXM|KQZU}Qz%!1Ym|9w%ARjt9G`8j zkTtIEe#MU5lzbN?b!kq$eK%&Rw|PIt7}B>zSyW^aD9acHu5?i1}mBbU}) zl3N}tA4r@qiK)lElKQko@84{@t&Y)@6@D_;4e{t-w?9^pys{#e=r>kSej$g?#J+mC zkuV&z4eb23nlj~JXhwp?F>nJ7!WqJy-;ueC1oI*uso`E{3hYfUJ$(J|&oUK}y~+VA zQ7ftE;PeuKY&h%weW@hlvqZ^#YRLrv9hj5Jk!dyT)shD*sItvy#I<{axf8FmLlHCb zXl$^~`}N7blL4?bt0EpY>j3V38K_VCbi>Ar?yu>$?zMl6t+!&tV$B_$U20$Oc%9Xo zF#lC?cy{;%2m^Y){-ocGW%BJ|c7C5Jeby^A_A$>)<{38NVLt5&rbK-t;j>r+1($GB z$$Z)+o1WBic@IgpByg`1b&ry8(#ntp9*G?F7@3n|pXZOMqJgsTpF!I@m|E{U*C)wO zQo8j${1;i}{b%#HGz&z%%_n0{M!VHLTJvR65XuL#zaJKP7eaDwMkiim6AcH_G3DG; z$1j+9j7Ng+a_9GOy_bg|_|m$WJembmWF)Whi)xi#EHH1eeyU}ROPaVy{tCWPjfp3& z#f)Z5V3|6QkPK+&{#RL0!l3^#G589L`bCm-eDZ47Hy$w48+()kcob+IV?XK8K#bsfV+zkFR#Z1=gUCC>!|4uw6a6Qv z5@wHYu)C2M5^YY~Y%HA=9z*K^*agAKfGMNI9~a@n-%no3i%Yn684@e0qwW1CuH+u( z;cww@>Ano_n6ibHt^ZRL^!XqF`;^pz{GX^6gbk^Y*#)b5wC)WrvJ9f-R#LX~_~m9X z4`NEJi;s9Fhd06F>9)LFLIoJf6V|%KebTFm$rGQkiK!dntMqLoKVabjV9(cyZCz5T z=}g&sVL|^B*6!FQt1d3LFuH?kPrfe4m7U-2K>^M0A2650#QF;pAF!6AH}s8ddZLG) z=7pG&GzE1%am%8kx2}w@#t}|dSZOlvq8wF;^Qmu=3U|)Sq5I&w>5naiV3*)a^IQx! zL)DTupo+#NB1!`y0aK19b@?_;MhQM?&$*OW9>H|3%$|S3B~eTsBI|VzBqh4njr;3K zcYETJ);x7%hgM;3WD;INGgOUTj;?My!Hx?0EW z6Cw7;ILkfrIx9Bh$Nl$H$UtK_SWH6JV|bDIzb}^|DQ^L+C{?B{sNH|MxHxfxXVloC zeNQuKyDW+2<9vFW9J@4$pSXlB5Olc_BVCeADXdrzz0Up_y)}PI4a;8lqN4~OgTKj+ zTa&cniDF?-{DE^n&|-Q#zyEUCl8T&Gj~Z3t;;TK`!a3oo*{nPdRnd3Wy;>iK)4-Fn zC0{cER+NoT)CnvQ83Z1EJ9O)0o1xMkl30G>T!-Z(0IDcULT~KJyFPdKtO2G;!qkK{ zGaL1+na-5NwH$|i+I;mMZ;ybZjETw}R{f+2cU#g@s7r#*iy5nuzm9!>_r=oHi{ErS zRqxH$VRn!fWz*gLm8Qb6O50b$>n(Xdwgv!yvRYJrVr2IJefv^fZ4Ax0zhp59dmbSr z@uxPk2Hh)ZEqTxs&5COKVXxFyHu*L*cR06t$Y82Tyvux4DNY0CIbOtwpRh*%itmjZ zF@7Q_O(U>3{rz(6tJu_RMaMkOy(n-)-(HHY7R%7=%fyrq7&`0g#u%$I0%~zp4xYd+ zpU{eIla+^6c<%6i-zoTV&tGfhm6>x$pf9celNF+p--gJpd!6DuJb{7t&KQ)sG9}KJ z!-i9-@g--tOICsRaz@AaezUIS{#!|Y z6|>?w6t?;GB`ljz1YlrIn4nmECqTlQxMs5y=9!9LnWO-2kj)|nO4`~L<<@Ls7Up=r zd!;?Dk_+acSNf+YgvU8{ElR{Aas4xPEs{{89doQbZoxD`DefIUuDHiB5-LH_an4R~J3Yh>T*{!^7e zQN*%uqqMlkseItNuTSpu=ep$FwvpMc*L=Kjrt~Ys67-R;6xe$`RXmd2V+WF04A@_# zWD`lyhtfXJ&YmlNuSp<@jH_aqkPPS-c&z^CRhA~RTJqZ7UY&XlYpX__27{>zeG_)T z&dzU%SaWi>(^dJs#!pzL{>f_voHN$F09)JEc%-R_#N3~xT%R4KxOgqoUi$Qtxn~+a z!&fO^m9i|xXZgeW{%U2PLwebAZpJ+;k7`*-+fBjZ?!Fz{W%#FB3xCPi?d@EL-+wiN z2j-xjG5;tT z)pOD&bB~kwXOdTiThdgNhlv^I&;H|11v`%~i}(FSz>S>_+ZZZvQoNV)or~mjThz8htt_%37CZB40pVnrpyawrUnNf))4dPr?h0 zfi&P*pTn^v^@vv5&6BSGqgIa&cCsC3yhvqUoL>^iG9NYdxR+oa)(xH#?fQBfI=0e! z?5ggBJO0aB_YxfEOcZ9wazv|d)0M~B8mrlS-pZoB=Vkr7P-$aMqja&7)cWeVPzU#( z{O8YkMW$bq)^spGbkn7ud>MGAsM{(y6QrnQ6JiL<-24Wj?wjfEiML6Y2 z7*qiJO)wsQ7>NMxca(S|-a`Pznt^tX63&30hbTdp<@qgxv)~bgsET-b3lu@TJb-eJ z>q4N0V!JF+ys=%HsMwe;H`JeZUCJo6cU>H)is&wT6hU;CA94Vns)h68H`2`k3X zTfr>G6v?Ap!0=w7EXE?pBU!*y%cH3a)*r>3Lt<@XnB_e<36{#EItd99fM9kKyM?$5 zplJ{74Ig`}yg|}}kMsX|8Yn}f(M&9s%OZYvI&q0NJe|J8o9v$8KMbV!6s(J~YI5&Z z>uz!I6^s4-IdRePM(ddNBAoEalbH82CJ)I!rf1#PaxL+G418`{{+P#@{C^g*4+wL0OgyxqE!Y#x`nb{a`pI|je@;0 zPUdpOnkDV-q0pJ<29V{K*>| zTk+3L@mee5y{)(DKBeA#fLK)#P(HNwUC@}W;9CtL?P*-%DmBgjn>hSiBRsyG8>yFB z5dR))^B=*N+VpoDEL_QW*7;Y)rS%db(ppp$Af@qO<;X1t-fKz|*E^(r*Y(c79gcy4 z=6ZZNTa9}itdv>D!Ozd%k-Plb4eKNnkR2t$M8T=i_yq8upg5?}*H-v4Ajy`v3+NM; zmA8uOOC6|eO{D;7`4c_?rmavs*( zNwzYAdh`$S5AGHwhsAA45rBOSGel>^+_OY~85$oPAIjdTv%)W<9B_N!u=D>GC9g1s z`$zfz^(4w04g%==VMe*=hiI6sA?W`g7AsiSNC-9t5>5?-2Wt{zb|EpMFbojnZlU(X z=+;QOC@dT}32TV0+kJ;jz#Kge&39)QnaVq&w5bx!1)O|8oQK*X7Igd^^1l+WKyCmIT z(~0tItJDW?`(<%nC(k7}=~Gy&9WM)RR!C9ZcJ965E0*Pw_J0pI{}WF^0m3)PcSi12 zqH{!Vf<@Sd<}i6wj3hGQZy3 zkvTre^#eI`Y-I<2*UXeLfK`@+G~zRhMg}KdZ0>L#U)aUVRr-77UyvFnh-UJy%zP0* z;0;eiYz_?SGwM9QoR$uB$_)~>a5zi9D@2q0DNXHpbLaW7uZRVfOPD`U zo8y%#3Zcs^O5DmC%)Kqa9evpj%Nq&En!V-M3pPET6Istx`gGw^>nd%i78z`JY%h9% zc4N1Ehm}egj0719AUIozZVcUWuun3}l9{IfOCyiy>XOE3?*fT2e2#@mi4 zc_(m8_*DD(dNZO8FFuC`Pk0+Xv++ewU%W+u{*$p^Xsdhz ze?z%XVU=cXdhMwCcZ$dAnbVku2VDjBKh9-du&_UoFVM|;GK;4eXAN# z!+5H#;EVju2$V9+G~;=-B6>lB`iVE$vMqWrd{^Xu>HUmfG0OtJ3bQspd4HZ~qUUyG z9p!J_@Zt5zoKAKtwdg@hbDHVO@;8ptljg?PAuUvrf5FvU%e? zZn0rwx6gy6HL*PguaW~x(}{44XL_~yIA9Eg?T0dYoS1Bg5tX#}=R#Io99aIJzo6-c zW#s|j63`v_T%dA2RNZjeLkblO9RPd=shFeKUUOL}-cds1!K-B*-71Q@5WZ0Ye-!;F zo)`9wCAn9|Iln>uK7<at4;Nx6scMr(khB^A1JWE|?kiA4*ZyfqCcQY6*!9g~njq7m2Qqx4xr&N?qWy~)N`%g@f_pp4 z#V$jc5$v*$yL9M#0b*3MPKsokjqF6cQ-QK?baD|`qo&9Pa;N@!mV73Af|Eh|4AZnw z{Y7W^MeBNqKWLMoh9|C2o;L$Oj%)}RSMbO$!yv>Mp`8@Ogsp>H@uIDUxX^q!K1QZ% zKqGDpuM`q`z&GP(^Ow%#Xppr~3x)F$i5~^Sfp-Pmo&YyMA+!)mZ0l@ zO2>_WHFE@utj>j28H)x^W*fqqX`NyAfMpPUcJp}E)v=x~0S^}`$N`-}wqFGNt|&FY z{ed9iQ0hgd;UXwTbM?_>NX_wR5fK*ww~8jKO^1=LA^w^;naF|*>0_}{j|ajbqN6y* zgTU6joUQ|Cl2+t_DwOZ|qQOkB3B9=!vMu!CL#sLL1_i?$+M?pucEOGTHN{KW5xru> zmLuH)jKz{xHM2^iskE=-we$`j&Wk~@6DVjO|r7~Sduzgck<-@6_c z)nmTNv0Qx0jOr&#k?hP)wmqh&)|bJTLY9z~OLf*K;~(ez`>K+-htZ@iu*EtbU_ty5 z?WH90Q?m4Nj)oQ=qh&u1VGjBGgRZ+`$c(z%pHFBh?+;kS^fU<%4=@VVxrWXGnRKq= zU*Th+?3ZE4`U}3TV#umG@jk|?`tG35A9OBMJ(=nK?LJ932rpLzq<&m_iic_@Yn5~m zS{_j>CZAC!-uW~U&~fOp(G2OzImtLkze-hTB)jZ-`r#tzv?{f`p6ptR22)}4YVl4t zkB&ng`){-*8lN0A)^7srS&IUXKREv;kD=o^4M65cLOH8w$mO6>Kt+m6(Et z$|`CmfS*N|7(*VxfxVVZSi6o@8O%Y9&OCVT6K^lV9)+10AZBmP$-o*6TKU?D@(WnI zK^f?qgU7j&RhZJh#+kS`VZfQnda&-XXORAbKD1dlK}xVGaQw`#Oa%`~!hz`r8W+LZ z#{;iJcFnM!ZyKamR@3TcT72sz*9UD5!pV%~y$@PQ-bRO@gG&9M*e>sv3qI%=5}i;{ z-pCcg4y#gTMNxp3@2G&ie(&q~>$p3EvcHijv!HFZtx6awdn^_Bp%k3x7~6%j-7pB+ z26Y6~tC#@@wa?=%D-6^^KoyPN`+LhXChQ857+35OF09nP{&`5Q7%Abp0+A&j%(%m9 zd{Zb(^Ng@CPIDLAGwym&uJB1&{-l-ws*FWiM*dTQ!0||6Nhy3)3$*8=yvU#57P50a zt}GA_)>h*14%b#Hfq%a)>&Ww`egz(YB~E}+jkLBvHz_lH;d@}Owlu~{>A!PEo6F}& z3R85D$6LwJCtO)6$_pg+ue``Cdr0ogB;_*;Oph70_ZU;hrRfoR0>82M;<%tH^ow~Z z-=*XSSpp=w(peNGf5odS)!mX@(&djN-j?gy+$InB6WsJZ1svr+v3N;$0iO%_j_<+( z^u{dSSMOkF#bF{oTyz8|6@s_pQVQF=lVsd@10kf3g)WG9<+J4UkQ@W^Yo(D2O5$GO zrb-i*DRPSa*;ku)`<7E#Y+KJmoEGfxT+U%jn|G@RT%b3R7$Q9$aP7@?h{XgSy_Pd6 zG$qEyT!oW{XWpfomyZM3>RZ&$tfVJIhqQ$ot#7gJinzcL>K8&<8OjjZe*8r5Dda7j z#uQcqNB@+0cXw63TNvV%K=5ejj$KX{N!f^bgp9kexJ|_cCyyLx-|{eYgVB!fmIbG{ zVc=Yt17j+09PK){iVK`WHsb6eWQuEoGoI@;!5llCM=hb804J9{25%m^uo0@Bza)>M z4$9E&=aOA$H;OLFoA(>NbOzSUo40X{d&=G@MX7nEAJG;p*IIvWg0KnmxMr^m97S8Y zl!*A!^Bn5>FIN5*XGRunKU5I!U->iG8fEnzEw5V0Yea=)H?S2`h=ccUyg~PI<|0-y z<%xFtEXKhqFvVd0$IoO%hhK~E?(7=!=FjRfgUX+X5Cq=!`hhOd>6tuq`p@c|c_S>S zQ=^as(sWj7xRTDEqEIQrUKF?Xv%9*D8t;0JBK6m(IcZb_s-OrIc^T7rg|0T;V1w7< zb?Gld}QQ$Fuhm-j|u>c4FFgv`n8UR~ZWV+r}pSu>P$|1bNX%uTlk@ivfp@~=%6 zz@rV&c4`d1HGQl7y7B8)(;&r-nSiE=^~6#mEEdplDz2|9N`^$9?Hi4rbd-{>p4t5) z`#ku*K2PrOoS7Wo7ai-crke3z2^B3Zaw#htktHM-P{vM=T7*t~V;$QiN zb~)lPxK57qYC3g>N#VMNO5)v)C*wXqw!!ZHgxxq*Cv2nhiiFKml3wygr~#Bmzs~JT z=<5voj%5q0De8>+sN@Q&@w^QCmTkFzubZkF*)RA|oQ1mJ#g=RRMBg{u=4N>52RSj? zeuqVIX0k2BfB2<(QZb_2a#X(KUrHC#3YyIdA9YQ&VS~zPq(%H!8o56;)nYQ0bin?` zurqdpqeA9Go|mi0vLhmk{Z-(NTcnunGL^6SdGB>J^_TdZtDj9Ek){0mUR7h~AgDsy zYvH`M+CsXV80UQK6{GWc7|-vSWdrD!eU`nT;s}FlLka0cqK3okE8H=6M#1wcL*M>` z6ovV~y2bcS)ur0Q-sNI6>Bac^L%H@M0YcU=3_RdG+5@}wgYD|FF`$`&S!w(){eVLi zy4@CEepTEG5Lj*nHAl!jDD>xOj{kZ^Bdr(|Rw$p~O5y-~<`QqWz>Vhl=%y>7yTlLe zYqo&axx9ZoDgBcPW2yJ*MpDz6q@tY*v2kM@TzZ7nZ1phXASY9vlvR=9WjU{9O zDj5g52=_yo-d&@d^%&6k-UXCutqNyU_r*4FWMk;8CDc)uJ)#JK(^x{;zVC}sceTg;nN*fvTxNSqN zG{##>yeS#Y`eNOk(XCi&yEYk5(~*7XBSTBcl%^}z%qwZv-fuWwN%Z*h{a=fFJ1V*S zAi(J>kK&ICk85)tY1(U*X}jKE)V(MQoY>P(&X-{L)`w|JZBU-BhaHFdOHDx>UO76z z{_J~;5~Ek5In&&|B6h)AedXp{H2hIkqEu}W)3-UyUy7IVG@`=*$&IR~S6$etE`Aa8 z8BKMevxlB_VW+0p6;Oa-Hwa-|^6Xv#BOH-&QrnGTMN%1!YhQ|!T~e*LhQ$$sIXJ=I zV3ClcR(efoWVjTAk&Zd(Ad2+Ikm2Nkc>&vnnA0%PA-!n%95f(U?l6P;4B$G11)*4+ z?1*esbR&Zyp5G%&aN}R-V?l41|7fe*7=>pF6{zIDX~D+Q3MSzxEr70R=>kfbpoEt8 z3Q$h@$NHkSsiy9|%&@nc<;L0@rKL--8@^PoNFx|GDj>E$ zzR1H~&#XON)~kY$hf446(4~ZWXuce7*C;cm;aGijC;TimkJeOd>t|@`z2gWC^x)<} zCo_)QKkP1|)#u^V0ijPk+wHXrhw@+xcD4~XX_5%`Z8RT5mW0I(tYVDdU&Gr0L&vS@ z#4stQrEstZ;)hy|It_~j=;3^3@(*ioRns-Gl8IA8u zTS7J$f{IiWppyHJc`3@oF2f^oARuoc7G^MbancCtzcLctYEJ{3Pd)FCXI)Fk$$V;T zX9|`YmWs3As3Ln8g%b!hU8zoAX}MDAz0z_#FO|5vU^6D5_whtBpqkBu=Qoz0^5vj^ zT6$ap9sq5Gj=@TeYv~T$;&tz|TR7_9Ikm7s3ST)5`JF|UM%uN+uB1uaU77uuLRXw~ zMsMJqduuEYt6~0mm9{4yx zrW7D;{opmR(Ufa&?_1#fdSKf&s^P^jxl z_4ZwLhv(mveCzR{cj^m2ZJTP&BF0)gVBHlr?Gbj znyJ!x$J+mkV5H`aeq{7BP95m<)`UhQc#FSmpJ$i+AkZZ63ceq*AhBRqsoN&9bBdkM zqnQjL9CaMq6XbG6|MP!>0Qe#5?{0gf^qPq9A>XOoE~+PCPeOY0NA4PS3BpL+sA7yx zgo?PRv2-lEK6U`Lg$t~WMAB3#jIF9o4g%e7ijR72CNzQ`cV?!4!+dQ2mdfH7hD6PO z1g-=r;N!*+RJDkrad*B5h7sOZ>JD~2B8O>W2ZF?VvO4_{x>^3%NOj#+kH&La;Kh)Q zH9z5!{gqarRMBbG|>k`gPS33|4O=~*x&REm7=Z(t;3p=&a+71Q>N!*FV&B66~I-qwT6-S^&vTwaZaI zY2q}X=~yvqy?r4dC-<)H z$SNYEQPf$m<6K|drlxG<*c!#HYMNDVxO~nDoP4Qsjj`{?`iJiN&Ma4ZnChRqB4JuM zF|nn4*ib1cb||9y+fe(HCTwCy_w!0leDqaH3)2DtTt(vmyOb_&IHowS>^aTGN8Vek zr^YIf8p^vi(Fk|=66rKU`D+SRukp!caBF4L8Qo0AC_Gr#|-?V}C!ccus zmGYkcuJoYKBU^ypEiDvaAVa zwadWr`0b6(518Rxl|>2LZ`)5H*bI4bKXI|P8!7NcUku=c^8BHK8nckXSM>z|`k3iC z`A-%0&+ZD8^w=0If9W$v)ttmnmcn5xQ~F;D<<6Kl4ju9CzE*qg(e_oJ=+S(QNH#Ho zQ`wrl`bDH0{MLjvh;QUett)3Q<8L#`No!5}Sv?9ajxWEL$a(We^xr;TzRiYV!~HVz z3WAk6N>S(4scCV5h*cACf>RM3HdD_*# z-Zn!I2z7!iU-CCC;k!0AcJ;#4NHLrkBgFFmL}))Ei#KHbK8k=ditw5- zFHOi%-?tFo1PCb-H>zeqn+y}jrn{5IuU(pvF)^h5 z#a!Q9aaO*S;W%}wX=1sA_>bb3@}B?eToMa@lJ~vL3jH}xeF$>Yy6MHT-o~p@s3ekV z8&hV5a2pnw$A}-Se;;4Np#HL8ac*BwV2K|S)`I%h7X$oQybrVuhCUte40yWt=tt}` z7u8ip_LuZ`(``KbiIE-5GebwY6*Hu}6iUL^qmkPq{J9 zZLcQSr5cEH+WT3TYwbtoSnMrqqEzcWa>~#0h(VZS6VhYaTYu`5c7BcJ1mdwpPo-UN zAM0>bgEe7k=Sh$BkX@(RnlJsTZqYZWQQeP~OqCi>9}T=-1BxMJGlK4BVGjDnO9ig_ z(Ax@@1<9^^B3fZ!veaTx%H{8FY64!J7Rb%kmRT@#{nAR*s(D)N*#^s-_0QUHt}B6@ zPP;qP&-_1$%?yb{+r*LVt#<`?)}bqSIub!8Cvp+`BriTlGW@CA%#o~Em3N{y`1-V5 z1AiRl-j?Eyy5Gn)_BQ8mtPli*^me!&TV1K7q5m_yjbHuk|uY{OUwd}KcVaDda>{?AymJK)D2Zuo$*vF{94i#dKLNxvBWk+o;Oo+;k!0^BuM8^hjTcvv+iRW-Lx=k?A0u>@VW_pkyhRUizB_d+&HOiMr9>te~CeFmv=D7tqL!4}e-e5vo5G zzT$c@BEx|VQEu#lR$`cR7IbqV+EO*SeXX^aF3a;KRamhbLJK=|z|Y(R&WoR-8I)IV zbm|kkz?$?)CEjAUl74&2)6mrqF4$R{3eKq?7(@Zw{~AI~xgGSyflERP%SGJjiuGU~ zZmx?oTuoQD`RHA_BH}`QO-IQt?=zB_ZayS?!;ZMzu=RveQnZN4>F7uqtx$ z)YyK5VOIF=Yt-?DNjFc1{%m@LdFTqe( zcQ^SI|7E#BR{gJ;BQmv=tt;2#`H%JM=m8;&hgeWJKpYNr<-SdBDDfc1hUTL>o$x&b z{=%b8K`aU>qLD)G)~{j@V+@W7hKD?zdBBk_k3iAzuafzn=k?AOGmic6vFJN%6RV`D zUE~l)``(l1=Jj*_Km;dzYPbEIG~&Jfd9n-d^DwWntMnprb95tkw~Nf*Fm%3LJgDDt6W36d zhb~~}ZI>k?BWKzql{cUH-MqXS>mKz2+{0dCLd=~qgS1m4J2|%3_&@wm3w9828R8EZ zb@>m7;6uY?0u!3P&eU+&kD>+m4*2^z_1C%` zsWJ>_`uf{JF@#>M3N3tI6@vy+B|1@lF-tKufMNgjJ)sL)>)asL?DVxphn~#j{9t~T zBRBO|Bg>(?TTAvtw_0-DkiER0nIp^j^P;LFX|v=wZZ5*uzF$u7;aFL_I<^a)QzY4`$lZ1NjSo|%8f zb#o@m5^X6jWPTz+5W9r6Z}=?C|A!qvqE=0KUh$s%Zb*xh1f>hi_Vlaa&(k%eg}9cU z@U0a;OMU7@1LSx#etqkdmC-1HF7VPb?T0xkIK{(w-lqG<1psAq@^jCWw;(3GuGkPE zD#Zv!fUztjHa5&^1vjcXt)a&;R@upKq}w{ z^Df^s;U*y-HR5U`xRlXn5O3IvI43kmKKM-_Rq#xHJ- z3wiU%>WuanzjMwIN+O81zf4EoDZv(}FV8IOOBfewrp0cOK?vvz=OCiYG~}reR{3eu zIX4{!Xx7DqJYD%B${$%86NV!&$UDKAW(S~B>f6q^OFf8Gg-qp`&bhPSpI7`DB8|IZ z92UW0C$g(JUe44D_I8q;J_`aO+NaMFN9=Ki8rgrDDhRnah&K(bnjSZNCE6&#op!(L z?hj0g`S9?lg7+OU&J1(;&CTmlDjeU%dJZRxV{O8_>5mmRRpwR1tJBsMH){>#%uK+! zVzv{`bo))m4>sdos=)ei|AiU1N;Z?;7jhMJ4?W0wn$n<}DN=OmE`j1RU&@a+EDU6% zH*O=7O&EvkNfVrM-aY1etOTBHV*j-c7C&H6cX1J)QK>kNXQY#mbezL8;CaTN@$6Qc zKknl~w_By2(bko|F3nw|&9C+EQ20AYZ zabAj2bX5@tS!M{}6syp1)Kq?Sb*k6ag#M@~Yc^}z15t8ym7mQwN)fz`IJC%mZ|@uV z!h3&9u$|j{v+04B1DQQK@3hFN!iF)D%D$me4qF?jL>JgEeYRCcVtx8 z*H(TDqBubx5`1KD=6Xf6@!uFpvgdyuRuN-7vrA??K1&Z)FVpd*>YL!)8wOH6#GCR9 zY4+Ox`tdGe)lO5LD}_H0ud|w7^!qeA->kG;#fGtTShJ7J*&@JLLgf=kFJf2ke+bY4 zVE7;Zs8sJSFX%;mec;1t_8=9qDq3k$b;YEIY$WJeKs3fW?k)cFq_F&n`OsxD zOmc5A$ZfyAMf#?0%(CsnU5$rt^B7uY`8hYgL7d>0nWVxW$eySq^o?_!@qyT#0cc4U zJXqO(!icJmMY{F+1BVn-3cUoji-@jRroEe;Xxu|r^gGcf<-qw&m42L`tEg}Z!L74B z*8?>rn{Xk^h09ip(jP|$eBiF{T&C1w`z96{@za*yGwDFT-_3;5j|+5*y=No(eYPSJ zgNn)BlR^@!aMUGkd*QeyF@8q)Lv~_;Ayswqd+QKW(a>T_qn@^QcwI3}IRQHf!4*~C z{>Fal8Rp;uu&V8lecJS0F99}QUbRIMu>(i94W)A%x}@AM6P~|ZI!#GCLROx(UAzXz zQ9+LCcBKzGm0(|dq-h;!;TMamQgI;VWLyf_m_Co~B{y%lZG2IuOTbkjxBd;c3`L-c zaRW^ri4TQ=X)ppCU)~TMd?Ai6d`nB!EqiKVcNdYUG;Ehspb0Tio1hh3db&% zR^usQCBrVrreK-u^j#OV-k7OUJ3@#m|6A!MxBMr)A?nMo}-z zZ|Joe55Y2Oqt(h_5C{E4JBlnYw3G^g=?`>@>;daqZBID+>;w)S+Akdk48KInmWe=+ z`iWLkEHfX@96`rS1+bzSNZruY+3fF5XZ$UF3UlwS7ArLiTunK9if|OC8Nys~1`*+H zFaK(M7nxh-P2!Ns_-B}u+Dd^pOrgxaM$+;|Bk=L5reo?;LQ~0_#;?)*Wl?p}%4Onp z(RO9$5TTb9A4j+@%ZERvPzex2KB0clY4#?hZkMySqDg;GFmUzW={>EmrN_JvG%mOz*Dhr=Fex8!2X&pr!Bw znXFp;+$X5J&G*bi`a@XYK>9{V76TJJc-ik$p~UiU_FU>g74jK~5o75j??~CKEqqL8$$uuo_-xXX4P7 zxR{=@8E)Ul-2uS;CuGPXb{btAAVyg;W0t$fH)!_BIeI2aPzE~m=IrP zq(cUCKPX(NR9tTfwDSlE_AyA8dT=OK{#Ha+`pZAi+WohEhXnH$9ORQFYhL?ZM^=Di z{E|<#qmfcSoIJr9FM&Z4Xtt!A|eId$Z}Pym_Rays;a>bb@;U;Fm%ogLU*y`fpB7 zf_d(#83A2mW(NNDif#R%dxGFGqP|K2m)z zx82V40F(fR5f5})FKoirne;~!aTSM~ZdK47H`s;$-5tc2>vIHX-*)TOJ-un;MkYbf z>IlfjA&=t1c#yHpzFkb;JBkz^>Tmn(W6eAkDs&2I!dVpV2PU>?ed%9!t@8>1F}A|@ zL}%La4PgdcsSYG@L-@1Em69-!vK{dGE30EcN9m&z3HwvH7U{9z(*dv>6X3(uyB9nB z%O!`Pofox`LPyg#+aO35HvWr@stXSWLpiJHJENt?~g8AS`oe>?npO z*6UOcLj=+@g)E9Nwf}-1)_hmqp>}iuF+&f<@=1#le5H3{TZANLIzd%a3hF=HDJqtP10>HtX{U6duVhXJ=a6WXc=%6u;Ry@WPW{g zW)HU$`ig+XahoMt@)=3-XY#Ja=Pfpru*!^Re;qz7v^u~_LKPsKIk;XNY{0s(wZQhz zn#BqAy*9Afq~A}{nOllkYmI*oma59IK-JAyg3-V6w1IB`Ve`y|agCPhsVfs_p|JAw z(63H+mLmx`NLrbni~cdT&98?ZF)M(G5RK5agloX2n9M<kobPSD!Dna`xtj%sv{iF4!Tpg^G>i6v6+9m>@*D1Azzwn4XMC$QQ9?F z!|2ytz7d$V9NIPR($tH{B}^m`pnU5PF1o|baXYZGb=-C#b?5KzJ=?#f$;V3Ids`2Pu1`@OY^|-EM>N`*FzIew) zF3FG!Ljw4T+)F~QQFaWf$rP*7AMO9&W>u4*K4{{C+OR|5Rpv^P-iI-LdyN|+S) zyAQ~I)lO8C*LWhXt@u!rR#e-(UGvx~|&-7C+K|^9A&&|sS-F%SzAe&^tft?hz1yvx4T-6M0rV4Un-JY>!m}!nbuBxiG;CX%~ zY{hO8RX@#u4=VkLbel@DS>0)4Y@K-I%*5kPu{cCWEWriXdjMhbB_?Qmz$)PYJ1!3- zHdAg2^Zm*Mndc)Jl6Ybs)+Cf3dk4Er@W<~4+?G(v*Ms8{HR7a)#2hJt^d&B19E8JV zy}Je;&^#{;)*c4A$n_?K0wJ|t+Q$NyZ+S|531Fkz)2-lwoP8i*sqKZ5NyPq+lfV`@ z&FX3uLCl3_Q|FVSqQupD`UMKv2lOO9IQ~f`xDdcWQrPJB>>f@~fs!XTF8CCfBl7q<$RO^caN_%_U$k8vF-S!8 z)SK`Q_G3C%3bdDy&!k{begHA~mGlR>MhYS3M@tINCCnxTCctqSZEqt0(+#O_>vlRe zMTg|4)vNmxU4%p+v-&e70Dl8`WDda70tcYSewZH|m-^7|nXd_C@UWJW&sDPT5MKET zJwni++ziAR|AP$t&AD;M^vO6{A*_0Ehu5_?8yYhyL2MyM~ZP>0ut z3e;j#TAr`c0A~&{i|yDmLzB;~r_C*2(Ogsb%^e)0{v3-t^OuD-Ei8C+janm^aVH3|4C)leR&C$IyT-}39gLZQ&)X1`)t*`YKSgrw)5!EhDSh@|7chdJ zsUt2_+Bv5E$b=jh5i~MkX`AIF-zUw3la-9NiMw8I*x5> z!pKsh6WDR~<^(~tU;itjzBIw8`0+WmY<7en_|n?I+te`|5qQ;3n7xUnK^>IhG3!~# z-saRogW4`Dy0sM!WE(4ezI(oNM^%aRBZhIy(wlACpf3v=btTe1O(Qk#nSLN*AAyCW zD;%#{i>D(!M}Eyrnxy->hzPr+40R+y%hDtLBFwT{W+RVI9Z*#v;kLD7!{0QHSsaqX z4#bPuS4O*2liv0{4Cf?zq8JqJhrBPj94%0FEu* z7SrI%;wFSe`TYe6@B#Yw^FJTQ$0vn+|J@3A3+Zys zwF~2w(G^JES{#1}?kdE%3+37Yl>jhZi0e`AZMdFuwOsL~lE4`j@tK;4L;Y+sbjWdG zF+3lBLo|3Qd~uCOv(R)HnYZVO2%%&kU#pBq0#)l}3JT?ze%GE^sRw;F{hPgUrJ`!+ zy<;k;gDlFAX)qp?!`iLW+i3b*TcT>qyxn?ar~<4kj{T$Kccc~kscSYnM?RqiQ~93I z@F9)56!Wg5s-pb6geWV`Dy9!-ziumm`rZ0a(9k7x;BP6N(dxBl@RH)x?iy1lJqBoT z4!*CtxzvN3ML&kz8bLZ=y2f5|;RidMGjK%uwqyvr|E?5ZD#TB?;9rg6AnTRbjO+V)7>Nf4WU`G$oQuW3-N8A;E~^ zC%$SPg-8wILuX6{uDJe|-)of+kkx%OpfpcM3lGXfk3V5vs|In}gF$JgL2qz0|0*n5 zT{+j4NjxC;+YUd4%>*dy;1N>ktAUbAVm@IeHReCa#@eR4Cb3YhyFd@lSl=OAg(Sb9 z7ILRjQepiF2Cwj`@F8CZw)??nS>Fz2&x5t0OEN)9L$Qc)3B!!XENX(?kt5-@9t zUN{^CRQl#^egZ)!IW?g&O}ju{m`iT{J#BmTSEGd)t|R&k&zFBOANDD($akmmvZ}6- zSlLEW1&nGg{B@TV`6`2gSQygFekslD+a^mG0Np>uuonZCwYnM05}wQ1&I`hjFHAQZ zvO4@EXb<05_`m!8cZZ@cg42T3rvK9T4akvek`YMAE$-aE z_X@P3XjLOfh2Fr#l_gJMVrR+rTsp0daxGlW`V!ueCw{5vG$(aNtKy>*0xl$YaR;R3 z5o@CeKB=xL;+)x`>0@UDIL0Ef+DAQl7Kp3&@98ZSEj%@y=A~|midLuJchcwifW!#) z9uncXU_%DLRI#1GzRExC=tXo{gYS#zjHZlg!XDQMRPoBN6YH09 zamv8Cs)H#*>TEV+#|nvM=#8e{CxPg*{ups)I5NB+0fNLgQ3Ne16cpA>Caf)-BQB;z z2+`%!S{_UjQc(H-5#|+KmgEtemdY%!BctOxp~Yi(NT6*~a!{}S_vlgcTUJ2==i85L z$J>=4vs(vj#QM;bZw#Epl0|;lW(5w|QnRbUqxGktl&_UzY!;uthk0&36b(~u$Zf=s z_v1;VOq`lAbDW=nRIrwQP9}#*<}_yzR1fN_2d>UWQF1$s*Gxz{lPy3dEbEJHOh2|s5)xD8!9`LSgT}2uHRC|UO$%AsQXSb#jEa8%eAFR5Z(*jOPHH=HU8fDHD!oflZwOCY3AG`@lC zNd=T~ykB|F-*)zLn%7PYs#`1}k3(w#6EEbG0qW(P`I2!FAJ{S2vFli<&u1o>-VR+R z$Uy7ry(29f2svL5pNDQ%1`rSLL$d-F44?dRJi(1k^+m{_;b?14V$DR@$1T+FWb)BB z{5Xj}^r?dwL!FbF%T9JQI_vWWLamaTPbNgj11MN8EzX}`KJ1Nd>}yT&9PLOuu#7?C zkwKzLNr{l6R~K^W=W#zJ1w>-{V%-szUSO+i@}*P0E*I`y`?>>g1#+ zp3)1Cu0Kp8-tt&I@>TkdqFa-Pvy=F6g z#isqLlss7i@}jvmh)3UcrUKp7(lg6IcjHl9(_d%O>%pq(DT_}`T0_fJ>7U5gwLZif z*SV?Decoo%j-9ktm8ptl98rs6(`E(?Mf*LjauNrVmNjG^Db%{>{)JEc(nb|bll!+Q z<_oQG($l?l{#R7Y6unt6Je7|l-bB$bw^=F{wV?SNZib7k`qKC+ zE1F@L{Lop|y_u=}uP1Ewxg*Z?hqHB4C7{RJdSm3_0P1}XlDH0se!m_j)}^0iKOA)6 zhW}!%(D&9s(~`C#hNw9d8zPx>{c<``w=}M+DaV}Yg6R)RaXR26Fp3UC#W|W0CbJHt zSA^2e#H510TQoSVMFRcIgo4i?bPN5|J=-f%@2#S`d-J6)}GL|UA`VV zRuQ^xjX^Gr_<6sWS%rPk_rRXS4OKy@>6-9p-tp3G?5}FFtrzHOq~0F_zi#KSF`h=Y zX@jF^_itJ@yT|C%KxA7h!?D44>|<`N`W^GNwCn(naJ3U|K-YXRE&HoSc<<4F3hW-? zE=Sx7IQfH|zzba$$A|ePS#JoBRzlJbFZal~5r8sDvt1DQ`VK;`(4G zHSCy!URpQA4}}rv7agnZ$0j=YcPul+3?Q$qy)W_9y#X*8827Wp_C(+vDv@08@OF{%OD^mE{ilDfCjCxZz*ruB+_K)sLMeCXWZq4YZ3~b1B%(^s<_+517)59@!FKvfTL>KAYn2YbA8hxjcQeO3 z!qEkouKqfIq|*SWHN^TI$c~DkS4jpt1L|;}10%>p#m*V@N)O-pg>a_`hLHKLRs?ft zF@;7UrmuG)1Gm=a4&p+-GP#Z9T1dKx?}4}CEBB!v{2USLKRI_^z2&(`)Bcbs8YX?HV{ny z8aDMBPaC|gDEpswA{5NKb8lTlcbwx6`3C9Ya0qA2f{;s+oWYy$o(~cdf8?cO z+e-V*kJrhWW^MQiSg*=#1%{B5ee_VQ<9A2A^ubHDR$-M#F)DE&lY&Yeu8ox zUXDHvc^{^%^z7$cTjiq1we(OgZk4|H#v`F59#e&3B~5k75FV{R6ItQd&XFVM98E$|HvqJ%XGB;(Qk*pO_+TC2HDCsGnK8#cp6L-BglC>-HGU!YG;MkLw z_4{cuEyOd^U_{YLl3)9Zo(iBkHr40nsJR3*(NB1yo_OfHs6l}_f)r0=Ur}uQ1_Y5o zgeOm^7J)`-$vHs|&F}M*$%qlp45Us)p$i?%MGwht$vRMaXmK7Rd1OeWorBp#nK3N_ z-IyrmGY9J1JZWJvdQj;D&6xp%&M}WxnuqCq&Z0`VKhIJ)15@Aw-9Sv$f~w&vz0|*m zem1(fr*Rt^wm=ka^HI-0=3#TrhoWP$}P)?ctE~Kt+)8#xYa&Fr%H^!Euwo z3`*!%Y>&Z^U$n7;^PuNXU=Lli%Aq2PwCLM}8bXwJzo%Bz=td6nj+3~aoUcGml`&pi zkS(g_A|n;{h|hdSxM_7EKeuT9#+X;DdMYaw`)JA+@n~Yz5l%5fxAh1?X*ydlY^h+f zm9Ts1Q^@r+s6EfcueuDfur@kVxBtjWdAcve7|izdREVRBXBJ{|e5`k^EljHHaeckj z<`KUbk~5+D$6GPJ&oVr@#8t~Sws5I>?ME2v6IUx|cqzqtWq+m<-acBlT}du#1<6?V zgqCIbm6L0z1JS!lZv+}&fwv0;l)E51>Q*?9g3*rZl&8nAd#F(sB?7N4)3+G& z7g*(}7RoP?5?*gMosTr0_Z_H*s>%>>p9!KoMA-iCU1Z}sSu~I}%ki=Eip)Vjnhp2h z%c0Eo-uDL*YQP>CLRx><>4%IaiNo$lQn}JbF)q-6QGBOuKyM98KN%m_HKTInu4UZ} zIcPv|2vb!bcPyjoF-NWF(5n#E4hZ7;@4HU4@wD^r~9Sl{)>kB z4;mLjg+{kicy7M(^vXD<)!uMqsne=HKVXXb4q!-Vzz*rRa&fZ1V+?H$T-{=yE3#Wwm|^l-AtvdMs0^lCE2 z5*zE1-YrFKwoJ58a{stkAQdwE=M3p>c@f*6eh@>GN59*CEU7^VC*6W3#eAvY**<6d zfRM*D{~17KHFb1bT$}j=O@7kump4XGQr6cB^JMCAKrN9o)+hFh{5BbJl5WItza-e)QVUL)%`zKE0`FP{L`Q$*b;3QDdws6IHlVF z#b35OF}Cr*vn4V@%^SPpaWBiuvW|tDk%`&PGNe!C{p`>^f$iuq-WbA3MIC4>PLxXm z<0Ryg+mm*Uu+8{!&*hgvJ^Y6TcJ7h3B&=4(UFBWh60p0JCyz+(uj=LRyCzAnk4}F( zJ#63f5LI{wA_5h9?=W$xM#`(&%Tx@6Zh2;t!?h?msm1lcsWOVtFq=i06r?dvbu?&Z;(Qx#z1`k^> zKeqd2e~fJZDge?+wFTWrY}6K_?#<>bKsJ0`pi4m74oLqItA1hdk6y&P_n$ zqx+XUEyTX3YQ#8E?B9Vsd)H%6V{^vPzx^m9k+{o|fnag&U4;$}3cR6wl0hwPz^qSCB{%|7KWwB126@3M0t)n%Z+O>MvPt1@cI zvszF%Cy!RX;X*D3Xw}1V+I%<;$Ma6*y9TY8wS*B(ts*7-D%v3lUC3EMD~8BfA-fG9 zh*bKvX8k(QF)jZZb{p^~)F@J^^Xq9#P1dw@P3&$@Frr!MAhh7c??5A`_N zMR+#pE%LJKy9Q(Z#;1r(aY?yn9%!RO12I6?Z5l25ntEK=H=F=uPqy?d*hcWclI0IU z^z}z18_~Z;jAT@;Jy})9%tO<0C&+G*J6zwj`ePG~LJ-v{UB&L#>#!l^brBfM^sXlw z6pkCMs4(ii`>1O6WOT?3yWIg1tm-5S+)jUM4WtkyXBX+iTEgLb>ME6 zcCr`vMHk+mHZeEbVdAWSsl(z}b=TLUe-cIl6@)h5GW=QLvG;OvL4u0GL=}IA} zn!itS@1R4P*S?WZFY4P@p+!eU+rL;;r$f8wP+~RY#Ye9?YtmzT;Y+Djx}_x^Z&jjQ zT4UQV)3~KI8~32`WQ4HnKvL#gBZT$JUh%!#Z7K$ zrNlmHoMP8)Y2C*?Bw)woZV7}#Q=EG>e^hPLNAqXtYpm6=nsXrO>k%Q-ZjH0L(>mVJ zn6HP0GG*5;ovdw$%h(cNkeyEFA`q2cIj_;7opmTt8d6J8LMtQgf$JCc(Z&PmN>sr(!zS877}uO6VGVhdseIA%a#=UkdxEIv;7iG@b9EE% zKDzyE12wbf&6NPb+u4esdP%}=@(ZP_si&_C@3TB+C2*PF7oZV`o*GbqzI0z0e1|1J zC(`^?1lqna*4GMUG7`HdAEhK`A^A#!`$N2z4iET5TL!G>2(H_Zplt->N!;K9#1 z-3@WZ$EtHaY(KyX9HL0zV^unrOCInbI!L`Ul95f@qy0vey_vZ9>&D%=XaEls@;TU~ zP&Vx&{kJbIn~8AI`TBNg(zM^U2R0MCewhWzE*~5TmChzBkK`5MiuY61y`E~e4^$^$ zi{k^mW!oJAdi&Z3N9A+96FK$;8DpP>p>Dzpt#dgGpxuGfvFe!D>l!v3U=5-i^Nf8h zuq}_Uo>7cp>c%wBN-E3$?ZJ%^psIXp6InKmo9-J`$!6htRQ^xNG`+TOJV)D!4ZqB` zWzrI9zkMm){BPlIe|o2-RF2)_S)H#JvMy03l_U&q#i!r(y!lKB;cq<0turx*cRJ;{ zX3pj#T@Y3|{Ga@RbjSk({%)D{*U&u@CE4J^_rbq~+aeyJzz!H-bt_x}$r0{DNbS!R zaq_l~orCmPqln2#vf?$~^jf7$ClMv`BezHVji|gWAozlqa8Ziv<^BAvTv0^z&U0(~ z;)1cuhAY;RCZg|DeHDKZ1QtT45;>;cARs9Ctg-Uyz|ayyvT#0uOeMuPg1#f@~`;OpCmp*SNSE1J><8h#K@44;)sYvTD&FklicC9g29E1eK6-x z-QT8#VgG-0Oh(>YVQW^oC8eSynf^Hp{X-YAeO0(^EJ#8Q8YZ~OFV@~QJ69SQv~UhU;l%~R!JylETVL%=L!$#YNP_6N~eZ&;%?p$F)B#&K`rOOJ(rzWH7wRIfzMG8Q~L z7jB!qP)eXVv_(FMFE9>yr$^lrjRJODL6MgT)%vGT$lczW*LDi*jDlF%?~3&MpO`-= z#yy2Md;4DZ4WYZfq^V5l;(EMmSRtwQmcC)l(w}_#bsX>1mh+HJ{MV$vtd+P4u64z5 z{^Z>ejze3T6WbHjtq2 z)8t9MOxxuHN&P)9G-3QxG(4hOPZ^x~gnshz;gj6r7mJ%?O(ueEV2XmW%Snn5KwB6I zxGM+47NPTao3zy0Wi+4x0PlA|7?VY};Ik59(py+2T20TlnNJy~hI{vIF$yI)0}S4f z)!J97U!GlG5RJUgD6XU&g!I!8HbyAzrEa|;rt6n?fyGeQ>h5471|~P#XFwgKE>|nczlZ7f%*oBP`AmhO-o@G1F(A#j&zn-j%yB6Z5lX^!KW*eCa9~ zq_pobZZ7tn@^k4p@_HQg`7!v*Dh5;%U}l_6TEJNisKokFCR5WB_S;M9j9IPF=mIG-uB~VAH6o9j>q+9_p8$WkcN>Ij#}A+l83T$l0{?MV=E5mdNt`sR4<7C>qp?J=knQ1tK9zm`d;f;49{ z;W3j{JsU}jv2AmCUp5$xn@%&(i3=oU!PPI|bw+622>ljiU7u%UTKxLJQwuAP^P3)8 zaoZ+4q1zyE9^r{4(?7!VrNte4KABi|qGL!S=$z8pmz1?*HTd;~Of7L6h8O!oM`X(} z;{gZUn)#M=v0LlWHCAN|e2e`-z>yz+lAK(ZK5Q)42!X3V!RuVn+E16YQ+7g7mcZ*Y z(Aw{nwdb}$#6QF9-2bOAdk>FUNn^iNx>|v$Q$*{Q5`Db=WX*?4Pb|5j1lKsPu{x;h zE9(p$5s}x_143I6FV=(;2)9+F^Y#>2TDtpDuO6r7fW;U71!TnHa97&C)dUg053f^5 z=SFztD?YRH?kL2oET_qoq+7wk@!#Voz@_@ttrqcP=QS}twP}sx6xWI^e3%!QxE?4` zu=R2{h}KTexX&5?(9s%moYss9ISdPT&77s+<`upo@a^(Pz8%XDZ5uj)Y`GoFxQM(U z!aZRd$m~?NSG>Op#aRA-QO}arxNU!p`lHfH_DbkSyoqa%U1OKyXQ@cgEg zbgcNg7iUILEtB`vY=*)`Ln|#uA`)C)CtCutT{~g|TxL&;(~a39iJ}{yXG6N>Yzto7 zXb^NcDz-58Z=cw5__)qRryF$yqq-g@6tymV4TQguuin|(N4}hH$?NKdxm}_^fUiGj zs~iu0a;Y^v+O&Eq|a;a?~gx94@ zU=9U#m6Xu0%N{Dc^W$9fvG-P0#R+q;rU02`_QQmuc-xrVLMNmQR^x#LC85pEh(mx*t=3iF-KRr%;=olz6u!*7V%7Tvfhr)^z& z8bOL(E1mJm%14a0VfuyVzi1fEz{~VT!C9J9(kw$j9JR>^o9@yux*!DopK=(ho$(>c zHrvA1k|ayM2>QJP{si|g*p|oIw+^aB{L6$3pT%WYL{fba^na~w-K%))Ni53Z14Z^n zde6jo%i@&~UZcTNIKhc^Q{f`7+oi9ttg39_44w_p{ii_Fb-D8>BC+u*6Zdterra?( z^9qYUc;97R*{#X8Hg5(lHwQ4f=FTg`$Ai1jf^Iy?db4AQTLav0v0F`21)2lqZ?J)B z%o22%Y|Oj83#C)gV7E4eKzb2Bt8}E$ijk}X+q!$Defx``@eCQsQK{Ow!llXh=L96u`s^ns(v; z>4DQur-2-zbX0Z}%8M=Pbj-DvKOGrssqZCltP5UjK=fO>CjG@>u>!l&kbF~wcvBQj zF6p8PL`-1k2Sn{0?Z6lyQiRwlXPr(Y&i_7&<1D93P7XxwD?<~JgO3`J{pE?TWy~W=$M#)giNes$};7& zmc6NcY{E?xrEl^frC%r^mr~BNewN?*rq=-qc!6nyZbM4jA)t9h*V+o)Dl8YR+pCsIMbhTO#BY`LjUhk24Sit+834P1O%ap zIDWl85v%LGE{R|*`#03VITE2~2D+D^cMiL^mZ>(Nf*#W*(;Puun|fYk0{ds}X~P!s zB6MYKWX)FVI*gqVwLA9`?=A4eGFaPW5CqvNmV#^0yv&EmmJ=OZ*I}PTCWJ3tgb4^2 z1_E?G0nsOpahx8|zrU-NA!@Ivd$?0S{-e^--5!@4lFN60GAH`N|&RIZhKWs~Us%PqEfg4hIOH-QTn zawi!VqU0)Dif@%Y2zj&%z*CM}JlOU6J_B%yAtL~a*~2k(Vb#OWuJSDUBr8Iy+OsS@ zxLJgHBG9a10#Lsq!VPISN}pd=kai=wTz~}=5h1^BcmPA6NW5{T6L^T5cUQ&0Q ziKgIX@k@p*SF{#doce{HB?cFl5rrG?Q+GZx8rRPaA%nUq$5{^QQG!r@`&vSM+4jSn zw-e;9=Oqg#v~%kpDw>ads{W`*oSH@qH@U6!JTO4GqSc4w>qdXL&G$cB^#o4FF>bJTu~bGTQ|BCgtZlOYQGX7Xal`PZPWp&iZFO{DaT$n#haWCHy2JGfxB_Fcys&Tn z#HWUyF?0g{3_v1M{M-&o^B)d|j5Y{>j60cLUx^cFD6hT_aAwFVon8eX`I{j@yyQjM z8^(wA%-z2#Z30p^C|5mYzA?uy$uF#wOD}dFugHp4;|qVy*@4q)(kChLv2D4u{dC@y zx-P~}1UI-gs28-xm!96s38=zdJg;gRnn~P3sj}?%E#W`YOciV&i?46lZxKDQy@|Xb zpAkF-dWXQ{c7Lekd{6>KQ32-WE<@$V&OdNo-<9?6w7pM%`RVygd;V6)61atU1b-yE z>>}wP>B2Dtd!{0e&q^Z2vM5r?DO8HelMzp%`M(RUN)xP=mPIO;p})rlKfpd|lSj0x zub!-u-_m#@J>xv`hki0TsC2^zdHA-Ez56|&8r3Q*4t()din^8&zyFBE&kOt(KMqUX zw7F_S?Teia-wDwcy(jwp)2W7+_iv@sOOQ8@i=)^cs%lQyblTte zN8JSY51G9KEcYRdiJpx^{ATGdwfB#8(>rY?0xvdKcXq{NAZ@Sbg(M`<8@3)OEtiO1 zHp^U4rySL)D1I-3wTGaZ!>IDV3TP@5tdcRvpT)-rKR5DW?e(bSTqsXe$u+)Q9IW?n z;n#epamStl{}53EY1(%wqzQX>Y~O5wteV5E61A-;o+OI(KZUXNmL$Hzx}=f1E6^ib z+p^pZ=r1Rv_84qdi8bHOK(@=e@FEAsmk#R$$TvUz8m@I1X+X#t;?V{Dmm^S){Ynw& zaDSV9zcKMIy>u${Tr7YABYfHCl}BPoU>#&M2TrL7&zp%j_%;*Iq1^2~lRTO8X~A4~ z3e0U*fy6^y-ywGaynw#dw`B0>4%ro5AB*Axo0l%JwZ&-EIM`A7i=NxiNjyBDu38ZjPsE(bHyBbuXOcrR1;2=D9x4 z;H2eGcxFALeXW#@)hoKJER2U}!Q9OiVib12FvJ+oj~8gU+}o01CF4|||FV<79T zxTWWQO1ts34?^QzhygR5Z*KWNd7y859ZPMYUh1#t!vz_E0}zS@A(f+@8_K(%9>X#V zF>H2dQGb`;>*y=%X@ORRNuKgount|QZReOn?kR_q$pAtzJZc4$)*1?z1!$~t0+w>v z*Bg%l+b+nYjp7>ty4H?pfAxDn&KrtkvobJohw7Dsye9&L* zzIw3PS=${ogto3G4w768Z$c(Vjkx+eBNn!V&m7Caii-bsXnigWyQJFu%^1jHLMB9w zqXy7$FEJC&C|N#K)2g1#iv3puMJsp3orNFwX~K>4wVwT1HqyKJQrlue3yJ-C2Xj}$ z#G92L_axYBZ)z~C;`S;oor0^DlfN17E}Z*w=vU+6A4YPE#!5uVNyMXWgvnAMxqD+4 z662|aoIVPEsyz_%L^!=1%1(SQu^&nF9WH%u3Ux09E7dKtbOiUuP`Gc_rtbBg;)hgE z%+FyzJOESc#27aT^?lv^y(tx8du#Vxq`f(U*f^xk6~?8$X(0=4Ouhch#Gz*fp|Hk$ zxEPNKt9?*{5+TfABWz?*Lca9$k0KgZ0&mIyY^;-bg1$z)S^b5_8%cb87`l{#*?Y@^ ztuB}&2sF7D(GwkNG@L)x)sh~@-_Ilw$lMw_;3>ClY=Y}piyM767khcSE7(IEMXBHW z-V5k5Nht6qzC8+SjN;jy1`)Mzba}d-bQ?=!JiWJe5q|6ZmLW)8c^d*3hTtH&@8Xfr zQ&U|Jf`r)s@KR2=?6dnh7JLOVo z@&M+$`fd1mVZkL>={EF@VhisQc@)r~%*0WdQJu%$$RuNLnTR*#rn-_BJD#3dbGteV zh_X`s+>3HWeaOJu{r0c^5Bbf9pAcngK2ZAf3MilltFL9Ddd#5pSUP>UlUPhW>6hvG z%Tt6|$IkDEVb78+Ss4GjBx;8h$8woP97l~H%zr{c> z-07hjN9)lZeS8wC;l^bmj8r_%|vvS)5dyc+simZRSj9kWkc*owYfe6Tm-48lu(cNe>= zzvSEW>>tWoG?kqEqWh?VaFapRa)-w*@RJ>ZK`(VO*+Y=1?Nb0A6UKJu<>hw8M7=9^ zGdO|)^RTR)o*w#5@8ZRfcM{5w0sC)Xta6H$Z@hvWddMJIvLx@)pxC{UpcOYY;QcBN zh8WgTcHY0qk4OB&UNMK{mHRNW49kR>ww~fTVK{4PJ8wy~#RKi;=^jNWQ$^%bs)HBp zW_M1Lc6C$yJM4o4?cY~+XZw?v+cz)Hh&3qJUEp(Y(RXTmVK-aYi{Gd z>wh)0t#Iy(r~ogt2oy{Zq^^Ekrc1s2s80`m7(hn7iN4w!VN4H}+~~y+Ur)0J+Y^j> z#`ur8#E=$@y2K#nL;D+jez`3PYg8bLx*{cY|3f96P}=T!s@RJeuTgJ0jMbd2#NtAHFgOT__h@e)=GEF0ihrOub zqfx+Fh~Qu*-WJw0quPC|M#+QG)k%opd;h_!9?K;h5GEGnKt{b+MR;!y%_0s+3`TVy zI6r-v=8lw@x^;XfFzddj=nqb@yZ-NCuL_o%ouCIAdS4;(L*?H z0IAFh4sG(Q+L`3KT6ODf_AU&gFuiJsY89i}cIz#92d#jwHEG+>siv#{wai13FDhRWGF`){ z2D$=_zXP7!ldgrK-z&k=`XtB+`K1$Ji8vZCBw*XyTDlkCa~josV?z4x`bNm}B^l|A z%w5y{pyL=~JoJBBJ?M0NBZh!(TOTM6W$f5v`!WDdluEn&|724cI!x;!{{0=qF5fTL;y%MH zX1Q8B;1`j#-Zny_nZF`3r|r-KQdZ~VPs|9*F3s;K>g3b{^1$cJ%3B;G0o*5qv?dukv5<7f|l^|9z>ZZiR@tm4SCA;>K9( zqoQvOeb!7330PYQdAyu4194qrorlz~HzG72F`C?o#QiU^UaYU#8o7n=Ce~U|mqRv4 zOK>LL*Sx%$zdd?C%brDkFv$P;zV3-)2&dAMjN?tdiGtU1Gft@6R|K(#EO;YK=2p}V z1m@P@{?VMed-Xn1nX3R5eW_O=7cYe6LIXn5u2M3Zmi(bgLaF8zqd}zfs|E}^uMX!i zd5+?h3652cuGV3x0ck~sL!~eRy78zeE7F;9kI^{zY$PrDgOZ3c&M8JiM#<<&^2Zek z<&1NT#_VS!UCAHLL~n)u&qidDKLQ9Tv29{ZBd3S6~o!x zzrxXFd1QXCQC9?Jchmerr{$BWl!LE$pWSU4j$X_y^V{{~KoVbG-^$Omw@B|xi^j-j zBX&t?HK&M{<9uM_%np!J`YvmaSK6+68lkLq=<@3Q>LH^$URKWBPGt%p*uAUXU%dXx z3%&tc`0&^xGkp<}Ow2)~qL6s_{o_J`fx*|d?jHAzbM%V^@^&Zch6Tec&A$SBNE2Zu z*&_3V?~x|$BE9`D39`gaawuuN-v_=Ig>1mzTp(S6VPV_!rN*aNBHasgBbDZqY80MC z`rN5sjZ|r^5x=|~NkFcgA$*E-X)y=AdSLdJza9Jm)r%cK)8QSxEVwutu#vA!{>vT3QaKz6RC9cJq@SgMUSlg00D2hw@5lGnwFL&yFC|6Ms8 zdizKBFd zm32^QiB8tJif($OQiXHqKZS-$m7PH)n~$f843rAyfNd}L)1{|;T8AF8weiMBu^aiTn z#YqO0h(5{+E+#HN57za${GYbI0xGKRiMFCh5T1J&X4`PQ~JBxKaq~^s{NarzcTWs`cE~cQ%ZYu%&=xf{hkTV0Zq^QH5c24OE3my%ybi}3A|h86BF<)^xI!<)!-so)1z|? z=V6R{4a_tV-4{qG^h-Fibn8hbm;GBol)=+MBqku>1ics;do97}_}cU9zkfWvpf-f&w@?&X|axkO*lemVN_N+3u;Y>rcyVDj_y1a7OoujT?@UOsOa6T6(WUm!d$ z12r@!LkbO8#!ur$P`tvwL2P_|v|q^L?x$@)9!id!rLc_P02lMSYf%ohPdv%z_)VJJ ziz3;p32$@9^=!8EV*575UgEpXrU!OPLUFi8Ny10rL8P6McO%uLs9JlRP3K{fcq`Bjsqb;U(8$KJ>bpd*vZ37!Wn`vVY4Kk<3jiI=#W@Q0UgO| z=~Ni|SImeYwh4k}j?^O_S`sAMuRfWv-<4O={*^KU%VxP2#}z%^3Kd*XtEbv=dc}cI z2$ezP^Q@{}r-mgyPp7JIe8rEbWJNdH+QA=JDsW}-BTm$|5OJKTSROW#Y!8z8V0rvG zu7!3UIg)P>&`&9<9osEW_%Z-+M<-?HlSmMZl5mb899eyq*d04(^rD?F#XP8u zQ~RNTpCm2rjii%nb80cU@mB@m4@)iVhVJ*z0HoBOP1i6WWPFjYdxn&HZr|m*-2BKq zZE6xK2kS!+m{UhxOHUT8e7_Ko@j$}KwJx=I?_PnV?mvIBXQUC~5>6ELsX~YM3TAXN z{#QWjWF(6_Y1gD~&@37>rei$@Oa0lSa>@S7n*Eosh{gjfp=OwTT`i>4orhh%Z*@1* zIb&v@UT$Tf#D00q*H@$W!&-QLnvs=>5tL|c{!zG6#osWcwHdPPd@B4)cJS-VuX>g4 z@7y1fNMmY|zU{ur9uBuNw|*^*f2H`o;m+U|3;)L8mSX$xR7apmmi(($xt^hW_fV}| ztb<|LR|xRVowB2-M6xdMz;5FA1}Kcl@q374W0>;llDd4c(%lSs;;l%iRi#y< zhjFKMWAL-w8B%^N^YxwWR|z6Nb2-R2uQvZrZ})3AT;T@>K`9o>i+|Y(J&{L}H|tIi zu@1HJlC%OB$?I#%Bq>kFN@KTYE<<#S@J4SrPR;wo!iz;8y}=FaiGs-7U?0feq8gngnRxM#PU1hF z7TKulHRk3C(m~m0s3eYfV8VF;=I~u&d8pQApyAzj$Sd3T3gT$Z57zDOXqPO?9v8I9 zJOPgeuM4}@PzSPob#+o=`sE~a`0g9nZ!dPCUmaPnB^jy0B>DIr7e{?wZ}tqFnAUw| z*Oz(G!>su&->2HIsJ?+=WReS#EaNlnDCy8iJn=*>j<+4i7YYEsA96o(!IC~NImfrb zj(C`d%rlhHaXjW}YRJ5`r={#pZW1Y2QY5NRd&| zQp?ZPIGN{BBHZsHn7tNjTGD8HwGv|j?QI@V4XQI%Kbu?5BF zY*Axk;G)Db@Y^%@`K~YVBBK)}mI~F+g6Fz`s0s|qDs~RCf(o-ddgc5)S7a1YY8hL- zbM3(jqgg3vMMiIwS{i_QD4eOxN*yeZ=+r7hM7Wc`oj+YXZb*B=Y^H3I#06x-8E98uyc@i9 z^LQxj3B6fqEa-{%%b!md-?XLurZFp3u>7X)xp=E7?Fo;WvX87%&EW=wE2%PGggZu` zM|3c)G)R!h?gjWTG-$#63IVx#lJ*#H3g&F=Uo|F5wbI2Zncd?I1mO z6Q?$#<5@xh#?!Vtl8l$^*uQ%su!meDO-E}^pE^LM*g?=qIn%Riv^#c;OsdzIT1?H6 zT*1#Q;wsp_s?vXq0-*)}W`P^OVg;Fzn>E#x!nSgbwhA~vJl!RrU>i9$y%1XnQckdS zlaMJ8S$D&ZJ1fE)4DL1F0l>xMEX73lZ_iswu611VRuNA;NrdzMB{f!4e(~(LnOmiU z>E=jcy_0=+GzNU~q4v;EtSFjmw~3tj7bN?xKfFlTw@M0dj0Lg$0_~ zehz|5KF0Y9%9O2|EZ6)fzhx3kPOMmGaRu*J+0$ZtG+FLR0C|Dr9|TW3=Pe%G%%04&F&lH~YSr^a%O?3|F zMS9fxY!ZW7-eodRR<2w+6)+IYPBhYs_>;YAbRp4>N-D^FG3mJSzgwhybZSn3+i>ji z<`0ic)0s6-3Bc1p2YL}6Tz}1P3+&*$m{oH;Z=9|WdSxrDi&)(PXTXl2o&G+Xw=waL z)mgoG>&#BACuF&q8`aH;V(rL5%4#{oQh_F;)2DIVURRP92M_qaSXu~m^E9sDGiiu3 za7oIe{x9c`Yfn00s{1doIr31oLB39IUSd8>s+^dnQ4LBIHA|KiDeXzHpMSv2++GjH zC9aZQ&@=tloR_U>(o7A_n0mP153vrKtEWl%=_I<@W6qxuU`lhvliWTP!~l#K68fDQ zG$RUu*{0y?jH&LUNFHz!{39yB%u70vZ z(c3GMvvWs!hl09a1S?rK&;nMg<(14S=Jq>=+yuTHy5q11yD z_U|IA>l6WX`PT^5`R!{uFkN@?u+CF}NAxXTxrH=y_ORYg<$))dt=L)TMFq4C9Znl; z84#DrfnQ(CXum1UU#;s_Vd6E`&fKMN?-TLSywo2Bx|@oz$i)2+ipd_Ffxphi6w=e) zuM{pDc>i5pdMBn(6BC%0I1lN_?FAJ+Y1G>27RiyCb78%E6-6@?_ct%B z;?&c&4_z=wn|tmB_Q*^DUmhTE8v6kfGt^OC{lf*)_r>dRtd~ptXU8nkc}3RcCMa!t zfMg%Siz`kC9%KP8lb0jOZ-a`pv&rhm;zY?4jGg{(QSoW7ql9ih%li3bwtl_M;F?>J zk6Wuhclq}S9sG=!b^~QAz_;9254BYL1!d9CI}xweai5MORc`nS0(HQ_2x}_;yeQk_ zPH0(sr{o_QsSw6PsXnAvecY~77S+5X>y4H}s|#6!i0J0&#BH6`y0>Tb{&D`rc3P}n z|M(8g{x|>2OR_A1OjN3rWrWR{gz+gF)AmE4pMcvc#)eT8vG|Hu#FqbK_((a)Pj%Ua z##`pJ9Jagw4jt7Z5M9Hrg9*IYOWA$}M&)!yieBpi7pUJMlN95&3e^?65Ei(yDS_8Z zyBn!$IIcDn?;$3z;o!+O>)!|+(>F!>{&T*p@Jvt2%jE3)@St^>tGb(KgK|?J<~_;4 zfORz<%Phlfm>G}wVC$7kfA^|cUHB%@&>x@Y(P&XkIIAW$L3m$HdB3rZo#Wv4(#UFE zgXl|}J3kpQ!{`HP{dzW*Jimiic~MkKjw{zRXxZTDs%{l@Q+GGPbHQ0-_?31!O}VNb zN7mQJp0-AF!LX9=qUe>FRxDDd40i2p!m)JdC>|x5-+6av#o*3^8nIjtumkUaC}yR~ zmApHN=)k$;;a}ME2{wqJ9NckOBP^%7nq~A@a6luBivnwy8$|#r%TrD438Yasf&)j* ztcicG^eg9T(~iRRL$}~BMnSbW;Tse!<>+NYIIwY%unnq6Edo|?uM ze&Q5^cMN!wAnk>GIeLH=GmJ_Wo-PBr$S(-u(+DY%p!iEK|T@TADf87df#aJp*H=( zF^DmFTkmeW+%>lUU*Syi(ZMYCyg@u6>N|zz%->}DgX*NIr!|ZmW-Xl6vQ;;CV$UtCMltVBVtpn3S#wClh z@moo0*Epv7bSm;9kbAK0gYo z1@lVo`Fx0#@MzPLib-)~y3r}9pKO%Hhho=SvJj}dxZc<1n&xQ2)mfy5yS%IG(a%?6 zs|7nsire93Thx^5N_0%+?i5r>HVWZGo!W?u&8c*3#Xg2>u_>!az$_>}^Zb`e z2T^E`%(JI9yAy)t)Rmc3^E4E#vFw6TVykCiYh(TjOf58mVfV(!oeYWm?Bv#?tX9wR zrlaxyrqPQ+H9T4M8^f^YHfML&y@-H>W(bsqboLTiM$^}F1)QNSe!XqQ1Bv67k;Wis zzr`{4;`_C)u@jf8kMHzy7*gYUrp!wQIT&CSpdL3ih=fZGr{q~z?ipi9W6uJs3(qe{ zB-7)WKQYyayL;hfEJ1ZMzlm)m4&hCsl=apfd*9y|nkeP3Asa<~=>ZJshl5r^FH{c4 z-bB$dOi6A{$gscRSg#Rrte&fV#{9}vDQZpLq#pt28m24@!7MkgZnIVv72Z)2TVpfo z&pWnK{S03n)oHLk-Xkhj!FyLSovkeB9-sHZ(jXT8V0bq-hjg#&#YnpV+wZG$?nqZ9 zUfg}r@Ql&7ce&Sr6SGecwKej4{n5uM`+Abx1sdNsu*D4&jztalNDQf_3Kyyzog=@8 z+@RkSvROO2XYdNtI<3o{6~G+0m7gQAmk+uXOsdrJg+4qDsGo-t+1{H1lR(7yWC^Lv)CQM#lc;P=0EZgL3<-^vG zW3SCn-`RWjX10C)k*T>Eyj84{pyw>B{n_X^uENDf^LXYYMDdT)m|#BaNN!D6dTm$= z&@MH47N7hi)e^P9?lc4{{zs;(zz7rfN0aHcbqL+mt~RQV%hBgPjS7aW@O#d&EshA5!OG~Na{|8wdtvf2U3uW6NPhJ1qX6qR z14;7Q&~_I`%kvPfYP~oBc^&rbxyRk--sc7rvVWnRv9_?|ncYB#lz?))Ibw0*2oedg ze}O~`jdNJFkLJ^XE;m2oZ;s@H0bB|@tK%7iUk(ahHeFGBhD76b-p4aKqxLB!<-|Bd ziJI5(On0F}iusfYjRH>}!QYgUCqaVxo#UAgGB&ZnAe`oM6}KJ<70L=9@}y75r#*Mk zTMs1Z`-_uUeXSxh$8PTDu80i(5L(4{ zrs(R;{F=4i?I)~W)4pcLR{agF?yd=?S>!|aCV!lZdwA>FE&9ABgd~N4aO*Znk&&CH z7H;41n8Rs0zYLwq0OJm=L*_VAJ;_y_-}BYH+_D<~pai;FiX ztg$(|7Z*e?-gE^@cnQC!xkUUBSqLePJUuv54KL>T#hu$m+f&iGXL7K1;*jFG0y`eV ztRJRHTmV|j%nyIukFYCi_23-Wb6YkY{|5cU@dF8cxdDCoPoTkuY=Q&uLn}*0A2Xp( zb>|_oV>|d-dBI*v0`jj!4EDG0@8P3OTqEcVt>3$vQ24|Qld3jqwCE6$;ol)NQRgMf zdU~`tw4afYeRz7oR^lD>^O!J%{E*-FRj8V}bfYpp<%_kFMY(MF9TCI)ZJkC5{05>^ z27d;^M`VZmm7SB*KrYe_cvH?Xx_Ut|MASnkd3S}xoX0kHfN(%DS9c|~mX>=(oRx1T zI#j0_ukjHvGuha6+t^UCaOFr$9$ez+M5hK{oV=QECOI^dV2X^yJk*7tfc*6}+sIHh zg0-lj8T5qMMahX>WM~vYGVw5N5x1dAZiwoy&`LX+9)!@#Cl@FVOCG;Qs#z&0p{LeB zAQ3YeXg@5Jm?CXIrj?p|jRblfw9Y0dLmg2dG)!v7A5w3_Jw(eLV0F*r%{$Y%$zu`2 zXYAVg8e*9TWY)`N&ARD#L2X*jwlDf zU&i~q!19)Ow29i2ae|;qjd%i|67QRL+E@5=bw8g&rikI&Rv#UExQS6x*^a|!zFvtH zA?F;Fy!>jq;PXs50-5X9lMG27ohnrU*{x6O%8;{!%^0!OmGsKzI+8WLMsIw4bYg0H zx1midveN?Fft+x$^c%9144EF}YE|+;U*|SH{c3u&kIwBHe$L6{1dmSRDk9YQcjGym z&Eb+QwNk>KfW23rJhU{c(5QzML+%N@WO7xG@5X}+=V<$We_?%rbFYTqVv-@wgB(`n zIQ$SZD3-K`Q<+-R>qVrtlwR(GbL9u$xkju+Fis1Io2f;cA}F!Zoa_h%;V%F8RL=zK*w-T)8>a{h-mboZ9Wj z^Tdi@M88x4g%!NoMvrn*x@74JhjL84pTC zq9(^m&|*t;l@K)pm7L*&Uhmu%n%pFUQdC~`;UO>x_mafd4})m6+l+MQ5WK}Ro}qe8 zB0VGens~V}z>`f^TWSc+VTtEG!vLlB2>Srcun%lc;2NK_M@Q3)7$a8aRcnh9UP7Oy+Q9q;4koZC0VOHvm8{D#lahaS7!|I@GZA<>TVS1f0CTS9`J z=8tle!`L8XeTCH*OJ3^}%Xcs})GbL(-D;Gda|L$&aa+E7a?t&eLie#j?e%*>s%1bK z>c`mN^>vI@GCCHXBOvk|ADtgNmTw;8VXaB{2^9u@<=IGDsAYt+P35xuGw8gI;l&Gf zk@1zeQtM-wyxG6fX&xbNui0OLDjvhtLPG0(m=$itat1diOxYn5w0D-|o)ey`SAEj? zM3LQ9Uas>teIXm7M2iFl+}E9Xd{-;^HurzypC->Sup>B2TE(+d7S3Fhx@s98 zytIN_Bv0$FIqa$~TH{4q{_I#Itj}KTdOraKpUse-2_>Mj(Z}3kEe&bH4A}=k5k;EBVHC~oufX_)lGq;^iusDZSXZ$s;H0WDYT^Tv>9hk zNYi>ljiRmuFHaLZXfjnLv39Ecs8x*Iz&qZV*C|Pp9T0yKPx}OLEZOtBU%5TSzvH&{ z&+zBs$Hx5yIeJQ&aF4B=GsTmD{oVEDaW&F0V*kf08Cgr@CcD|8%v25Bbcw%f@dIMd z!6EWgtotBbxsl9L1&;>*{PhMc;W1ok`sohU)>cdC0ZERsrwT;^f-$skC=s6lS%)8| zyhn3;MoW@L0M8C6$x(T5Xl%d19VNu;1;dHt`X+7f*C&;K;O5lAD^^ti?jrX%L zZvhIXs~OK4#qMM-{Di1ls70?wC7v~j9diAqy?|@#wV+6+EnVGssTYqKTwAk-qnnD1 zBDdI@rDbn+(dAq#qHnp!8<`KIf`JnKbUB}j!CGDQc-DM&2;`={y=!aqu%N~v)vWZ3 z$1$KbMT8OWqe9p%(VHB}UnFGizeOMc(_J8GgboS91{sk>w|uE7q0%>@6#V>m3}6)h E2Q75D@&Et; diff --git a/previews/PR3913/api/JuMP.Containers/index.html b/previews/PR3913/api/JuMP.Containers/index.html index 367a99d4ce5..283c34f2511 100644 --- a/previews/PR3913/api/JuMP.Containers/index.html +++ b/previews/PR3913/api/JuMP.Containers/index.html @@ -12,7 +12,7 @@ 3 4 julia> array[:b, 3] -4source

  • All usages of @SDconstraint are deprecated. The new syntax is @constraint(model, X >= Y, PSDCone()).
  • Creating a DenseAxisArray with a Number as an axis will now display a warning. This catches a common error in which users write @variable(model, x[length(S)]) instead of @variable(model, x[1:length(S)]).
  • The caching_mode argument to Model, for example, Model(caching_mode = MOIU.MANUAL) mode has been removed. For more control over the optimizer, use direct_model instead.
  • The previously deprecated lp_objective_perturbation_range and lp_rhs_perturbation_range functions have been removed. Use lp_sensitivity_report instead.
  • The .m fields of NonlinearExpression and NonlinearParameter have been renamed to .model.
  • Infinite variable bounds are now ignored. Thus, @variable(model, x <= Inf) will show has_upper_bound(x) == false. Previously, these bounds were passed through to the solvers which caused numerical issues for solvers expecting finite bounds.
  • The variable_type and constraint_type functions were removed. This should only affect users who previously wrote JuMP extensions. The functions can be deleted without consequence.
  • The internal functions moi_mode, moi_bridge_constraints, moi_add_constraint, and moi_add_to_function_constant are no longer exported.
  • The un-used method Containers.generate_container has been deleted.
  • The Containers API has been refactored, and _build_ref_sets is now public as Containers.build_ref_sets.
  • The parse_constraint_ methods for extending @constraint at parse time have been refactored in a breaking way. Consult the Extensions documentation for more details and examples.
  • Added

    • The TerminationStatusCode and ResultStatusCode enums are now exported by JuMP. Prefer termination_status(model) == OPTIMAL instead of == MOI.OPTIMAL, although the MOI. prefix way still works.
    • Copy a x::DenseAxisArray to an Array by calling Array(x).
    • NonlinearExpression is now a subtype of AbstractJuMPScalar
    • Constraints such as @constraint(model, x + 1 in MOI.Integer()) are now supported.
    • primal_feasibility_report now accepts a function as the first argument.
    • Scalar variables @variable(model, x[1:2] in MOI.Integer()) creates two variables, both of which are constrained to be in the set MOI.Integer.
    • Conic constraints can now be specified as inequalities under a different partial ordering. So @constraint(model, x - y in MOI.Nonnegatives()) can now be written as @constraint(model, x >= y, MOI.Nonnegatives()).
    • Names are now set for vectorized constraints.

    Fixed

    • Fixed a performance issue when show was called on a SparseAxisArray with a large number of elements.
    • Fixed a bug displaying barrier and simplex iterations in solution_summary.
    • Fixed a bug by implementing hash for DenseAxisArray and SparseAxisArray.
    • Names are now only set if the solver supports them. Previously, this prevented solvers such as Ipopt from being used with direct_model.
    • MutableArithmetics.Zero is converted into a 0.0 before being returned to the user. Previously, some calls to @expression would return the undocumented MutableArithmetics.Zero() object. One example is summing over an empty set @expression(model, sum(x[i] for i in 1:0)). You will now get 0.0 instead.
    • AffExpr and QuadExpr can now be used with == 0 instead of iszero. This fixes a number of issues relating to Julia standard libraries such as LinearAlgebra and SparseArrays.
    • Fixed a bug when registering a user-defined function with splatting.

    Other

    • The documentation is now available as a PDF.
    • The documentation now includes a full copy of the MathOptInterface documentation to make it easy to link concepts between the docs. (The MathOptInterface documentation has also been significantly improved.)
    • The documentation contains a large number of improvements and clarifications on a range of topics. Thanks to @sshin23, @DilumAluthge, and @jlwether.
    • The documentation is now built with Julia 1.6 instead of 1.0.
    • Various error messages have been improved to be more readable.

    Version 0.21.10 (September 4, 2021)

    Added

    • Added add_NL_expression
    • add_NL_xxx functions now support AffExpr and QuadExpr as terms

    Fixed

    • Fixed a bug in solution_summary
    • Fixed a bug in relax_integrality

    Other

    • Improved error message in lp_sensitivity_report

    Version 0.21.9 (August 1, 2021)

    Added

    • Containers now support arbitrary container types by passing the type to the container keyword and overloading Containers.container.
    • is_valid now supports nonlinear constraints
    • Added unsafe_backend for querying the inner-most optimizer of a JuMP model.
    • Nonlinear parameters now support the plural @NLparameters macro.
    • Containers (for example, DenseAxisArray) can now be used in vector-valued constraints.

    Other

    • Various improvements to the documentation.

    Version 0.21.8 (May 8, 2021)

    Added

    • The @constraint macro is now extendable in the same way as @variable.
    • AffExpr and QuadExpr can now be used in nonlinear macros.

    Fixed

    • Fixed a bug in lp_sensitivity_report.
    • Fixed an inference issue when creating empty SparseAxisArrays.

    Version 0.21.7 (April 12, 2021)

    Added

    • Added primal_feasibility_report, which can be used to check whether a primal point satisfies primal feasibility.
    • Added coefficient, which returns the coefficient associated with a variable in affine and quadratic expressions.
    • Added copy_conflict, which returns the IIS of an infeasible model.
    • Added solution_summary, which returns (and prints) a struct containing a summary of the solution.
    • Allow AbstractVector in vector constraints instead of just Vector.
    • Added latex_formulation(model) which returns an object representing the latex formulation of a model. Use print(latex_formulation(model)) to print the formulation as a string.
    • User-defined functions in nonlinear expressions are now automatically registered to aid quick model prototyping. However, a warning is printed to encourage the manual registration.
    • DenseAxisArray's now support broadcasting over multiple arrays.
    • Container indices can now be iterators of Base.SizeUnknown.

    Fixed

    • Fixed bug in rad2deg and deg2rad in nonlinear expressions.
    • Fixed a MethodError bug in Containers when forcing container type.
    • Allow partial slicing of a DenseAxisArray, resolving an issue from 2014.
    • Fixed a bug printing variable names in IJulia.
    • Ending an IJulia cell with model now prints a summary of the model (like in the REPL) not the latex formulation. Use print(model) to print the latex formulation.
    • Fixed a bug when copying models containing nested arrays.

    Other

    • Tutorials are now part of the documentation, and more refactoring has taken place.
    • Added JuliaFormatter added as a code formatter.
    • Added some precompilation statements to reduce initial latency.
    • Various improvements to error messages to make them more helpful.
    • Improved performance of value(::NonlinearExpression).
    • Improved performance of fix(::VariableRef).

    Version 0.21.6 (January 29, 2021)

    Added

    • Added support for skew symmetric variables via @variable(model, X[1:2, 1:2] in SkewSymmetricMatrixSpace()).
    • lp_sensitivity_report has been added which significantly improves the performance of querying the sensitivity summary of an LP. lp_objective_perturbation_range and lp_rhs_perturbation_range are deprecated.
    • Dual warm-starts are now supported with set_dual_start_value and dual_start_value.
    • (\in<tab>) can now be used in macros instead of = or in.
    • Use haskey(model::Model, key::Symbol) to check if a name key is registered in a model.
    • Added unregister(model::Model, key::Symbol) to unregister a name key from model.
    • Added callback_node_status for use in callbacks.
    • Added print_bridge_graph to visualize the bridging graph generated by MathOptInterface.
    • Improved error message for containers with duplicate indices.

    Fixed

    • Various fixes to pass tests on Julia 1.6.
    • Fixed a bug in the printing of nonlinear expressions in IJulia.
    • Fixed a bug when nonlinear expressions are passed to user-defined functions.
    • Some internal functions that were previously exported are now no longer exported.
    • Fixed a bug when relaxing a fixed binary variable.
    • Fixed a StackOverflowError that occurred when SparseAxisArrays had a large number of elements.
    • Removed an unnecessary type assertion in list_of_constraint_types.
    • Fixed a bug when copying models with registered expressions.

    Other

    • The documentation has been significantly overhauled. It now has distinct sections for the manual, API reference, and examples. The existing examples in /examples have now been moved to /docs/src/examples and rewritten using Literate.jl, and they are now included in the documentation.
    • JuliaFormatter has been applied to most of the codebase. This will continue to roll out over time, as we fix upstream issues in the formatter, and will eventually become compulsory.
    • The root cause of a large number of method invalidations has been resolved.
    • We switched continuous integration from Travis and Appveyor to GitHub Actions.

    Version 0.21.5 (September 18, 2020)

    Fixed

    • Fixed deprecation warnings
    • Throw DimensionMismatch for incompatibly sized functions and sets
    • Unify treatment of keys(x) on JuMP containers

    Version 0.21.4 (September 14, 2020)

    Added

    • Add debug info when adding unsupported constraints
    • Add relax_integrality for solving continuous relaxation
    • Allow querying constraint conflicts

    Fixed

    • Dispatch on Real for MOI.submit
    • Implement copy for CustomSet in tests
    • Don't export private macros
    • Fix invalid assertion in nonlinear
    • Error if constraint has NaN right-hand side
    • Improve speed of tests
    • Lots of work modularizing files in /test
    • Improve line numbers in macro error messages
    • Print nonlinear subexpressions
    • Various documentation updates
    • Dependency updates:
      • Datastructures 0.18
      • MathOptFormat v0.5
      • Prep for MathOptInterface 0.9.15

    Version 0.21.3 (June 18, 2020)

    • Added Special Order Sets (SOS1 and SOS2) to JuMP with default weights to ease the creation of such constraints (#2212).
    • Added functions simplex_iterations, barrier_iterations and node_count (#2201).
    • Added function reduced_cost (#2205).
    • Implemented callback_value for affine and quadratic expressions (#2231).
    • Support MutableArithmetics.Zero in objective and constraints (#2219).
    • Documentation improvements:
      • Mention tutorials in the docs (#2223).
      • Update COIN-OR links (#2242).
      • Explicit link to the documentation of MOI.FileFormats (#2253).
      • Typo fixes (#2261).
    • Containers improvements:
      • Fix Base.map for DenseAxisArray (#2235).
      • Throw BoundsError if number of indices is incorrect for DenseAxisArray and SparseAxisArray (#2240).
    • Extensibility improvements:
      • Implement a set_objective method fallback that redirects to set_objective_sense and set_objective_function (#2247).
      • Add parse_constraint method with arbitrary number of arguments (#2051).
      • Add parse_constraint_expr and parse_constraint_head (#2228).

    Version 0.21.2 (April 2, 2020)

    • Added relative_gap() to access MOI.RelativeGap() attribute (#2199).
    • Documentation fixes:
      • Added link to source for docstrings in the documentation (#2207).
      • Added docstring for @variables macro (#2216).
      • Typo fixes (#2177, #2184, #2182).
    • Implementation of methods for Base functions:
      • Implemented Base.empty! for JuMP.Model (#2198).
      • Implemented Base.conj for JuMP scalar types (#2209).

    Fixed

    • Fixed sum of expression with scalar product in macro (#2178).
    • Fixed writing of nonlinear models to MathOptFormat (#2181).
    • Fixed construction of empty SparseAxisArray (#2179).
    • Fixed constraint with zero function (#2188).

    Version 0.21.1 (Feb 18, 2020)

    • Improved the clarity of the with_optimizer deprecation warning.

    Version 0.21.0 (Feb 16, 2020)

    Breaking

    • Deprecated with_optimizer (#2090, #2084, #2141). You can replace with_optimizer by either nothing, optimizer_with_attributes or a closure:

      • replace with_optimizer(Ipopt.Optimizer) by Ipopt.Optimizer.
      • replace with_optimizer(Ipopt.Optimizer, max_cpu_time=60.0) by optimizer_with_attributes(Ipopt.Optimizer, "max_cpu_time" => 60.0).
      • replace with_optimizer(Gurobi.Optimizer, env) by () -> Gurobi.Optimizer(env).
      • replace with_optimizer(Gurobi.Optimizer, env, Presolve=0) by optimizer_with_attributes(() -> Gurobi.Optimizer(env), "Presolve" => 0).

      alternatively to optimizer_with_attributes, you can also set the attributes separately with set_optimizer_attribute.

    • Renamed set_parameter and set_parameters to set_optimizer_attribute and set_optimizer_attributes (#2150).

    • Broadcast should now be explicit inside macros. @SDconstraint(model, x >= 1) and @constraint(model, x + 1 in SecondOrderCone()) now throw an error instead of broadcasting 1 along the dimension of x (#2107).

    • @SDconstraint(model, x >= 0) is now equivalent to @constraint(model, x in PSDCone()) instead of @constraint(model, (x .- 0) in PSDCone()) (#2107).

    • The macros now create the containers with map instead of for loops, as a consequence, containers created by @expression can now have any element type and containers of constraint references now have concrete element types when possible. This fixes a long-standing issue where @expression could only be used to generate a collection of linear expressions. Now it works for quadratic expressions as well (#2070).

    • Calling deepcopy(::AbstractModel) now throws an error.

    • The constraint name is now printed in the model string (#2108).

    Added

    • Added support for solver-independent and solver-specific callbacks (#2101).
    • Added write_to_file and read_from_file, supported formats are CBF, LP, MathOptFormat, MPS and SDPA (#2114).
    • Added support for complementarity constraints (#2132).
    • Added support for indicator constraints (#2092).
    • Added support for querying multiple solutions with the result keyword (#2100).
    • Added support for constraining variables on creation (#2128).
    • Added method delete that deletes a vector of variables at once if it is supported by the underlying solver (#2135).
    • The arithmetic between JuMP expression has be refactored into the MutableArithmetics package (#2107).
    • Improved error on complex values in NLP (#1978).
    • Added an example of column generation (#2010).

    Fixed

    • Incorrect coefficients generated when using Symmetric variables (#2102)

    Version 0.20.1 (Oct 18, 2019)

    • Add sections on @variables and @constraints in the documentation (#2062).
    • Fixed product of sparse matrices for Julia v1.3 (#2063).
    • Added set_objective_coefficient to modify the coefficient of a linear term of the objective function (#2008).
    • Added set_time_limit_sec, unset_time_limit_sec and time_limit_sec to set and query the time limit for the solver in seconds (#2053).

    Version 0.20.0 (Aug 24, 2019)

    • Documentation updates.
    • Numerous bug fixes.
    • Better error messages (#1977, #1978, #1997, #2017).
    • Performance improvements (#1947, #2032).
    • Added LP sensitivity summary functions lp_objective_perturbation_range and lp_rhs_perturbation_range (#1917).
    • Added functions dual_objective_value, raw_status and set_parameter.
    • Added function set_objective_coefficient to modify the coefficient of a linear term of the objective (#2008).
    • Added functions set_normalized_rhs, normalized_rhs, and add_to_function_constant to modify and get the constant part of a constraint (#1935, #1960).
    • Added functions set_normalized_coefficient and normalized_coefficient to modify and get the coefficient of a linear term of a constraint (#1935, #1960).
    • Numerous other improvements in MOI 0.9, see the NEWS.md file of MOI for more details.

    Version 0.19.2 (June 8, 2019)

    • Fix a bug in derivatives that could arise in models with nested nonlinear subexpressions.

    Version 0.19.1 (May 12, 2019)

    • Usability and performance improvements.
    • Bug fixes.

    Version 0.19.0 (February 15, 2019)

    JuMP 0.19 contains significant breaking changes.

    Breaking

    • JuMP's abstraction layer for communicating with solvers changed from MathProgBase (MPB) to MathOptInterface (MOI). MOI addresses many longstanding design issues. (See @mlubin's slides from JuMP-dev 2018.) JuMP 0.19 is compatible only with solvers that have been updated for MOI. See the installation guide for a list of solvers that have and have not yet been updated.

    • Most solvers have been renamed to PackageName.Optimizer. For example, GurobiSolver() is now Gurobi.Optimizer.

    • Solvers are no longer added to a model via Model(solver = XXX(kwargs...)). Instead use Model(with_optimizer(XXX, kwargs...)). For example, Model(with_optimizer(Gurobi.Optimizer, OutputFlag=0)).

    • JuMP containers (for example, the objects returned by @variable) have been redesigned. Containers.SparseAxisArray replaces JuMPDict, JuMPArray was rewritten (inspired by AxisArrays) and renamed Containers.DenseAxisArray, and you can now request a container type with the container= keyword to the macros. See the corresponding documentation for more details.

    • The statuses returned by solvers have changed. See the possible status values here. The MOI statuses are much richer than the MPB statuses and can be used to distinguish between previously indistinguishable cases (for example, did the solver have a feasible solution when it stopped because of the time limit?).

    • Starting values are separate from result values. Use value to query the value of a variable in a solution. Use start_value and set_start_value to get and set an initial starting point provided to the solver. The solutions from previous solves are no longer automatically set as the starting points for the next solve.

    • The data structures for affine and quadratic expressions AffExpr and QuadExpr have changed. Internally, terms are stored in dictionaries instead of lists. Duplicate coefficients can no longer exist. Accessors and iteration methods have changed.

    • JuMPNLPEvaluator no longer includes the linear and quadratic parts of the model in the evaluation calls. These are now handled separately to allow NLP solvers that support various types of constraints.

    • JuMP solver-independent callbacks have been replaced by solver-specific callbacks. See your favorite solver for more details. (See the note below: No solver-specific callbacks are implemented yet.)

    • The norm() syntax is no longer recognized inside macros. Use the SecondOrderCone() set instead.

    • JuMP no longer performs automatic transformation between special quadratic forms and second-order cone constraints. Support for these constraint classes depends on the solver.

    • The symbols :Min and :Max are no longer used as optimization senses. Instead, JuMP uses the OptimizationSense enum from MathOptInterface. @objective(model, Max, ...), @objective(model, Min, ...), @NLobjective(model, Max, ...), and @objective(model, Min, ...) remain valid, but @objective(m, :Max, ...) is no longer accepted.

    • The sign conventions for duals has changed in some cases for consistency with conic duality (see the documentation). The shadow_price helper method returns duals with signs that match conventional LP interpretations of dual values as sensitivities of the objective value to relaxations of constraints.

    • @constraintref is no longer defined. Instead, create the appropriate container to hold constraint references manually. For example,

      constraints = Dict() # Optionally, specify types for improved performance.
       for i in 1:N
         constraints[i] = @constraint(model, ...)
      -end
    • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

    • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

    Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    +end
  • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

  • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

  • Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    diff --git a/previews/PR3913/developers/checklists/index.html b/previews/PR3913/developers/checklists/index.html index 07d9d34e7ff..05116bef569 100644 --- a/previews/PR3913/developers/checklists/index.html +++ b/previews/PR3913/developers/checklists/index.html @@ -69,4 +69,4 @@ - [ ] Implement `vectorize(data, ::NewShape)::Vector` - [ ] Implement `reshape_vector(vector, ::NewShape)` - [ ] Implement `dual_shape`, or verify that the shape is self-dual - - [ ] Add the tests from https://github.com/jump-dev/JuMP.jl/pull/3816 + - [ ] Add the tests from https://github.com/jump-dev/JuMP.jl/pull/3816 diff --git a/previews/PR3913/developers/contributing/index.html b/previews/PR3913/developers/contributing/index.html index 84382a30b2e..d1aa2eeb229 100644 --- a/previews/PR3913/developers/contributing/index.html +++ b/previews/PR3913/developers/contributing/index.html @@ -25,4 +25,4 @@ $ git checkout master -$ git pull
    Note

    If you have suggestions to improve this guide, please make a pull request. It's particularly helpful if you do this after your first pull request because you'll know all the parts that could be explained better.

    +$ git pull
    Note

    If you have suggestions to improve this guide, please make a pull request. It's particularly helpful if you do this after your first pull request because you'll know all the parts that could be explained better.

    diff --git a/previews/PR3913/developers/custom_solver_binaries/index.html b/previews/PR3913/developers/custom_solver_binaries/index.html index b2ed23d5daf..4f0bf96d8f7 100644 --- a/previews/PR3913/developers/custom_solver_binaries/index.html +++ b/previews/PR3913/developers/custom_solver_binaries/index.html @@ -90,4 +90,4 @@ libCbc_path = "/usr/local/Cellar/cbc/2.10.5/lib/libCbc.3.10.5" libOsiCbc_path = "/usr/local/Cellar/cbc/2.10.5/lib/libOsiCbc.3.10.5" libcbcsolver_path = "/usr/local/Cellar/cbc/2.10.5/lib/libCbcSolver.3.10.5"
    Info

    Note that capitalization matters, so libcbcsolver_path corresponds to libCbcSolver.3.10.5.

    Override entire artifact

    To use the homebrew install as our custom binary we add the following to ~/.julia/artifacts/Overrides.toml:

    # Override for Cbc_jll
    -e481bc81db5e229ba1f52b2b4bd57484204b1b06 = "/usr/local/Cellar/cbc/2.10.5"
    +e481bc81db5e229ba1f52b2b4bd57484204b1b06 = "/usr/local/Cellar/cbc/2.10.5" diff --git a/previews/PR3913/developers/extensions/index.html b/previews/PR3913/developers/extensions/index.html index 3093193e784..cfa5d54be3b 100644 --- a/previews/PR3913/developers/extensions/index.html +++ b/previews/PR3913/developers/extensions/index.html @@ -310,4 +310,4 @@ _function_barrier(names, model, F, S) end return names -end
    Note

    It is important to explicitly type the F and S arguments. If you leave them untyped, for example, function _function_barrier(names, model, F, S), Julia will not specialize the function calls and performance will not be improved.

    +end
    Note

    It is important to explicitly type the F and S arguments. If you leave them untyped, for example, function _function_barrier(names, model, F, S), Julia will not specialize the function calls and performance will not be improved.

    diff --git a/previews/PR3913/developers/roadmap/index.html b/previews/PR3913/developers/roadmap/index.html index 095000b3085..ced02270632 100644 --- a/previews/PR3913/developers/roadmap/index.html +++ b/previews/PR3913/developers/roadmap/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Development roadmap

    The JuMP developers have compiled this roadmap document to share their plans and goals with the JuMP community. Contributions to roadmap issues are especially invited.

    Most of these issues will require changes to both JuMP and MathOptInterface, and are non-trivial in their implementation. They are in no particular order, but represent broad themes that we see as areas in which JuMP could be improved.

    • Support nonlinear expressions with vector-valued inputs and outputs. There are a few related components:
      • Representing terms like log(det(X)) as necessary for Convex.jl
      • Automatic differentiation of terms with vector inputs and outputs
      • User-defined functions with vector–as opposed to scalar–inputs, which is particularly useful for optimal control problems
      • User-defined functions with vector outputs, avoiding the need for User-defined operators with vector outputs
    • Add support for modeling with SI units. The UnitJuMP.jl extension is a good proof of concept for what this would look like. We want to make units a first-class concept in JuMP. See #1350 for more details.

    Completed

    +

    Development roadmap

    The JuMP developers have compiled this roadmap document to share their plans and goals with the JuMP community. Contributions to roadmap issues are especially invited.

    Most of these issues will require changes to both JuMP and MathOptInterface, and are non-trivial in their implementation. They are in no particular order, but represent broad themes that we see as areas in which JuMP could be improved.

    • Support nonlinear expressions with vector-valued inputs and outputs. There are a few related components:
      • Representing terms like log(det(X)) as necessary for Convex.jl
      • Automatic differentiation of terms with vector inputs and outputs
      • User-defined functions with vector–as opposed to scalar–inputs, which is particularly useful for optimal control problems
      • User-defined functions with vector outputs, avoiding the need for User-defined operators with vector outputs
    • Add support for modeling with SI units. The UnitJuMP.jl extension is a good proof of concept for what this would look like. We want to make units a first-class concept in JuMP. See #1350 for more details.

    Completed

    diff --git a/previews/PR3913/developers/style/index.html b/previews/PR3913/developers/style/index.html index 74e5005fab2..0b88b46cf2a 100644 --- a/previews/PR3913/developers/style/index.html +++ b/previews/PR3913/developers/style/index.html @@ -182,4 +182,4 @@ end # module TestPkg -TestPkg.runtests()

    Break the tests into multiple files, with one module per file, so that subsets of the codebase can be tested by calling include with the relevant file.

    +TestPkg.runtests()

    Break the tests into multiple files, with one module per file, so that subsets of the codebase can be tested by calling include with the relevant file.

    diff --git a/previews/PR3913/extensions/DimensionalData/index.html b/previews/PR3913/extensions/DimensionalData/index.html index c883922b3ad..f89d35d2112 100644 --- a/previews/PR3913/extensions/DimensionalData/index.html +++ b/previews/PR3913/extensions/DimensionalData/index.html @@ -45,4 +45,4 @@ ↓ j Categorical{String} ["a", "b"] ForwardOrdered └──────────────────────────────────────────────────────────────────────────────┘ "a" x[2,a] + x[3,a] + x[4,a] ≤ 1 - "b" x[2,b] + x[3,b] + x[4,b] ≤ 1

    Documentation

    See the DimensionalData.jl documentation for more details on the syntax and features of DimensionalData.DimArray.

    + "b" x[2,b] + x[3,b] + x[4,b] ≤ 1

    Documentation

    See the DimensionalData.jl documentation for more details on the syntax and features of DimensionalData.DimArray.

    diff --git a/previews/PR3913/extensions/introduction/index.html b/previews/PR3913/extensions/introduction/index.html index 12602cb5c57..28380933c33 100644 --- a/previews/PR3913/extensions/introduction/index.html +++ b/previews/PR3913/extensions/introduction/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Introduction

    This section of the documentation contains brief documentation for some popular JuMP extensions. The list of extensions is not exhaustive, but instead is intended to help you discover popular JuMP extensions, and to give you an overview of the types of extensions that are possible to write with JuMP.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new extensions

    Written an extension? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    Weak dependencies

    Some extensions listed in this section are implemented using the weak dependency feature added to Julia in v1.9. These extensions are activated if and only if you have JuMP and the other package loaded into your current scope with using or import.

    Compat

    Using a weak dependency requires Julia v1.9 or later.

    +

    Introduction

    This section of the documentation contains brief documentation for some popular JuMP extensions. The list of extensions is not exhaustive, but instead is intended to help you discover popular JuMP extensions, and to give you an overview of the types of extensions that are possible to write with JuMP.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new extensions

    Written an extension? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    Weak dependencies

    Some extensions listed in this section are implemented using the weak dependency feature added to Julia in v1.9. These extensions are activated if and only if you have JuMP and the other package loaded into your current scope with using or import.

    Compat

    Using a weak dependency requires Julia v1.9 or later.

    diff --git a/previews/PR3913/index.html b/previews/PR3913/index.html index c70b1148c2e..dda2d54eec8 100644 --- a/previews/PR3913/index.html +++ b/previews/PR3913/index.html @@ -32,4 +32,4 @@ journal = {Mathematical Programming Computation}, year = {2023}, doi = {10.1007/s12532-023-00239-3} -}

    NumFOCUS

    NumFOCUS logo

    JuMP is a Sponsored Project of NumFOCUS, a 501(c)(3) nonprofit charity in the United States. NumFOCUS provides JuMP with fiscal, legal, and administrative support to help ensure the health and sustainability of the project. Visit numfocus.org for more information.

    You can support JuMP by donating.

    Donations to JuMP are managed by NumFOCUS. For donors in the United States, your gift is tax-deductible to the extent provided by law. As with any donation, you should consult with your tax adviser about your particular tax situation.

    JuMP's largest expense is the annual JuMP-dev workshop. Donations will help us provide travel support for JuMP-dev attendees and take advantage of other opportunities that arise to support JuMP development.

    License

    JuMP is licensed under the MPL-2.0 software license. Consult the license and the Mozilla FAQ for more information. In addition, JuMP is typically used in conjunction with solver packages and extensions which have their own licences. Consult their package repositories for the specific licenses that apply.

    +}

    NumFOCUS

    NumFOCUS logo

    JuMP is a Sponsored Project of NumFOCUS, a 501(c)(3) nonprofit charity in the United States. NumFOCUS provides JuMP with fiscal, legal, and administrative support to help ensure the health and sustainability of the project. Visit numfocus.org for more information.

    You can support JuMP by donating.

    Donations to JuMP are managed by NumFOCUS. For donors in the United States, your gift is tax-deductible to the extent provided by law. As with any donation, you should consult with your tax adviser about your particular tax situation.

    JuMP's largest expense is the annual JuMP-dev workshop. Donations will help us provide travel support for JuMP-dev attendees and take advantage of other opportunities that arise to support JuMP development.

    License

    JuMP is licensed under the MPL-2.0 software license. Consult the license and the Mozilla FAQ for more information. In addition, JuMP is typically used in conjunction with solver packages and extensions which have their own licences. Consult their package repositories for the specific licenses that apply.

    diff --git a/previews/PR3913/installation/index.html b/previews/PR3913/installation/index.html index c156d5c3c30..c197d30fcaa 100644 --- a/previews/PR3913/installation/index.html +++ b/previews/PR3913/installation/index.html @@ -28,4 +28,4 @@ [4076af6c] ↓ JuMP v0.21.5 ⇒ v0.18.6 [707a9f91] + JuMPeR v0.6.0 Updating `~/jump_example/Manifest.toml` - ... lines omitted ...

    JuMPeR gets added at version 0.6.0 (+ JuMPeR v0.6.0), but JuMP gets downgraded from 0.21.5 to 0.18.6 (↓ JuMP v0.21.5 ⇒ v0.18.6)! The reason for this is that JuMPeR doesn't support a version of JuMP newer than 0.18.6.

    Tip

    Pay careful attention to the output of the package manager when adding new packages, especially when you see a package being downgraded.

    + ... lines omitted ...

    JuMPeR gets added at version 0.6.0 (+ JuMPeR v0.6.0), but JuMP gets downgraded from 0.21.5 to 0.18.6 (↓ JuMP v0.21.5 ⇒ v0.18.6)! The reason for this is that JuMPeR doesn't support a version of JuMP newer than 0.18.6.

    Tip

    Pay careful attention to the output of the package manager when adding new packages, especially when you see a package being downgraded.

    diff --git a/previews/PR3913/manual/callbacks/index.html b/previews/PR3913/manual/callbacks/index.html index 237cb35ff6f..f4949132e01 100644 --- a/previews/PR3913/manual/callbacks/index.html +++ b/previews/PR3913/manual/callbacks/index.html @@ -81,4 +81,4 @@ end my_callback_function (generic function with 1 method) -julia> set_attribute(model, MOI.HeuristicCallback(), my_callback_function)

    The third argument to submit is a vector of JuMP variables, and the fourth argument is a vector of values corresponding to each variable.

    MOI.submit returns an enum that depends on whether the solver accepted the solution. The possible return codes are:

    • MOI.HEURISTIC_SOLUTION_ACCEPTED
    • MOI.HEURISTIC_SOLUTION_REJECTED
    • MOI.HEURISTIC_SOLUTION_UNKNOWN
    Warning

    Some solvers may accept partial solutions. Others require a feasible integer solution for every variable. If in doubt, provide a complete solution.

    Info

    The heuristic solution callback may be called at fractional nodes in the branch-and-bound tree. There is no guarantee that the callback is called at every fractional primal solution.

    +julia> set_attribute(model, MOI.HeuristicCallback(), my_callback_function)

    The third argument to submit is a vector of JuMP variables, and the fourth argument is a vector of values corresponding to each variable.

    MOI.submit returns an enum that depends on whether the solver accepted the solution. The possible return codes are:

    • MOI.HEURISTIC_SOLUTION_ACCEPTED
    • MOI.HEURISTIC_SOLUTION_REJECTED
    • MOI.HEURISTIC_SOLUTION_UNKNOWN
    Warning

    Some solvers may accept partial solutions. Others require a feasible integer solution for every variable. If in doubt, provide a complete solution.

    Info

    The heuristic solution callback may be called at fractional nodes in the branch-and-bound tree. There is no guarantee that the callback is called at every fractional primal solution.

    diff --git a/previews/PR3913/manual/complex/index.html b/previews/PR3913/manual/complex/index.html index 533c592ea7c..e63aaf38c67 100644 --- a/previews/PR3913/manual/complex/index.html +++ b/previews/PR3913/manual/complex/index.html @@ -197,4 +197,4 @@ julia> @constraint(model, H in HermitianPSDCone()) [x[1] im - -im -x[2]] ∈ HermitianPSDCone()
    Note

    The matrix H in H in HermitianPSDCone() must be a LinearAlgebra.Hermitian matrix type. A build_constraint error will be thrown if the matrix is a different matrix type.

    + -im -x[2]] ∈ HermitianPSDCone()
    Note

    The matrix H in H in HermitianPSDCone() must be a LinearAlgebra.Hermitian matrix type. A build_constraint error will be thrown if the matrix is a different matrix type.

    diff --git a/previews/PR3913/manual/constraints/index.html b/previews/PR3913/manual/constraints/index.html index 0239c396ddc..706d17d95b9 100644 --- a/previews/PR3913/manual/constraints/index.html +++ b/previews/PR3913/manual/constraints/index.html @@ -801,4 +801,4 @@ (x[1] == x[2]) - 0.0 = 0 julia> @constraint(model, x[1] == x[2] := rhs) -x[1] == x[2] = false +x[1] == x[2] = false diff --git a/previews/PR3913/manual/containers/index.html b/previews/PR3913/manual/containers/index.html index 08aa378c836..5473d7e7419 100644 --- a/previews/PR3913/manual/containers/index.html +++ b/previews/PR3913/manual/containers/index.html @@ -232,4 +232,4 @@ julia> Containers.@container([i = 1:2, j = 1:4; condition(i, j)], i + j) JuMP.Containers.SparseAxisArray{Int64, 2, Tuple{Int64, Int64}} with 2 entries: [1, 2] = 3 - [1, 4] = 5 + [1, 4] = 5 diff --git a/previews/PR3913/manual/expressions/index.html b/previews/PR3913/manual/expressions/index.html index 11ceb1c9737..6c9ee820106 100644 --- a/previews/PR3913/manual/expressions/index.html +++ b/previews/PR3913/manual/expressions/index.html @@ -247,4 +247,4 @@ julia> x 2-element Vector{AffExpr}: 1.1 - 0

    Note that for large expressions this will be slower due to the allocation of additional temporary objects.

    + 0

    Note that for large expressions this will be slower due to the allocation of additional temporary objects.

    diff --git a/previews/PR3913/manual/models/index.html b/previews/PR3913/manual/models/index.html index 5937d24adb2..5da671d8297 100644 --- a/previews/PR3913/manual/models/index.html +++ b/previews/PR3913/manual/models/index.html @@ -313,4 +313,4 @@ If you expected the solver to support your problem, you may have an error in your formulation. Otherwise, consider using a different solver. The list of available solvers, along with the problem types they support, is available at https://jump.dev/JuMP.jl/stable/installation/#Supported-solvers. -Stacktrace:
    Warning

    Another downside of direct mode is that the behavior of querying solution information after modifying the problem is solver-specific. This can lead to errors, or the solver silently returning an incorrect value. See OptimizeNotCalled errors for more information.

    +Stacktrace:
    Warning

    Another downside of direct mode is that the behavior of querying solution information after modifying the problem is solver-specific. This can lead to errors, or the solver silently returning an incorrect value. See OptimizeNotCalled errors for more information.

    diff --git a/previews/PR3913/manual/nlp/index.html b/previews/PR3913/manual/nlp/index.html index a31e25e7e73..4220a723328 100644 --- a/previews/PR3913/manual/nlp/index.html +++ b/previews/PR3913/manual/nlp/index.html @@ -344,4 +344,4 @@ f1(x[1]) - 1.0 ≤ 0 f2(x[1], x[2]) - 1.0 ≤ 0 f3(x[2], x[3], x[4]) - 1.0 ≤ 0 - f4(x[1], x[3], x[4], x[5]) - 1.0 ≤ 0

    Known performance issues

    The macro-based input to JuMP's nonlinear interface can cause a performance issue if you:

    1. write a macro with a large number (hundreds) of terms
    2. call that macro from within a function instead of from the top-level in global scope.

    The first issue does not depend on the number of resulting terms in the mathematical expression, but rather the number of terms in the Julia Expr representation of that expression. For example, the expression sum(x[i] for i in 1:1_000_000) contains one million mathematical terms, but the Expr representation is just a single sum.

    The most common cause, other than a lot of tedious typing, is if you write a program that automatically writes a JuMP model as a text file, which you later execute. One example is MINLPlib.jl which automatically transpiled models in the GAMS scalar format into JuMP examples.

    As a rule of thumb, if you are writing programs to automatically generate expressions for the JuMP macros, you should target the Raw expression input instead. For more information, read MathOptInterface Issue#1997.

    + f4(x[1], x[3], x[4], x[5]) - 1.0 ≤ 0

    Known performance issues

    The macro-based input to JuMP's nonlinear interface can cause a performance issue if you:

    1. write a macro with a large number (hundreds) of terms
    2. call that macro from within a function instead of from the top-level in global scope.

    The first issue does not depend on the number of resulting terms in the mathematical expression, but rather the number of terms in the Julia Expr representation of that expression. For example, the expression sum(x[i] for i in 1:1_000_000) contains one million mathematical terms, but the Expr representation is just a single sum.

    The most common cause, other than a lot of tedious typing, is if you write a program that automatically writes a JuMP model as a text file, which you later execute. One example is MINLPlib.jl which automatically transpiled models in the GAMS scalar format into JuMP examples.

    As a rule of thumb, if you are writing programs to automatically generate expressions for the JuMP macros, you should target the Raw expression input instead. For more information, read MathOptInterface Issue#1997.

    diff --git a/previews/PR3913/manual/nonlinear/index.html b/previews/PR3913/manual/nonlinear/index.html index f714aef15dc..6c85eff1c48 100644 --- a/previews/PR3913/manual/nonlinear/index.html +++ b/previews/PR3913/manual/nonlinear/index.html @@ -319,4 +319,4 @@ julia> ForwardDiff.gradient(x -> my_operator_good(x...), [1.0, 2.0]) 2-element Vector{Float64}: 2.0 - 4.0 + 4.0 diff --git a/previews/PR3913/manual/objective/index.html b/previews/PR3913/manual/objective/index.html index ef811bfc1c7..ca3d239c13f 100644 --- a/previews/PR3913/manual/objective/index.html +++ b/previews/PR3913/manual/objective/index.html @@ -179,4 +179,4 @@ 2 x[1] julia> @constraint(model, obj3 <= 2.0) -x[1] + x[2] ≤ 2 +x[1] + x[2] ≤ 2 diff --git a/previews/PR3913/manual/solutions/index.html b/previews/PR3913/manual/solutions/index.html index 60262d9a8c5..ddef5ffa882 100644 --- a/previews/PR3913/manual/solutions/index.html +++ b/previews/PR3913/manual/solutions/index.html @@ -430,4 +430,4 @@ x integer => 0.1

    You can also use the functional form, where the first argument is a function that maps variables to their primal values:

    julia> optimize!(model)
     
     julia> primal_feasibility_report(v -> value(v), model)
    -Dict{Any, Float64}()
    +Dict{Any, Float64}() diff --git a/previews/PR3913/manual/variables/index.html b/previews/PR3913/manual/variables/index.html index f434204863d..6177b2ed68c 100644 --- a/previews/PR3913/manual/variables/index.html +++ b/previews/PR3913/manual/variables/index.html @@ -639,4 +639,4 @@ p*x julia> typeof(px) -QuadExpr (alias for GenericQuadExpr{Float64, GenericVariableRef{Float64}})

    When to use a parameter

    Parameters are most useful when solving nonlinear models in a sequence:

    julia> using JuMP, Ipopt
    julia> model = Model(Ipopt.Optimizer);
    julia> set_silent(model)
    julia> @variable(model, x)x
    julia> @variable(model, p in Parameter(1.0))p
    julia> @objective(model, Min, (x - p)^2)x² - 2 p*x + p²
    julia> optimize!(model)
    julia> value(x)1.0
    julia> set_parameter_value(p, 5.0)
    julia> optimize!(model)
    julia> value(x)5.0

    Using parameters can be faster than creating a new model from scratch with updated data because JuMP is able to avoid repeating a number of steps in processing the model before handing it off to the solver.

    +QuadExpr (alias for GenericQuadExpr{Float64, GenericVariableRef{Float64}})

    When to use a parameter

    Parameters are most useful when solving nonlinear models in a sequence:

    julia> using JuMP, Ipopt
    julia> model = Model(Ipopt.Optimizer);
    julia> set_silent(model)
    julia> @variable(model, x)x
    julia> @variable(model, p in Parameter(1.0))p
    julia> @objective(model, Min, (x - p)^2)x² - 2 p*x + p²
    julia> optimize!(model)
    julia> value(x)1.0
    julia> set_parameter_value(p, 5.0)
    julia> optimize!(model)
    julia> value(x)5.0

    Using parameters can be faster than creating a new model from scratch with updated data because JuMP is able to avoid repeating a number of steps in processing the model before handing it off to the solver.

    diff --git a/previews/PR3913/moi/background/duality/index.html b/previews/PR3913/moi/background/duality/index.html index ddc8a524cc2..299ea05cd1e 100644 --- a/previews/PR3913/moi/background/duality/index.html +++ b/previews/PR3913/moi/background/duality/index.html @@ -81,4 +81,4 @@ \max & \sum b_k y_k \\ \text{s.t.} \;\; & C+C^\top - \sum (A_k+A_k^\top) y_k \in \mathcal{S}_+ \\ & C-C^\top - \sum(A_k-A_k^\top) y_k = 0 -\end{align}\]

    and we recover $Z = X + X^\top$.

    +\end{align}\]

    and we recover $Z = X + X^\top$.

    diff --git a/previews/PR3913/moi/background/infeasibility_certificates/index.html b/previews/PR3913/moi/background/infeasibility_certificates/index.html index 593a373c112..88020f4a547 100644 --- a/previews/PR3913/moi/background/infeasibility_certificates/index.html +++ b/previews/PR3913/moi/background/infeasibility_certificates/index.html @@ -29,4 +29,4 @@ \end{align}\]

    and:

    \[-\sum_{i=1}^m b_i^\top (y_i + \eta d_i) > -\sum_{i=1}^m b_i^\top y_i,\]

    for any feasible dual solution $y$. The latter simplifies to $-\sum_{i=1}^m b_i^\top d_i > 0$. For a maximization problem, the inequality is $\sum_{i=1}^m b_i^\top d_i < 0$. (Note that these are the same inequality, modulo a - sign.)

    If the solver has found a certificate of primal infeasibility:

    Note

    The choice of whether to scale the ray $d$ to have magnitude 1 is left to the solver.

    Infeasibility certificates of variable bounds

    Many linear solvers (for example, Gurobi) do not provide explicit access to the primal infeasibility certificate of a variable bound. However, given a set of linear constraints:

    \[\begin{align} l_A \le A x \le u_A \\ l_x \le x \le u_x, -\end{align}\]

    the primal certificate of the variable bounds can be computed using the primal certificate associated with the affine constraints, $d$. (Note that $d$ will have one element for each row of the $A$ matrix, and that some or all of the elements in the vectors $l_A$ and $u_A$ may be $\pm \infty$. If both $l_A$ and $u_A$ are finite for some row, the corresponding element in `d must be 0.)

    Given $d$, compute $\bar{d} = d^\top A$. If the bound is finite, a certificate for the lower variable bound of $x_i$ is $\max\{\bar{d}_i, 0\}$, and a certificate for the upper variable bound is $\min\{\bar{d}_i, 0\}$.

    +\end{align}\]

    the primal certificate of the variable bounds can be computed using the primal certificate associated with the affine constraints, $d$. (Note that $d$ will have one element for each row of the $A$ matrix, and that some or all of the elements in the vectors $l_A$ and $u_A$ may be $\pm \infty$. If both $l_A$ and $u_A$ are finite for some row, the corresponding element in `d must be 0.)

    Given $d$, compute $\bar{d} = d^\top A$. If the bound is finite, a certificate for the lower variable bound of $x_i$ is $\max\{\bar{d}_i, 0\}$, and a certificate for the upper variable bound is $\min\{\bar{d}_i, 0\}$.

    diff --git a/previews/PR3913/moi/background/motivation/index.html b/previews/PR3913/moi/background/motivation/index.html index 01b6fcb260b..8842114004b 100644 --- a/previews/PR3913/moi/background/motivation/index.html +++ b/previews/PR3913/moi/background/motivation/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Motivation

    MathOptInterface (MOI) is a replacement for MathProgBase, the first-generation abstraction layer for mathematical optimization previously used by JuMP and Convex.jl.

    To address a number of limitations of MathProgBase, MOI is designed to:

    • Be simple and extensible
      • unifying linear, quadratic, and conic optimization,
      • seamlessly facilitating extensions to essentially arbitrary constraints and functions (for example, indicator constraints, complementarity constraints, and piecewise-linear functions)
    • Be fast
      • by allowing access to a solver's in-memory representation of a problem without writing intermediate files (when possible)
      • by using multiple dispatch and avoiding requiring containers of non-concrete types
    • Allow a solver to return multiple results (for example, a pool of solutions)
    • Allow a solver to return extra arbitrary information via attributes (for example, variable- and constraint-wise membership in an irreducible inconsistent subset for infeasibility analysis)
    • Provide a greatly expanded set of status codes explaining what happened during the optimization procedure
    • Enable a solver to more precisely specify which problem classes it supports
    • Enable both primal and dual warm starts
    • Enable adding and removing both variables and constraints by indices that are not required to be consecutive
    • Enable any modification that the solver supports to an existing model
    • Avoid requiring the solver wrapper to store an additional copy of the problem data
    +

    Motivation

    MathOptInterface (MOI) is a replacement for MathProgBase, the first-generation abstraction layer for mathematical optimization previously used by JuMP and Convex.jl.

    To address a number of limitations of MathProgBase, MOI is designed to:

    • Be simple and extensible
      • unifying linear, quadratic, and conic optimization,
      • seamlessly facilitating extensions to essentially arbitrary constraints and functions (for example, indicator constraints, complementarity constraints, and piecewise-linear functions)
    • Be fast
      • by allowing access to a solver's in-memory representation of a problem without writing intermediate files (when possible)
      • by using multiple dispatch and avoiding requiring containers of non-concrete types
    • Allow a solver to return multiple results (for example, a pool of solutions)
    • Allow a solver to return extra arbitrary information via attributes (for example, variable- and constraint-wise membership in an irreducible inconsistent subset for infeasibility analysis)
    • Provide a greatly expanded set of status codes explaining what happened during the optimization procedure
    • Enable a solver to more precisely specify which problem classes it supports
    • Enable both primal and dual warm starts
    • Enable adding and removing both variables and constraints by indices that are not required to be consecutive
    • Enable any modification that the solver supports to an existing model
    • Avoid requiring the solver wrapper to store an additional copy of the problem data
    diff --git a/previews/PR3913/moi/background/naming_conventions/index.html b/previews/PR3913/moi/background/naming_conventions/index.html index 0c42c419ada..4fff28cfcbe 100644 --- a/previews/PR3913/moi/background/naming_conventions/index.html +++ b/previews/PR3913/moi/background/naming_conventions/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Naming conventions

    MOI follows several conventions for naming functions and structures. These should also be followed by packages extending MOI.

    Sets

    Sets encode the structure of constraints. Their names should follow the following conventions:

    • Abstract types in the set hierarchy should begin with Abstract and end in Set, for example, AbstractScalarSet, AbstractVectorSet.
    • Vector-valued conic sets should end with Cone, for example, NormInfinityCone, SecondOrderCone.
    • Vector-valued Cartesian products should be plural and not end in Cone, for example, Nonnegatives, not NonnegativeCone.
    • Matrix-valued conic sets should provide two representations: ConeSquare and ConeTriangle, for example, RootDetConeTriangle and RootDetConeSquare. See Matrix cones for more details.
    • Scalar sets should be singular, not plural, for example, Integer, not Integers.
    • As much as possible, the names should follow established conventions in the domain where this set is used: for instance, convex sets should have names close to those of CVX, and constraint-programming sets should follow MiniZinc's constraints.
    +

    Naming conventions

    MOI follows several conventions for naming functions and structures. These should also be followed by packages extending MOI.

    Sets

    Sets encode the structure of constraints. Their names should follow the following conventions:

    • Abstract types in the set hierarchy should begin with Abstract and end in Set, for example, AbstractScalarSet, AbstractVectorSet.
    • Vector-valued conic sets should end with Cone, for example, NormInfinityCone, SecondOrderCone.
    • Vector-valued Cartesian products should be plural and not end in Cone, for example, Nonnegatives, not NonnegativeCone.
    • Matrix-valued conic sets should provide two representations: ConeSquare and ConeTriangle, for example, RootDetConeTriangle and RootDetConeSquare. See Matrix cones for more details.
    • Scalar sets should be singular, not plural, for example, Integer, not Integers.
    • As much as possible, the names should follow established conventions in the domain where this set is used: for instance, convex sets should have names close to those of CVX, and constraint-programming sets should follow MiniZinc's constraints.
    diff --git a/previews/PR3913/moi/changelog/index.html b/previews/PR3913/moi/changelog/index.html index 0e4f855c00b..20ac8b5c3b9 100644 --- a/previews/PR3913/moi/changelog/index.html +++ b/previews/PR3913/moi/changelog/index.html @@ -31,4 +31,4 @@ end write(path, s) end -end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    +end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    diff --git a/previews/PR3913/moi/developer/checklists/index.html b/previews/PR3913/moi/developer/checklists/index.html index 682fe06e3c1..bf683784e05 100644 --- a/previews/PR3913/moi/developer/checklists/index.html +++ b/previews/PR3913/moi/developer/checklists/index.html @@ -112,4 +112,4 @@ ## Documentation - - [ ] The version fields are updated in `docs/src/submodules/FileFormats/overview.md` + - [ ] The version fields are updated in `docs/src/submodules/FileFormats/overview.md` diff --git a/previews/PR3913/moi/index.html b/previews/PR3913/moi/index.html index 8908c098dd4..c8bbff241b0 100644 --- a/previews/PR3913/moi/index.html +++ b/previews/PR3913/moi/index.html @@ -10,4 +10,4 @@ year={2021}, doi={10.1287/ijoc.2021.1067}, publisher={INFORMS} -}

    A preprint of this paper is freely available.

    +}

    A preprint of this paper is freely available.

    diff --git a/previews/PR3913/moi/manual/constraints/index.html b/previews/PR3913/moi/manual/constraints/index.html index 74cd014ee4b..9a0487aa79a 100644 --- a/previews/PR3913/moi/manual/constraints/index.html +++ b/previews/PR3913/moi/manual/constraints/index.html @@ -23,4 +23,4 @@ false

    Constraint attributes

    The following attributes are available for constraints:

    Get and set these attributes using get and set.

    julia> MOI.set(model, MOI.ConstraintName(), c, "con_c")
     
     julia> MOI.get(model, MOI.ConstraintName(), c)
    -"con_c"

    Constraints by function-set pairs

    Below is a list of common constraint types and how they are represented as function-set pairs in MOI. In the notation below, $x$ is a vector of decision variables, $x_i$ is a scalar decision variable, $\alpha, \beta$ are scalar constants, $a, b$ are constant vectors, A is a constant matrix and $\mathbb{R}_+$ (resp. $\mathbb{R}_-$) is the set of non-negative (resp. non-positive) real numbers.

    Linear constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $a^Tx \le \beta$ScalarAffineFunctionLessThan
    $a^Tx \ge \alpha$ScalarAffineFunctionGreaterThan
    $a^Tx = \beta$ScalarAffineFunctionEqualTo
    $\alpha \le a^Tx \le \beta$ScalarAffineFunctionInterval
    $x_i \le \beta$VariableIndexLessThan
    $x_i \ge \alpha$VariableIndexGreaterThan
    $x_i = \beta$VariableIndexEqualTo
    $\alpha \le x_i \le \beta$VariableIndexInterval
    $Ax + b \in \mathbb{R}_+^n$VectorAffineFunctionNonnegatives
    $Ax + b \in \mathbb{R}_-^n$VectorAffineFunctionNonpositives
    $Ax + b = 0$VectorAffineFunctionZeros

    By convention, solvers are not expected to support nonzero constant terms in the ScalarAffineFunctions the first four rows of the preceding table because they are redundant with the parameters of the sets. For example, encode $2x + 1 \le 2$ as $2x \le 1$.

    Constraints with VariableIndex in LessThan, GreaterThan, EqualTo, or Interval sets have a natural interpretation as variable bounds. As such, it is typically not natural to impose multiple lower- or upper-bounds on the same variable, and the solver interfaces will throw respectively LowerBoundAlreadySet or UpperBoundAlreadySet.

    Moreover, adding two VariableIndex constraints on the same variable with the same set is impossible because they share the same index as it is the index of the variable, see ConstraintIndex.

    It is natural, however, to impose upper- and lower-bounds separately as two different constraints on a single variable. The difference between imposing bounds by using a single Interval constraint and by using separate LessThan and GreaterThan constraints is that the latter will allow the solver to return separate dual multipliers for the two bounds, while the former will allow the solver to return only a single dual for the interval constraint.

    Conic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\lVert Ax + b\rVert_2 \le c^Tx + d$VectorAffineFunctionSecondOrderCone
    $y \ge \lVert x \rVert_2$VectorOfVariablesSecondOrderCone
    $2yz \ge \lVert x \rVert_2^2, y,z \ge 0$VectorOfVariablesRotatedSecondOrderCone
    $(a_1^Tx + b_1,a_2^Tx + b_2,a_3^Tx + b_3) \in \mathcal{E}$VectorAffineFunctionExponentialCone
    $A(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeTriangle
    $B(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeSquare
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeTriangle
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeSquare

    where $\mathcal{E}$ is the exponential cone (see ExponentialCone), $\mathcal{S}_+$ is the set of positive semidefinite symmetric matrices, $A$ is an affine map that outputs symmetric matrices and $B$ is an affine map that outputs square matrices.

    Quadratic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\frac{1}{2}x^TQx + a^Tx + b \ge 0$ScalarQuadraticFunctionGreaterThan
    $\frac{1}{2}x^TQx + a^Tx + b \le 0$ScalarQuadraticFunctionLessThan
    $\frac{1}{2}x^TQx + a^Tx + b = 0$ScalarQuadraticFunctionEqualTo
    Bilinear matrix inequalityVectorQuadraticFunctionPositiveSemidefiniteCone...
    Note

    For more details on the internal format of the quadratic functions see ScalarQuadraticFunction or VectorQuadraticFunction.

    Discrete and logical constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $x_i \in \mathbb{Z}$VariableIndexInteger
    $x_i \in \{0,1\}$VariableIndexZeroOne
    $x_i \in \{0\} \cup [l,u]$VariableIndexSemicontinuous
    $x_i \in \{0\} \cup \{l,l+1,\ldots,u-1,u\}$VariableIndexSemiinteger
    At most one component of $x$ can be nonzeroVectorOfVariablesSOS1
    At most two components of $x$ can be nonzero, and if so they must be adjacent componentsVectorOfVariablesSOS2
    $y = 1 \implies a^T x \in S$VectorAffineFunctionIndicator

    JuMP mapping

    The following bullet points show examples of how JuMP constraints are translated into MOI function-set pairs:

    • @constraint(m, 2x + y <= 10) becomes ScalarAffineFunction-in-LessThan
    • @constraint(m, 2x + y >= 10) becomes ScalarAffineFunction-in-GreaterThan
    • @constraint(m, 2x + y == 10) becomes ScalarAffineFunction-in-EqualTo
    • @constraint(m, 0 <= 2x + y <= 10) becomes ScalarAffineFunction-in-Interval
    • @constraint(m, 2x + y in ArbitrarySet()) becomes ScalarAffineFunction-in-ArbitrarySet.

    Variable bounds are handled in a similar fashion:

    • @variable(m, x <= 1) becomes VariableIndex-in-LessThan
    • @variable(m, x >= 1) becomes VariableIndex-in-GreaterThan

    One notable difference is that a variable with an upper and lower bound is translated into two constraints, rather than an interval, that is:

    • @variable(m, 0 <= x <= 1) becomes VariableIndex-in-LessThan and VariableIndex-in-GreaterThan.
    +"con_c"

    Constraints by function-set pairs

    Below is a list of common constraint types and how they are represented as function-set pairs in MOI. In the notation below, $x$ is a vector of decision variables, $x_i$ is a scalar decision variable, $\alpha, \beta$ are scalar constants, $a, b$ are constant vectors, A is a constant matrix and $\mathbb{R}_+$ (resp. $\mathbb{R}_-$) is the set of non-negative (resp. non-positive) real numbers.

    Linear constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $a^Tx \le \beta$ScalarAffineFunctionLessThan
    $a^Tx \ge \alpha$ScalarAffineFunctionGreaterThan
    $a^Tx = \beta$ScalarAffineFunctionEqualTo
    $\alpha \le a^Tx \le \beta$ScalarAffineFunctionInterval
    $x_i \le \beta$VariableIndexLessThan
    $x_i \ge \alpha$VariableIndexGreaterThan
    $x_i = \beta$VariableIndexEqualTo
    $\alpha \le x_i \le \beta$VariableIndexInterval
    $Ax + b \in \mathbb{R}_+^n$VectorAffineFunctionNonnegatives
    $Ax + b \in \mathbb{R}_-^n$VectorAffineFunctionNonpositives
    $Ax + b = 0$VectorAffineFunctionZeros

    By convention, solvers are not expected to support nonzero constant terms in the ScalarAffineFunctions the first four rows of the preceding table because they are redundant with the parameters of the sets. For example, encode $2x + 1 \le 2$ as $2x \le 1$.

    Constraints with VariableIndex in LessThan, GreaterThan, EqualTo, or Interval sets have a natural interpretation as variable bounds. As such, it is typically not natural to impose multiple lower- or upper-bounds on the same variable, and the solver interfaces will throw respectively LowerBoundAlreadySet or UpperBoundAlreadySet.

    Moreover, adding two VariableIndex constraints on the same variable with the same set is impossible because they share the same index as it is the index of the variable, see ConstraintIndex.

    It is natural, however, to impose upper- and lower-bounds separately as two different constraints on a single variable. The difference between imposing bounds by using a single Interval constraint and by using separate LessThan and GreaterThan constraints is that the latter will allow the solver to return separate dual multipliers for the two bounds, while the former will allow the solver to return only a single dual for the interval constraint.

    Conic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\lVert Ax + b\rVert_2 \le c^Tx + d$VectorAffineFunctionSecondOrderCone
    $y \ge \lVert x \rVert_2$VectorOfVariablesSecondOrderCone
    $2yz \ge \lVert x \rVert_2^2, y,z \ge 0$VectorOfVariablesRotatedSecondOrderCone
    $(a_1^Tx + b_1,a_2^Tx + b_2,a_3^Tx + b_3) \in \mathcal{E}$VectorAffineFunctionExponentialCone
    $A(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeTriangle
    $B(x) \in \mathcal{S}_+$VectorAffineFunctionPositiveSemidefiniteConeSquare
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeTriangle
    $x \in \mathcal{S}_+$VectorOfVariablesPositiveSemidefiniteConeSquare

    where $\mathcal{E}$ is the exponential cone (see ExponentialCone), $\mathcal{S}_+$ is the set of positive semidefinite symmetric matrices, $A$ is an affine map that outputs symmetric matrices and $B$ is an affine map that outputs square matrices.

    Quadratic constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $\frac{1}{2}x^TQx + a^Tx + b \ge 0$ScalarQuadraticFunctionGreaterThan
    $\frac{1}{2}x^TQx + a^Tx + b \le 0$ScalarQuadraticFunctionLessThan
    $\frac{1}{2}x^TQx + a^Tx + b = 0$ScalarQuadraticFunctionEqualTo
    Bilinear matrix inequalityVectorQuadraticFunctionPositiveSemidefiniteCone...
    Note

    For more details on the internal format of the quadratic functions see ScalarQuadraticFunction or VectorQuadraticFunction.

    Discrete and logical constraints

    Mathematical ConstraintMOI FunctionMOI Set
    $x_i \in \mathbb{Z}$VariableIndexInteger
    $x_i \in \{0,1\}$VariableIndexZeroOne
    $x_i \in \{0\} \cup [l,u]$VariableIndexSemicontinuous
    $x_i \in \{0\} \cup \{l,l+1,\ldots,u-1,u\}$VariableIndexSemiinteger
    At most one component of $x$ can be nonzeroVectorOfVariablesSOS1
    At most two components of $x$ can be nonzero, and if so they must be adjacent componentsVectorOfVariablesSOS2
    $y = 1 \implies a^T x \in S$VectorAffineFunctionIndicator

    JuMP mapping

    The following bullet points show examples of how JuMP constraints are translated into MOI function-set pairs:

    • @constraint(m, 2x + y <= 10) becomes ScalarAffineFunction-in-LessThan
    • @constraint(m, 2x + y >= 10) becomes ScalarAffineFunction-in-GreaterThan
    • @constraint(m, 2x + y == 10) becomes ScalarAffineFunction-in-EqualTo
    • @constraint(m, 0 <= 2x + y <= 10) becomes ScalarAffineFunction-in-Interval
    • @constraint(m, 2x + y in ArbitrarySet()) becomes ScalarAffineFunction-in-ArbitrarySet.

    Variable bounds are handled in a similar fashion:

    • @variable(m, x <= 1) becomes VariableIndex-in-LessThan
    • @variable(m, x >= 1) becomes VariableIndex-in-GreaterThan

    One notable difference is that a variable with an upper and lower bound is translated into two constraints, rather than an interval, that is:

    • @variable(m, 0 <= x <= 1) becomes VariableIndex-in-LessThan and VariableIndex-in-GreaterThan.
    diff --git a/previews/PR3913/moi/manual/models/index.html b/previews/PR3913/moi/manual/models/index.html index b5c46e2505a..17779111354 100644 --- a/previews/PR3913/moi/manual/models/index.html +++ b/previews/PR3913/moi/manual/models/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Models

    The most significant part of MOI is the definition of the model API that is used to specify an instance of an optimization problem (for example, by adding variables and constraints). Objects that implement the model API must inherit from the ModelLike abstract type.

    Notably missing from the model API is the method to solve an optimization problem. ModelLike objects may store an instance (for example, in memory or backed by a file format) without being linked to a particular solver. In addition to the model API, MOI defines AbstractOptimizer and provides methods to solve the model and interact with solutions. See the Solutions section for more details.

    Info

    Throughout the rest of the manual, model is used as a generic ModelLike, and optimizer is used as a generic AbstractOptimizer.

    Tip

    MOI does not export functions, but for brevity we often omit qualifying names with the MOI module. Best practice is to have

    import MathOptInterface as MOI

    and prefix all MOI methods with MOI. in user code. If a name is also available in base Julia, we always explicitly use the module prefix, for example, with MOI.get.

    Attributes

    Attributes are properties of the model that can be queried and modified. These include constants such as the number of variables in a model NumberOfVariables), and properties of variables and constraints such as the name of a variable (VariableName).

    There are four types of attributes:

    Some attributes are values that can be queried by the user but not modified, while other attributes can be modified by the user.

    All interactions with attributes occur through the get and set functions.

    Consult the docstrings of each attribute for information on what it represents.

    ModelLike API

    The following attributes are available:

    AbstractOptimizer API

    The following attributes are available:

    +

    Models

    The most significant part of MOI is the definition of the model API that is used to specify an instance of an optimization problem (for example, by adding variables and constraints). Objects that implement the model API must inherit from the ModelLike abstract type.

    Notably missing from the model API is the method to solve an optimization problem. ModelLike objects may store an instance (for example, in memory or backed by a file format) without being linked to a particular solver. In addition to the model API, MOI defines AbstractOptimizer and provides methods to solve the model and interact with solutions. See the Solutions section for more details.

    Info

    Throughout the rest of the manual, model is used as a generic ModelLike, and optimizer is used as a generic AbstractOptimizer.

    Tip

    MOI does not export functions, but for brevity we often omit qualifying names with the MOI module. Best practice is to have

    import MathOptInterface as MOI

    and prefix all MOI methods with MOI. in user code. If a name is also available in base Julia, we always explicitly use the module prefix, for example, with MOI.get.

    Attributes

    Attributes are properties of the model that can be queried and modified. These include constants such as the number of variables in a model NumberOfVariables), and properties of variables and constraints such as the name of a variable (VariableName).

    There are four types of attributes:

    Some attributes are values that can be queried by the user but not modified, while other attributes can be modified by the user.

    All interactions with attributes occur through the get and set functions.

    Consult the docstrings of each attribute for information on what it represents.

    ModelLike API

    The following attributes are available:

    AbstractOptimizer API

    The following attributes are available:

    diff --git a/previews/PR3913/moi/manual/modification/index.html b/previews/PR3913/moi/manual/modification/index.html index e11acca8e1e..b1ae9121745 100644 --- a/previews/PR3913/moi/manual/modification/index.html +++ b/previews/PR3913/moi/manual/modification/index.html @@ -152,4 +152,4 @@ ); julia> MOI.get(model, MOI.ConstraintFunction(), c) ≈ new_f -true +true diff --git a/previews/PR3913/moi/manual/solutions/index.html b/previews/PR3913/moi/manual/solutions/index.html index 7ba473dbf42..adba89c011e 100644 --- a/previews/PR3913/moi/manual/solutions/index.html +++ b/previews/PR3913/moi/manual/solutions/index.html @@ -36,4 +36,4 @@ end rethrow(err) # Something else went wrong. Rethrow the error end -end +end diff --git a/previews/PR3913/moi/manual/standard_form/index.html b/previews/PR3913/moi/manual/standard_form/index.html index 1d71aec4282..f8fa110730d 100644 --- a/previews/PR3913/moi/manual/standard_form/index.html +++ b/previews/PR3913/moi/manual/standard_form/index.html @@ -7,4 +7,4 @@ & \min_{x \in \mathbb{R}^n} & f_0(x) \\ & \;\;\text{s.t.} & f_i(x) & \in \mathcal{S}_i & i = 1 \ldots m -\end{align}\]

    where:

    • the functions $f_0, f_1, \ldots, f_m$ are specified by AbstractFunction objects
    • the sets $\mathcal{S}_1, \ldots, \mathcal{S}_m$ are specified by AbstractSet objects
    Tip

    For more information on this standard form, read our paper.

    MOI defines some commonly used functions and sets, but the interface is extensible to other sets recognized by the solver.

    Functions

    The function types implemented in MathOptInterface.jl are:

    FunctionDescription
    VariableIndex$x_j$, the projection onto a single coordinate defined by a variable index $j$.
    VectorOfVariablesThe projection onto multiple coordinates (that is, extracting a sub-vector).
    ScalarAffineFunction$a^T x + b$, where $a$ is a vector and $b$ scalar.
    ScalarNonlinearFunction$f(x)$, where $f$ is a nonlinear function.
    VectorAffineFunction$A x + b$, where $A$ is a matrix and $b$ is a vector.
    ScalarQuadraticFunction$\frac{1}{2} x^T Q x + a^T x + b$, where $Q$ is a symmetric matrix, $a$ is a vector, and $b$ is a constant.
    VectorQuadraticFunctionA vector of scalar-valued quadratic functions.
    VectorNonlinearFunction$f(x)$, where $f$ is a vector-valued nonlinear function.

    Extensions for nonlinear programming are present but not yet well documented.

    One-dimensional sets

    The one-dimensional set types implemented in MathOptInterface.jl are:

    SetDescription
    LessThan(u)$(-\infty, u]$
    GreaterThan(l)$[l, \infty)$
    EqualTo(v)$\{v\}$
    Interval(l, u)$[l, u]$
    Integer()$\mathbb{Z}$
    ZeroOne()$\{ 0, 1 \}$
    Semicontinuous(l, u)$\{ 0\} \cup [l, u]$
    Semiinteger(l, u)$\{ 0\} \cup \{l,l+1,\ldots,u-1,u\}$

    Vector cones

    The vector-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    Reals(d)$\mathbb{R}^{d}$
    Zeros(d)$0^{d}$
    Nonnegatives(d)$\{ x \in \mathbb{R}^{d} : x \ge 0 \}$
    Nonpositives(d)$\{ x \in \mathbb{R}^{d} : x \le 0 \}$
    SecondOrderCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \lVert x \rVert_2 \}$
    RotatedSecondOrderCone(d)$\{ (t,u,x) \in \mathbb{R}^{d} : 2tu \ge \lVert x \rVert_2^2, t \ge 0,u \ge 0 \}$
    ExponentialCone()$\{ (x,y,z) \in \mathbb{R}^3 : y \exp (x/y) \le z, y > 0 \}$
    DualExponentialCone()$\{ (u,v,w) \in \mathbb{R}^3 : -u \exp (v/u) \le \exp(1) w, u < 0 \}$
    GeometricMeanCone(d)$\{ (t,x) \in \mathbb{R}^{1+n} : x \ge 0, t \le \sqrt[n]{x_1 x_2 \cdots x_n} \}$ where $n$ is $d - 1$
    PowerCone(α)$\{ (x,y,z) \in \mathbb{R}^3 : x^{\alpha} y^{1-\alpha} \ge |z|, x \ge 0,y \ge 0 \}$
    DualPowerCone(α)$\{ (u,v,w) \in \mathbb{R}^3 : \left(\frac{u}{\alpha}\right)^{\alpha}\left(\frac{v}{1-\alpha}\right)^{1-\alpha} \ge |w|, u,v \ge 0 \}$
    NormOneCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \sum_i \lvert x_i \rvert \}$
    NormInfinityCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \max_i \lvert x_i \rvert \}$
    RelativeEntropyCone(d)$\{ (u, v, w) \in \mathbb{R}^{d} : u \ge \sum_i w_i \log (\frac{w_i}{v_i}), v_i \ge 0, w_i \ge 0 \}$
    HyperRectangle(l, u)$\{x \in \bar{\mathbb{R}}^d: x_i \in [l_i, u_i] \forall i=1,\ldots,d\}$
    NormCone(p, d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \left(\sum\limits_i \lvert x_i \rvert^p\right)^{\frac{1}{p}} \}$

    Matrix cones

    The matrix-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    RootDetConeTriangle(d)$\{ (t,X) \in \mathbb{R}^{1+d(1+d)/2} : t \le \det(X)^{1/d}, X \mbox{ is the upper triangle of a PSD matrix} \}$
    RootDetConeSquare(d)$\{ (t,X) \in \mathbb{R}^{1+d^2} : t \le \det(X)^{1/d}, X \mbox{ is a PSD matrix} \}$
    PositiveSemidefiniteConeTriangle(d)$\{ X \in \mathbb{R}^{d(d+1)/2} : X \mbox{ is the upper triangle of a PSD matrix} \}$
    PositiveSemidefiniteConeSquare(d)$\{ X \in \mathbb{R}^{d^2} : X \mbox{ is a PSD matrix} \}$
    LogDetConeTriangle(d)$\{ (t,u,X) \in \mathbb{R}^{2+d(1+d)/2} : t \le u\log(\det(X/u)), X \mbox{ is the upper triangle of a PSD matrix}, u > 0 \}$
    LogDetConeSquare(d)$\{ (t,u,X) \in \mathbb{R}^{2+d^2} : t \le u \log(\det(X/u)), X \mbox{ is a PSD matrix}, u > 0 \}$
    NormSpectralCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sigma_1(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    NormNuclearCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sum_i \sigma_i(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    HermitianPositiveSemidefiniteConeTriangle(d)The cone of Hermitian positive semidefinite matrices, with
    side_dimension rows and columns.
    Scaled(S)The set S scaled so that Utilities.set_dot corresponds to LinearAlgebra.dot

    Some of these cones can take two forms: XXXConeTriangle and XXXConeSquare.

    In XXXConeTriangle sets, the matrix is assumed to be symmetric, and the elements are provided by a vector, in which the entries of the upper-right triangular part of the matrix are given column by column (or equivalently, the entries of the lower-left triangular part are given row by row).

    In XXXConeSquare sets, the entries of the matrix are given column by column (or equivalently, row by row), and the matrix is constrained to be symmetric. As an example, given a 2-by-2 matrix of variables X and a one-dimensional variable t, we can specify a root-det constraint as [t, X11, X12, X22] ∈ RootDetConeTriangle or [t, X11, X12, X21, X22] ∈ RootDetConeSquare.

    We provide both forms to enable flexibility for solvers who may natively support one or the other. Transformations between XXXConeTriangle and XXXConeSquare are handled by bridges, which removes the chance of conversion mistakes by users or solver developers.

    Multi-dimensional sets with combinatorial structure

    Other sets are vector-valued, with a particular combinatorial structure. Read their docstrings for more information on how to interpret them.

    SetDescription
    SOS1A Special Ordered Set (SOS) of Type I
    SOS2A Special Ordered Set (SOS) of Type II
    IndicatorA set to specify an indicator constraint
    ComplementsA set to specify a mixed complementarity constraint
    AllDifferentThe all_different global constraint
    BinPackingThe bin_packing global constraint
    CircuitThe circuit global constraint
    CountAtLeastThe at_least global constraint
    CountBelongsThe nvalue global constraint
    CountDistinctThe distinct global constraint
    CountGreaterThanThe count_gt global constraint
    CumulativeThe cumulative global constraint
    PathThe path global constraint
    TableThe table global constraint
    +\end{align}\]

    where:

    • the functions $f_0, f_1, \ldots, f_m$ are specified by AbstractFunction objects
    • the sets $\mathcal{S}_1, \ldots, \mathcal{S}_m$ are specified by AbstractSet objects
    Tip

    For more information on this standard form, read our paper.

    MOI defines some commonly used functions and sets, but the interface is extensible to other sets recognized by the solver.

    Functions

    The function types implemented in MathOptInterface.jl are:

    FunctionDescription
    VariableIndex$x_j$, the projection onto a single coordinate defined by a variable index $j$.
    VectorOfVariablesThe projection onto multiple coordinates (that is, extracting a sub-vector).
    ScalarAffineFunction$a^T x + b$, where $a$ is a vector and $b$ scalar.
    ScalarNonlinearFunction$f(x)$, where $f$ is a nonlinear function.
    VectorAffineFunction$A x + b$, where $A$ is a matrix and $b$ is a vector.
    ScalarQuadraticFunction$\frac{1}{2} x^T Q x + a^T x + b$, where $Q$ is a symmetric matrix, $a$ is a vector, and $b$ is a constant.
    VectorQuadraticFunctionA vector of scalar-valued quadratic functions.
    VectorNonlinearFunction$f(x)$, where $f$ is a vector-valued nonlinear function.

    Extensions for nonlinear programming are present but not yet well documented.

    One-dimensional sets

    The one-dimensional set types implemented in MathOptInterface.jl are:

    SetDescription
    LessThan(u)$(-\infty, u]$
    GreaterThan(l)$[l, \infty)$
    EqualTo(v)$\{v\}$
    Interval(l, u)$[l, u]$
    Integer()$\mathbb{Z}$
    ZeroOne()$\{ 0, 1 \}$
    Semicontinuous(l, u)$\{ 0\} \cup [l, u]$
    Semiinteger(l, u)$\{ 0\} \cup \{l,l+1,\ldots,u-1,u\}$

    Vector cones

    The vector-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    Reals(d)$\mathbb{R}^{d}$
    Zeros(d)$0^{d}$
    Nonnegatives(d)$\{ x \in \mathbb{R}^{d} : x \ge 0 \}$
    Nonpositives(d)$\{ x \in \mathbb{R}^{d} : x \le 0 \}$
    SecondOrderCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \lVert x \rVert_2 \}$
    RotatedSecondOrderCone(d)$\{ (t,u,x) \in \mathbb{R}^{d} : 2tu \ge \lVert x \rVert_2^2, t \ge 0,u \ge 0 \}$
    ExponentialCone()$\{ (x,y,z) \in \mathbb{R}^3 : y \exp (x/y) \le z, y > 0 \}$
    DualExponentialCone()$\{ (u,v,w) \in \mathbb{R}^3 : -u \exp (v/u) \le \exp(1) w, u < 0 \}$
    GeometricMeanCone(d)$\{ (t,x) \in \mathbb{R}^{1+n} : x \ge 0, t \le \sqrt[n]{x_1 x_2 \cdots x_n} \}$ where $n$ is $d - 1$
    PowerCone(α)$\{ (x,y,z) \in \mathbb{R}^3 : x^{\alpha} y^{1-\alpha} \ge |z|, x \ge 0,y \ge 0 \}$
    DualPowerCone(α)$\{ (u,v,w) \in \mathbb{R}^3 : \left(\frac{u}{\alpha}\right)^{\alpha}\left(\frac{v}{1-\alpha}\right)^{1-\alpha} \ge |w|, u,v \ge 0 \}$
    NormOneCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \sum_i \lvert x_i \rvert \}$
    NormInfinityCone(d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \max_i \lvert x_i \rvert \}$
    RelativeEntropyCone(d)$\{ (u, v, w) \in \mathbb{R}^{d} : u \ge \sum_i w_i \log (\frac{w_i}{v_i}), v_i \ge 0, w_i \ge 0 \}$
    HyperRectangle(l, u)$\{x \in \bar{\mathbb{R}}^d: x_i \in [l_i, u_i] \forall i=1,\ldots,d\}$
    NormCone(p, d)$\{ (t,x) \in \mathbb{R}^{d} : t \ge \left(\sum\limits_i \lvert x_i \rvert^p\right)^{\frac{1}{p}} \}$

    Matrix cones

    The matrix-valued set types implemented in MathOptInterface.jl are:

    SetDescription
    RootDetConeTriangle(d)$\{ (t,X) \in \mathbb{R}^{1+d(1+d)/2} : t \le \det(X)^{1/d}, X \mbox{ is the upper triangle of a PSD matrix} \}$
    RootDetConeSquare(d)$\{ (t,X) \in \mathbb{R}^{1+d^2} : t \le \det(X)^{1/d}, X \mbox{ is a PSD matrix} \}$
    PositiveSemidefiniteConeTriangle(d)$\{ X \in \mathbb{R}^{d(d+1)/2} : X \mbox{ is the upper triangle of a PSD matrix} \}$
    PositiveSemidefiniteConeSquare(d)$\{ X \in \mathbb{R}^{d^2} : X \mbox{ is a PSD matrix} \}$
    LogDetConeTriangle(d)$\{ (t,u,X) \in \mathbb{R}^{2+d(1+d)/2} : t \le u\log(\det(X/u)), X \mbox{ is the upper triangle of a PSD matrix}, u > 0 \}$
    LogDetConeSquare(d)$\{ (t,u,X) \in \mathbb{R}^{2+d^2} : t \le u \log(\det(X/u)), X \mbox{ is a PSD matrix}, u > 0 \}$
    NormSpectralCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sigma_1(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    NormNuclearCone(r, c)$\{ (t, X) \in \mathbb{R}^{1 + r \times c} : t \ge \sum_i \sigma_i(X), X \mbox{ is a } r\times c\mbox{ matrix} \}$
    HermitianPositiveSemidefiniteConeTriangle(d)The cone of Hermitian positive semidefinite matrices, with
    side_dimension rows and columns.
    Scaled(S)The set S scaled so that Utilities.set_dot corresponds to LinearAlgebra.dot

    Some of these cones can take two forms: XXXConeTriangle and XXXConeSquare.

    In XXXConeTriangle sets, the matrix is assumed to be symmetric, and the elements are provided by a vector, in which the entries of the upper-right triangular part of the matrix are given column by column (or equivalently, the entries of the lower-left triangular part are given row by row).

    In XXXConeSquare sets, the entries of the matrix are given column by column (or equivalently, row by row), and the matrix is constrained to be symmetric. As an example, given a 2-by-2 matrix of variables X and a one-dimensional variable t, we can specify a root-det constraint as [t, X11, X12, X22] ∈ RootDetConeTriangle or [t, X11, X12, X21, X22] ∈ RootDetConeSquare.

    We provide both forms to enable flexibility for solvers who may natively support one or the other. Transformations between XXXConeTriangle and XXXConeSquare are handled by bridges, which removes the chance of conversion mistakes by users or solver developers.

    Multi-dimensional sets with combinatorial structure

    Other sets are vector-valued, with a particular combinatorial structure. Read their docstrings for more information on how to interpret them.

    SetDescription
    SOS1A Special Ordered Set (SOS) of Type I
    SOS2A Special Ordered Set (SOS) of Type II
    IndicatorA set to specify an indicator constraint
    ComplementsA set to specify a mixed complementarity constraint
    AllDifferentThe all_different global constraint
    BinPackingThe bin_packing global constraint
    CircuitThe circuit global constraint
    CountAtLeastThe at_least global constraint
    CountBelongsThe nvalue global constraint
    CountDistinctThe distinct global constraint
    CountGreaterThanThe count_gt global constraint
    CumulativeThe cumulative global constraint
    PathThe path global constraint
    TableThe table global constraint
    diff --git a/previews/PR3913/moi/manual/variables/index.html b/previews/PR3913/moi/manual/variables/index.html index 2e49b87c025..7c90d3bd121 100644 --- a/previews/PR3913/moi/manual/variables/index.html +++ b/previews/PR3913/moi/manual/variables/index.html @@ -14,4 +14,4 @@ false
    Warning

    Not all ModelLike models support deleting variables. A DeleteNotAllowed error is thrown if this is not supported.

    Variable attributes

    The following attributes are available for variables:

    Get and set these attributes using get and set.

    julia> MOI.set(model, MOI.VariableName(), x, "var_x")
     
     julia> MOI.get(model, MOI.VariableName(), x)
    -"var_x"
    +"var_x" diff --git a/previews/PR3913/moi/reference/callbacks/index.html b/previews/PR3913/moi/reference/callbacks/index.html index 5b9f792cc48..7d39b8a3433 100644 --- a/previews/PR3913/moi/reference/callbacks/index.html +++ b/previews/PR3913/moi/reference/callbacks/index.html @@ -33,4 +33,4 @@ MOI.submit(optimizer, MOI.HeuristicSolution(callback_data), x, values) end -endsource
    MathOptInterface.HeuristicSolutionType
    HeuristicSolution(callback_data)

    Heuristically obtained feasible solution. The solution is submitted as variables, values where values[i] gives the value of variables[i], similarly to set. The submit call returns a HeuristicSolutionStatus indicating whether the provided solution was accepted or rejected.

    This can be submitted only from the HeuristicCallback. The field callback_data is a solver-specific callback type that is passed as the argument to the heuristic callback.

    Some solvers require a complete solution, others only partial solutions.

    source
    +endsource
    MathOptInterface.HeuristicSolutionType
    HeuristicSolution(callback_data)

    Heuristically obtained feasible solution. The solution is submitted as variables, values where values[i] gives the value of variables[i], similarly to set. The submit call returns a HeuristicSolutionStatus indicating whether the provided solution was accepted or rejected.

    This can be submitted only from the HeuristicCallback. The field callback_data is a solver-specific callback type that is passed as the argument to the heuristic callback.

    Some solvers require a complete solution, others only partial solutions.

    source
    diff --git a/previews/PR3913/moi/reference/constraints/index.html b/previews/PR3913/moi/reference/constraints/index.html index 95784400b42..61969a7a652 100644 --- a/previews/PR3913/moi/reference/constraints/index.html +++ b/previews/PR3913/moi/reference/constraints/index.html @@ -44,4 +44,4 @@ model::ModelLike, ::Type{F}, ::Type{S}, -)::Bool where {F<:AbstractFunction,S<:AbstractSet}

    Return a Bool indicating whether model supports F-in-S constraints, that is, copy_to(model, src) does not throw UnsupportedConstraint when src contains F-in-S constraints. If F-in-S constraints are only not supported in specific circumstances, for example, F-in-S constraints cannot be combined with another type of constraint, it should still return true.

    source

    Attributes

    MathOptInterface.ConstraintNameType
    ConstraintName()

    A constraint attribute for a string identifying the constraint.

    It is valid for constraints variables to have the same name; however, constraints with duplicate names cannot be looked up using get, regardless of whether they have the same F-in-S type.

    ConstraintName has a default value of "" if not set.

    Notes

    You should not implement ConstraintName for VariableIndex constraints.

    source
    MathOptInterface.ConstraintPrimalType
    ConstraintPrimal(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's primal value in result result_index.

    If the constraint is f(x) in S, then in most cases the ConstraintPrimal is the value of f, evaluated at the corresponding VariablePrimal solution.

    However, some conic solvers reformulate b - Ax in S to s = b - Ax, s in S. These solvers may return the value of s for ConstraintPrimal, rather than b - Ax. (Although these are constrained by an equality constraint, due to numerical tolerances they may not be identical.)

    If the solver does not have a primal value for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintPrimal attribute.

    If result_index is omitted, it is 1 by default. See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintDualType
    ConstraintDual(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's dual value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a dual value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the ConstraintDual attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintBasisStatusType
    ConstraintBasisStatus(result_index::Int = 1)

    A constraint attribute for the BasisStatusCode of some constraint in result result_index, with respect to an available optimal solution basis. If result_index is omitted, it is 1 by default.

    If the solver does not have a basis status for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    Notes

    For the basis status of a variable, query VariableBasisStatus.

    ConstraintBasisStatus does not apply to VariableIndex constraints. You can infer the basis status of a VariableIndex constraint by looking at the result of VariableBasisStatus.

    source
    MathOptInterface.ConstraintFunctionType
    ConstraintFunction()

    A constraint attribute for the AbstractFunction object used to define the constraint.

    It is guaranteed to be equivalent but not necessarily identical to the function provided by the user.

    source
    MathOptInterface.CanonicalConstraintFunctionType
    CanonicalConstraintFunction()

    A constraint attribute for a canonical representation of the AbstractFunction object used to define the constraint.

    Getting this attribute is guaranteed to return a function that is equivalent but not necessarily identical to the function provided by the user.

    By default, MOI.get(model, MOI.CanonicalConstraintFunction(), ci) fallbacks to MOI.Utilities.canonical(MOI.get(model, MOI.ConstraintFunction(), ci)). However, if model knows that the constraint function is canonical then it can implement a specialized method that directly return the function without calling Utilities.canonical. Therefore, the value returned cannot be assumed to be a copy of the function stored in model. Moreover, Utilities.Model checks with Utilities.is_canonical whether the function stored internally is already canonical and if it's the case, then it returns the function stored internally instead of a copy.

    source
    MathOptInterface.BasisStatusCodeType
    BasisStatusCode

    An Enum of possible values for the ConstraintBasisStatus and VariableBasisStatus attributes, explaining the status of a given element with respect to an optimal solution basis.

    Notes

    • NONBASIC_AT_LOWER and NONBASIC_AT_UPPER should be used only for constraints with the Interval set. In this case, they are necessary to distinguish which side of the constraint is active. One-sided constraints (for example, LessThan and GreaterThan) should use NONBASIC instead of the NONBASIC_AT_* values. This restriction does not apply to VariableBasisStatus, which should return NONBASIC_AT_* regardless of whether the alternative bound exists.

    • In linear programs, SUPER_BASIC occurs when a variable with no bounds is not in the basis.

    Values

    Possible values are:

    source
    +)::Bool where {F<:AbstractFunction,S<:AbstractSet}

    Return a Bool indicating whether model supports F-in-S constraints, that is, copy_to(model, src) does not throw UnsupportedConstraint when src contains F-in-S constraints. If F-in-S constraints are only not supported in specific circumstances, for example, F-in-S constraints cannot be combined with another type of constraint, it should still return true.

    source

    Attributes

    MathOptInterface.ConstraintNameType
    ConstraintName()

    A constraint attribute for a string identifying the constraint.

    It is valid for constraints variables to have the same name; however, constraints with duplicate names cannot be looked up using get, regardless of whether they have the same F-in-S type.

    ConstraintName has a default value of "" if not set.

    Notes

    You should not implement ConstraintName for VariableIndex constraints.

    source
    MathOptInterface.ConstraintPrimalType
    ConstraintPrimal(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's primal value in result result_index.

    If the constraint is f(x) in S, then in most cases the ConstraintPrimal is the value of f, evaluated at the corresponding VariablePrimal solution.

    However, some conic solvers reformulate b - Ax in S to s = b - Ax, s in S. These solvers may return the value of s for ConstraintPrimal, rather than b - Ax. (Although these are constrained by an equality constraint, due to numerical tolerances they may not be identical.)

    If the solver does not have a primal value for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintPrimal attribute.

    If result_index is omitted, it is 1 by default. See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintDualType
    ConstraintDual(result_index::Int = 1)

    A constraint attribute for the assignment to some constraint's dual value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a dual value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the ConstraintDual attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.ConstraintBasisStatusType
    ConstraintBasisStatus(result_index::Int = 1)

    A constraint attribute for the BasisStatusCode of some constraint in result result_index, with respect to an available optimal solution basis. If result_index is omitted, it is 1 by default.

    If the solver does not have a basis status for the constraint because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ConstraintBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    Notes

    For the basis status of a variable, query VariableBasisStatus.

    ConstraintBasisStatus does not apply to VariableIndex constraints. You can infer the basis status of a VariableIndex constraint by looking at the result of VariableBasisStatus.

    source
    MathOptInterface.ConstraintFunctionType
    ConstraintFunction()

    A constraint attribute for the AbstractFunction object used to define the constraint.

    It is guaranteed to be equivalent but not necessarily identical to the function provided by the user.

    source
    MathOptInterface.CanonicalConstraintFunctionType
    CanonicalConstraintFunction()

    A constraint attribute for a canonical representation of the AbstractFunction object used to define the constraint.

    Getting this attribute is guaranteed to return a function that is equivalent but not necessarily identical to the function provided by the user.

    By default, MOI.get(model, MOI.CanonicalConstraintFunction(), ci) fallbacks to MOI.Utilities.canonical(MOI.get(model, MOI.ConstraintFunction(), ci)). However, if model knows that the constraint function is canonical then it can implement a specialized method that directly return the function without calling Utilities.canonical. Therefore, the value returned cannot be assumed to be a copy of the function stored in model. Moreover, Utilities.Model checks with Utilities.is_canonical whether the function stored internally is already canonical and if it's the case, then it returns the function stored internally instead of a copy.

    source
    MathOptInterface.BasisStatusCodeType
    BasisStatusCode

    An Enum of possible values for the ConstraintBasisStatus and VariableBasisStatus attributes, explaining the status of a given element with respect to an optimal solution basis.

    Notes

    • NONBASIC_AT_LOWER and NONBASIC_AT_UPPER should be used only for constraints with the Interval set. In this case, they are necessary to distinguish which side of the constraint is active. One-sided constraints (for example, LessThan and GreaterThan) should use NONBASIC instead of the NONBASIC_AT_* values. This restriction does not apply to VariableBasisStatus, which should return NONBASIC_AT_* regardless of whether the alternative bound exists.

    • In linear programs, SUPER_BASIC occurs when a variable with no bounds is not in the basis.

    Values

    Possible values are:

    source
    diff --git a/previews/PR3913/moi/reference/errors/index.html b/previews/PR3913/moi/reference/errors/index.html index 7f0824b3b3d..607ab7e78fd 100644 --- a/previews/PR3913/moi/reference/errors/index.html +++ b/previews/PR3913/moi/reference/errors/index.html @@ -57,4 +57,4 @@ julia> throw(MOI.UnsupportedNonlinearOperator(:black_box)) ERROR: MathOptInterface.UnsupportedNonlinearOperator: The nonlinear operator `:black_box` is not supported by the model. Stacktrace: -[...]source

    Note that setting the ConstraintFunction of a VariableIndex constraint is not allowed:

    +[...]source

    Note that setting the ConstraintFunction of a VariableIndex constraint is not allowed:

    diff --git a/previews/PR3913/moi/reference/models/index.html b/previews/PR3913/moi/reference/models/index.html index f9d95c14b9f..aec809f9baf 100644 --- a/previews/PR3913/moi/reference/models/index.html +++ b/previews/PR3913/moi/reference/models/index.html @@ -7,7 +7,7 @@ model::MOI.ModelLike, attr::MOI.AbstractConstraintAttribute, bridge::AbstractBridge, -)

    Return the value of the attribute attr of the model model for the constraint bridged by bridge.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractOptimizerAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractModelAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(optimizer::AbstractOptimizer, attr::AbstractOptimizerAttribute)

    Return an attribute attr of the optimizer optimizer.

    get(model::ModelLike, attr::AbstractModelAttribute)

    Return an attribute attr of the model model.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::VariableIndex)

    If the attribute attr is set for the variable v in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::Vector{VariableIndex})

    Return a vector of attributes corresponding to each variable in the collection v in the model model.

    get(model::ModelLike, attr::AbstractConstraintAttribute, c::ConstraintIndex)

    If the attribute attr is set for the constraint c in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(
    +)

    Return the value of the attribute attr of the model model for the constraint bridged by bridge.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractOptimizerAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(model::GenericModel, attr::MathOptInterface.AbstractModelAttribute)

    Return the value of the attribute attr from the model's MOI backend.

    source
    get(optimizer::AbstractOptimizer, attr::AbstractOptimizerAttribute)

    Return an attribute attr of the optimizer optimizer.

    get(model::ModelLike, attr::AbstractModelAttribute)

    Return an attribute attr of the model model.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::VariableIndex)

    If the attribute attr is set for the variable v in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(model::ModelLike, attr::AbstractVariableAttribute, v::Vector{VariableIndex})

    Return a vector of attributes corresponding to each variable in the collection v in the model model.

    get(model::ModelLike, attr::AbstractConstraintAttribute, c::ConstraintIndex)

    If the attribute attr is set for the constraint c in the model model, return its value, return nothing otherwise. If the attribute attr is not supported by model then an error should be thrown instead of returning nothing.

    get(
         model::ModelLike,
         attr::AbstractConstraintAttribute,
         c::Vector{ConstraintIndex{F,S}},
    @@ -139,4 +139,4 @@
     MOI.get(model, MOI.RelativeGapTolerance())  # returns 1e-3
     # ... and the relative gap of the obtained solution is smaller or equal to the
     # tolerance
    -MOI.get(model, MOI.RelativeGap())  # should return something ≤ 1e-3
    Warning

    The mathematical definition of "relative gap", and its allowed range, are solver-dependent. Typically, solvers expect a value between 0.0 and 1.0.

    source

    List of attributes useful for optimizers

    MathOptInterface.TerminationStatusCodeType
    TerminationStatusCode

    An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

    Values

    Possible values are:

    • OPTIMIZE_NOT_CALLED: The algorithm has not started.
    • OPTIMAL: The algorithm found a globally optimal solution.
    • INFEASIBLE: The algorithm concluded that no feasible solution exists.
    • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
    • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
    • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
    • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
    • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
    • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
    • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
    • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
    • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
    • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
    • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
    • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
    • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
    • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
    • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
    • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
    • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
    • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
    • INVALID_MODEL: The algorithm stopped because the model is invalid.
    • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
    • INTERRUPTED: The algorithm stopped because of an interrupt signal.
    • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
    source
    MathOptInterface.DUAL_INFEASIBLEConstant
    DUAL_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

    source
    MathOptInterface.LOCALLY_SOLVEDConstant
    LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

    source
    MathOptInterface.LOCALLY_INFEASIBLEConstant
    LOCALLY_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

    source
    MathOptInterface.SOLUTION_LIMITConstant
    SOLUTION_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

    source
    MathOptInterface.DualStatusType
    DualStatus(result_index::Int = 1)

    A model attribute for the ResultStatusCode of the dual result result_index. If result_index is omitted, it defaults to 1.

    See ResultCount for information on how the results are ordered.

    If result_index is larger than the value of ResultCount then NO_SOLUTION is returned.

    source
    MathOptInterface.ResultCountType
    ResultCount()

    A model attribute for the number of results available.

    Order of solutions

    A number of attributes contain an index, result_index, which is used to refer to one of the available results. Thus, result_index must be an integer between 1 and the number of available results.

    As a general rule, the first result (result_index=1) is the most important result (for example, an optimal solution or an infeasibility certificate). Other results will typically be alternate solutions that the solver found during the search for the first result.

    If a (local) optimal solution is available, that is, TerminationStatus is OPTIMAL or LOCALLY_SOLVED, the first result must correspond to the (locally) optimal solution. Other results may be alternative optimal solutions, or they may be other suboptimal solutions; use ObjectiveValue to distinguish between them.

    If a primal or dual infeasibility certificate is available, that is, TerminationStatus is INFEASIBLE or DUAL_INFEASIBLE and the corresponding PrimalStatus or DualStatus is INFEASIBILITY_CERTIFICATE, then the first result must be a certificate. Other results may be alternate certificates, or infeasible points.

    source
    MathOptInterface.ObjectiveValueType
    ObjectiveValue(result_index::Int = 1)

    A model attribute for the objective value of the primal solution result_index.

    If the solver does not have a primal value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.DualObjectiveValueType
    DualObjectiveValue(result_index::Int = 1)

    A model attribute for the value of the objective function of the dual problem for the result_indexth dual result.

    If the solver does not have a dual value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the DualObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.RelativeGapType
    RelativeGap()

    A model attribute for the final relative optimality gap.

    Warning

    The definition of this gap is solver-dependent. However, most solvers implementing this attribute define the relative gap as some variation of $\frac{|b-f|}{|f|}$, where $b$ is the best bound and $f$ is the best feasible objective value.

    source
    MathOptInterface.SimplexIterationsType
    SimplexIterations()

    A model attribute for the cumulative number of simplex iterations during the optimization process.

    For a mixed-integer program (MIP), the return value is the total simplex iterations for all nodes.

    source
    MathOptInterface.NodeCountType
    NodeCount()

    A model attribute for the total number of branch-and-bound nodes explored while solving a mixed-integer program (MIP).

    source

    ResultStatusCode

    MathOptInterface.ResultStatusCodeType
    ResultStatusCode

    An Enum of possible values for the PrimalStatus and DualStatus attributes.

    The values indicate how to interpret the result vector.

    Values

    Possible values are:

    • NO_SOLUTION: the result vector is empty.
    • FEASIBLE_POINT: the result vector is a feasible point.
    • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
    • INFEASIBLE_POINT: the result vector is an infeasible point.
    • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
    • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
    • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
    • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
    • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
    • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
    source
    MathOptInterface.INFEASIBILITY_CERTIFICATEConstant
    INFEASIBILITY_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

    source
    MathOptInterface.REDUCTION_CERTIFICATEConstant
    REDUCTION_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

    source

    Conflict Status

    MathOptInterface.compute_conflict!Function
    compute_conflict!(optimizer::AbstractOptimizer)

    Computes a minimal subset of constraints such that the model with the other constraint removed is still infeasible.

    Some solvers call a set of conflicting constraints an Irreducible Inconsistent Subsystem (IIS).

    See also ConflictStatus and ConstraintConflictStatus.

    Note

    If the model is modified after a call to compute_conflict!, the implementor is not obliged to purge the conflict. Any calls to the above attributes may return values for the original conflict without a warning. Similarly, when modifying the model, the conflict can be discarded.

    source
    MathOptInterface.ConflictStatusCodeType
    ConflictStatusCode

    An Enum of possible values for the ConflictStatus attribute. This attribute is meant to explain the reason why the conflict finder stopped executing in the most recent call to compute_conflict!.

    Possible values are:

    • COMPUTE_CONFLICT_NOT_CALLED: the function compute_conflict! has not yet been called
    • NO_CONFLICT_EXISTS: there is no conflict because the problem is feasible
    • NO_CONFLICT_FOUND: the solver could not find a conflict
    • CONFLICT_FOUND: at least one conflict could be found
    source
    MathOptInterface.ConflictParticipationStatusCodeType
    ConflictParticipationStatusCode

    An Enum of possible values for the ConstraintConflictStatus attribute. This attribute is meant to indicate whether a given constraint participates or not in the last computed conflict.

    Values

    Possible values are:

    • NOT_IN_CONFLICT: the constraint does not participate in the conflict
    • IN_CONFLICT: the constraint participates in the conflict
    • MAYBE_IN_CONFLICT: the constraint may participate in the conflict, the solver was not able to prove that the constraint can be excluded from the conflict
    source
    +MOI.get(model, MOI.RelativeGap()) # should return something ≤ 1e-3
    Warning

    The mathematical definition of "relative gap", and its allowed range, are solver-dependent. Typically, solvers expect a value between 0.0 and 1.0.

    source

    List of attributes useful for optimizers

    MathOptInterface.TerminationStatusCodeType
    TerminationStatusCode

    An Enum of possible values for the TerminationStatus attribute. This attribute is meant to explain the reason why the optimizer stopped executing in the most recent call to optimize!.

    Values

    Possible values are:

    • OPTIMIZE_NOT_CALLED: The algorithm has not started.
    • OPTIMAL: The algorithm found a globally optimal solution.
    • INFEASIBLE: The algorithm concluded that no feasible solution exists.
    • DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.
    • LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.
    • LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.
    • INFEASIBLE_OR_UNBOUNDED: The algorithm stopped because it decided that the problem is infeasible or unbounded; this occasionally happens during MIP presolve.
    • ALMOST_OPTIMAL: The algorithm found a globally optimal solution to relaxed tolerances.
    • ALMOST_INFEASIBLE: The algorithm concluded that no feasible solution exists within relaxed tolerances.
    • ALMOST_DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem within relaxed tolerances.
    • ALMOST_LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, or could not find directions for improvement within relaxed tolerances.
    • ITERATION_LIMIT: An iterative algorithm stopped after conducting the maximum number of iterations.
    • TIME_LIMIT: The algorithm stopped after a user-specified computation time.
    • NODE_LIMIT: A branch-and-bound algorithm stopped because it explored a maximum number of nodes in the branch-and-bound tree.
    • SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.
    • MEMORY_LIMIT: The algorithm stopped because it ran out of memory.
    • OBJECTIVE_LIMIT: The algorithm stopped because it found a solution better than a minimum limit set by the user.
    • NORM_LIMIT: The algorithm stopped because the norm of an iterate became too large.
    • OTHER_LIMIT: The algorithm stopped due to a limit not covered by one of the _LIMIT_ statuses above.
    • SLOW_PROGRESS: The algorithm stopped because it was unable to continue making progress towards the solution.
    • NUMERICAL_ERROR: The algorithm stopped because it encountered unrecoverable numerical error.
    • INVALID_MODEL: The algorithm stopped because the model is invalid.
    • INVALID_OPTION: The algorithm stopped because it was provided an invalid option.
    • INTERRUPTED: The algorithm stopped because of an interrupt signal.
    • OTHER_ERROR: The algorithm stopped because of an error not covered by one of the statuses defined above.
    source
    MathOptInterface.DUAL_INFEASIBLEConstant
    DUAL_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    DUAL_INFEASIBLE: The algorithm concluded that no dual bound exists for the problem. If, additionally, a feasible (primal) solution is known to exist, this status typically implies that the problem is unbounded, with some technical exceptions.

    source
    MathOptInterface.LOCALLY_SOLVEDConstant
    LOCALLY_SOLVED::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_SOLVED: The algorithm converged to a stationary point, local optimal solution, could not find directions for improvement, or otherwise completed its search without global guarantees.

    source
    MathOptInterface.LOCALLY_INFEASIBLEConstant
    LOCALLY_INFEASIBLE::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    LOCALLY_INFEASIBLE: The algorithm converged to an infeasible point or otherwise completed its search without finding a feasible solution, without guarantees that no feasible solution exists.

    source
    MathOptInterface.SOLUTION_LIMITConstant
    SOLUTION_LIMIT::TerminationStatusCode

    An instance of the TerminationStatusCode enum.

    SOLUTION_LIMIT: The algorithm stopped because it found the required number of solutions. This is often used in MIPs to get the solver to return the first feasible solution it encounters.

    source
    MathOptInterface.DualStatusType
    DualStatus(result_index::Int = 1)

    A model attribute for the ResultStatusCode of the dual result result_index. If result_index is omitted, it defaults to 1.

    See ResultCount for information on how the results are ordered.

    If result_index is larger than the value of ResultCount then NO_SOLUTION is returned.

    source
    MathOptInterface.ResultCountType
    ResultCount()

    A model attribute for the number of results available.

    Order of solutions

    A number of attributes contain an index, result_index, which is used to refer to one of the available results. Thus, result_index must be an integer between 1 and the number of available results.

    As a general rule, the first result (result_index=1) is the most important result (for example, an optimal solution or an infeasibility certificate). Other results will typically be alternate solutions that the solver found during the search for the first result.

    If a (local) optimal solution is available, that is, TerminationStatus is OPTIMAL or LOCALLY_SOLVED, the first result must correspond to the (locally) optimal solution. Other results may be alternative optimal solutions, or they may be other suboptimal solutions; use ObjectiveValue to distinguish between them.

    If a primal or dual infeasibility certificate is available, that is, TerminationStatus is INFEASIBLE or DUAL_INFEASIBLE and the corresponding PrimalStatus or DualStatus is INFEASIBILITY_CERTIFICATE, then the first result must be a certificate. Other results may be alternate certificates, or infeasible points.

    source
    MathOptInterface.ObjectiveValueType
    ObjectiveValue(result_index::Int = 1)

    A model attribute for the objective value of the primal solution result_index.

    If the solver does not have a primal value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the ObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.DualObjectiveValueType
    DualObjectiveValue(result_index::Int = 1)

    A model attribute for the value of the objective function of the dual problem for the result_indexth dual result.

    If the solver does not have a dual value for the objective because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a primal solution is available), the result is undefined. Users should first check DualStatus before accessing the DualObjectiveValue attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.RelativeGapType
    RelativeGap()

    A model attribute for the final relative optimality gap.

    Warning

    The definition of this gap is solver-dependent. However, most solvers implementing this attribute define the relative gap as some variation of $\frac{|b-f|}{|f|}$, where $b$ is the best bound and $f$ is the best feasible objective value.

    source
    MathOptInterface.SimplexIterationsType
    SimplexIterations()

    A model attribute for the cumulative number of simplex iterations during the optimization process.

    For a mixed-integer program (MIP), the return value is the total simplex iterations for all nodes.

    source
    MathOptInterface.NodeCountType
    NodeCount()

    A model attribute for the total number of branch-and-bound nodes explored while solving a mixed-integer program (MIP).

    source

    ResultStatusCode

    MathOptInterface.ResultStatusCodeType
    ResultStatusCode

    An Enum of possible values for the PrimalStatus and DualStatus attributes.

    The values indicate how to interpret the result vector.

    Values

    Possible values are:

    • NO_SOLUTION: the result vector is empty.
    • FEASIBLE_POINT: the result vector is a feasible point.
    • NEARLY_FEASIBLE_POINT: the result vector is feasible if some constraint tolerances are relaxed.
    • INFEASIBLE_POINT: the result vector is an infeasible point.
    • INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.
    • NEARLY_INFEASIBILITY_CERTIFICATE: the result satisfies a relaxed criterion for a certificate of infeasibility.
    • REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.
    • NEARLY_REDUCTION_CERTIFICATE: the result satisfies a relaxed criterion for an ill-posed certificate.
    • UNKNOWN_RESULT_STATUS: the result vector contains a solution with an unknown interpretation.
    • OTHER_RESULT_STATUS: the result vector contains a solution with an interpretation not covered by one of the statuses defined above
    source
    MathOptInterface.INFEASIBILITY_CERTIFICATEConstant
    INFEASIBILITY_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    INFEASIBILITY_CERTIFICATE: the result vector is an infeasibility certificate. If the PrimalStatus is INFEASIBILITY_CERTIFICATE, then the primal result vector is a certificate of dual infeasibility. If the DualStatus is INFEASIBILITY_CERTIFICATE, then the dual result vector is a proof of primal infeasibility.

    source
    MathOptInterface.REDUCTION_CERTIFICATEConstant
    REDUCTION_CERTIFICATE::ResultStatusCode

    An instance of the ResultStatusCode enum.

    REDUCTION_CERTIFICATE: the result vector is an ill-posed certificate; see this article for details. If the PrimalStatus is REDUCTION_CERTIFICATE, then the primal result vector is a proof that the dual problem is ill-posed. If the DualStatus is REDUCTION_CERTIFICATE, then the dual result vector is a proof that the primal is ill-posed.

    source

    Conflict Status

    MathOptInterface.compute_conflict!Function
    compute_conflict!(optimizer::AbstractOptimizer)

    Computes a minimal subset of constraints such that the model with the other constraint removed is still infeasible.

    Some solvers call a set of conflicting constraints an Irreducible Inconsistent Subsystem (IIS).

    See also ConflictStatus and ConstraintConflictStatus.

    Note

    If the model is modified after a call to compute_conflict!, the implementor is not obliged to purge the conflict. Any calls to the above attributes may return values for the original conflict without a warning. Similarly, when modifying the model, the conflict can be discarded.

    source
    MathOptInterface.ConflictStatusCodeType
    ConflictStatusCode

    An Enum of possible values for the ConflictStatus attribute. This attribute is meant to explain the reason why the conflict finder stopped executing in the most recent call to compute_conflict!.

    Possible values are:

    • COMPUTE_CONFLICT_NOT_CALLED: the function compute_conflict! has not yet been called
    • NO_CONFLICT_EXISTS: there is no conflict because the problem is feasible
    • NO_CONFLICT_FOUND: the solver could not find a conflict
    • CONFLICT_FOUND: at least one conflict could be found
    source
    MathOptInterface.ConflictParticipationStatusCodeType
    ConflictParticipationStatusCode

    An Enum of possible values for the ConstraintConflictStatus attribute. This attribute is meant to indicate whether a given constraint participates or not in the last computed conflict.

    Values

    Possible values are:

    • NOT_IN_CONFLICT: the constraint does not participate in the conflict
    • IN_CONFLICT: the constraint participates in the conflict
    • MAYBE_IN_CONFLICT: the constraint may participate in the conflict, the solver was not able to prove that the constraint can be excluded from the conflict
    source
    diff --git a/previews/PR3913/moi/reference/modification/index.html b/previews/PR3913/moi/reference/modification/index.html index 433acb07c3d..9ad0b155751 100644 --- a/previews/PR3913/moi/reference/modification/index.html +++ b/previews/PR3913/moi/reference/modification/index.html @@ -97,4 +97,4 @@ )

    A struct used to request a change in the quadratic coefficient of a ScalarQuadraticFunction.

    Scaling factors

    A ScalarQuadraticFunction has an implicit 0.5 scaling factor in front of the Q matrix. This modification applies to terms in the Q matrix.

    If variable_1 == variable_2, this modification sets the corresponding diagonal element of the Q matrix to new_coefficient.

    If variable_1 != variable_2, this modification is equivalent to setting both the corresponding upper- and lower-triangular elements of the Q matrix to new_coefficient.

    As a consequence:

    • to modify the term x^2 to become 2x^2, new_coefficient must be 4
    • to modify the term xy to become 2xy, new_coefficient must be 2
    source +) where {T}

    A struct used to request a change in the linear coefficients of a single variable in a vector-valued function.

    New coefficients are specified by (output_index, coefficient) tuples.

    Applicable to VectorAffineFunction and VectorQuadraticFunction.

    source diff --git a/previews/PR3913/moi/reference/nonlinear/index.html b/previews/PR3913/moi/reference/nonlinear/index.html index 03bcc057dcf..9ef9ec21b21 100644 --- a/previews/PR3913/moi/reference/nonlinear/index.html +++ b/previews/PR3913/moi/reference/nonlinear/index.html @@ -425,4 +425,4 @@ :(x[MOI.VariableIndex(1)] * x[MOI.VariableIndex(2)] * x[MOI.VariableIndex(3)] * x[MOI.VariableIndex(4)] >= 25.0) julia> MOI.constraint_expr(evaluator, 2) -:(x[MOI.VariableIndex(1)] ^ 2 + x[MOI.VariableIndex(2)] ^ 2 + x[MOI.VariableIndex(3)] ^ 2 + x[MOI.VariableIndex(4)] ^ 2 == 40.0)source +:(x[MOI.VariableIndex(1)] ^ 2 + x[MOI.VariableIndex(2)] ^ 2 + x[MOI.VariableIndex(3)] ^ 2 + x[MOI.VariableIndex(4)] ^ 2 == 40.0)source diff --git a/previews/PR3913/moi/reference/standard_form/index.html b/previews/PR3913/moi/reference/standard_form/index.html index e44d6576b3a..425e1c000ad 100644 --- a/previews/PR3913/moi/reference/standard_form/index.html +++ b/previews/PR3913/moi/reference/standard_form/index.html @@ -944,4 +944,4 @@ MOI.VectorOfVariables([t; vec(X)]), MOI.RootDetConeSquare(2), ) -MathOptInterface.ConstraintIndex{MathOptInterface.VectorOfVariables, MathOptInterface.RootDetConeSquare}(1)source +MathOptInterface.ConstraintIndex{MathOptInterface.VectorOfVariables, MathOptInterface.RootDetConeSquare}(1)source diff --git a/previews/PR3913/moi/reference/variables/index.html b/previews/PR3913/moi/reference/variables/index.html index 1c9c10098f1..73ccbe85055 100644 --- a/previews/PR3913/moi/reference/variables/index.html +++ b/previews/PR3913/moi/reference/variables/index.html @@ -63,4 +63,4 @@ )::Bool

    Return a Bool indicating whether model supports constraining a variable to belong to a set of type S either on creation of the variable with add_constrained_variable or after the variable is created with add_constraint.

    By default, this function falls back to supports_add_constrained_variables(model, Reals) && supports_constraint(model, MOI.VariableIndex, S) which is the correct definition for most models.

    Example

    Suppose that a solver supports only two kind of variables: binary variables and continuous variables with a lower bound. If the solver decides not to support VariableIndex-in-Binary and VariableIndex-in-GreaterThan constraints, it only has to implement add_constrained_variable for these two sets which prevents the user to add both a binary constraint and a lower bound on the same variable. Moreover, if the user adds a VariableIndex-in-GreaterThan constraint, implementing this interface (that is, supports_add_constrained_variables) enables the constraint to be transparently bridged into a supported constraint.

    source
    MathOptInterface.supports_add_constrained_variablesFunction
    supports_add_constrained_variables(
         model::ModelLike,
         S::Type{<:AbstractVectorSet}
    -)::Bool

    Return a Bool indicating whether model supports constraining a vector of variables to belong to a set of type S either on creation of the vector of variables with add_constrained_variables or after the variable is created with add_constraint.

    By default, if S is Reals then this function returns true and otherwise, it falls back to supports_add_constrained_variables(model, Reals) && supports_constraint(model, MOI.VectorOfVariables, S) which is the correct definition for most models.

    Example

    In the standard conic form (see Duality), the variables are grouped into several cones and the constraints are affine equality constraints. If Reals is not one of the cones supported by the solvers then it needs to implement supports_add_constrained_variables(::Optimizer, ::Type{Reals}) = false as free variables are not supported. The solvers should then implement supports_add_constrained_variables(::Optimizer, ::Type{<:SupportedCones}) = true where SupportedCones is the union of all cone types that are supported; it does not have to implement the method supports_constraint(::Type{VectorOfVariables}, Type{<:SupportedCones}) as it should return false and it's the default. This prevents the user to constrain the same variable in two different cones. When a VectorOfVariables-in-S is added, the variables of the vector have already been created so they already belong to given cones. If bridges are enabled, the constraint will therefore be bridged by adding slack variables in S and equality constraints ensuring that the slack variables are equal to the corresponding variables of the given constraint function.

    Note that there may also be sets for which !supports_add_constrained_variables(model, S) and supports_constraint(model, MOI.VectorOfVariables, S). For instance, suppose a solver supports positive semidefinite variable constraints and two types of variables: binary variables and nonnegative variables. Then the solver should support adding VectorOfVariables-in-PositiveSemidefiniteConeTriangle constraints, but it should not support creating variables constrained to belong to the PositiveSemidefiniteConeTriangle because the variables in PositiveSemidefiniteConeTriangle should first be created as either binary or non-negative.

    source
    MathOptInterface.is_validMethod
    is_valid(model::ModelLike, index::Index)::Bool

    Return a Bool indicating whether this index refers to a valid object in the model model.

    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, index::Index)

    Delete the referenced object from the model. Throw DeleteNotAllowed if if index cannot be deleted.

    The following modifications also take effect if Index is VariableIndex:

    • If index used in the objective function, it is removed from the function, that is, it is substituted for zero.
    • For each func-in-set constraint of the model:
      • If func isa VariableIndex and func == index then the constraint is deleted.
      • If func isa VectorOfVariables and index in func.variables then
        • if length(func.variables) == 1 is one, the constraint is deleted;
        • if length(func.variables) > 1 and supports_dimension_update(set) then then the variable is removed from func and set is replaced by update_dimension(set, MOI.dimension(set) - 1).
        • Otherwise, a DeleteNotAllowed error is thrown.
      • Otherwise, the variable is removed from func, that is, it is substituted for zero.
    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, indices::Vector{R<:Index}) where {R}

    Delete the referenced objects in the vector indices from the model. It may be assumed that R is a concrete type. The default fallback sequentially deletes the individual items in indices, although specialized implementations may be more efficient.

    source

    Attributes

    MathOptInterface.VariableNameType
    VariableName()

    A variable attribute for a string identifying the variable. It is valid for two variables to have the same name; however, variables with duplicate names cannot be looked up using get. It has a default value of "" if not set`.

    source
    MathOptInterface.VariablePrimalStartType
    VariablePrimalStart()

    A variable attribute for the initial assignment to some primal variable's value that the optimizer may use to warm-start the solve. May be a number or nothing (unset).

    source
    MathOptInterface.VariablePrimalType
    VariablePrimal(result_index::Int = 1)

    A variable attribute for the assignment to some primal variable's value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a primal value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariablePrimal attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.VariableBasisStatusType
    VariableBasisStatus(result_index::Int = 1)

    A variable attribute for the BasisStatusCode of a variable in result result_index, with respect to an available optimal solution basis.

    If the solver does not have a basis status for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariableBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    source
    +)::Bool

    Return a Bool indicating whether model supports constraining a vector of variables to belong to a set of type S either on creation of the vector of variables with add_constrained_variables or after the variable is created with add_constraint.

    By default, if S is Reals then this function returns true and otherwise, it falls back to supports_add_constrained_variables(model, Reals) && supports_constraint(model, MOI.VectorOfVariables, S) which is the correct definition for most models.

    Example

    In the standard conic form (see Duality), the variables are grouped into several cones and the constraints are affine equality constraints. If Reals is not one of the cones supported by the solvers then it needs to implement supports_add_constrained_variables(::Optimizer, ::Type{Reals}) = false as free variables are not supported. The solvers should then implement supports_add_constrained_variables(::Optimizer, ::Type{<:SupportedCones}) = true where SupportedCones is the union of all cone types that are supported; it does not have to implement the method supports_constraint(::Type{VectorOfVariables}, Type{<:SupportedCones}) as it should return false and it's the default. This prevents the user to constrain the same variable in two different cones. When a VectorOfVariables-in-S is added, the variables of the vector have already been created so they already belong to given cones. If bridges are enabled, the constraint will therefore be bridged by adding slack variables in S and equality constraints ensuring that the slack variables are equal to the corresponding variables of the given constraint function.

    Note that there may also be sets for which !supports_add_constrained_variables(model, S) and supports_constraint(model, MOI.VectorOfVariables, S). For instance, suppose a solver supports positive semidefinite variable constraints and two types of variables: binary variables and nonnegative variables. Then the solver should support adding VectorOfVariables-in-PositiveSemidefiniteConeTriangle constraints, but it should not support creating variables constrained to belong to the PositiveSemidefiniteConeTriangle because the variables in PositiveSemidefiniteConeTriangle should first be created as either binary or non-negative.

    source
    MathOptInterface.is_validMethod
    is_valid(model::ModelLike, index::Index)::Bool

    Return a Bool indicating whether this index refers to a valid object in the model model.

    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, index::Index)

    Delete the referenced object from the model. Throw DeleteNotAllowed if if index cannot be deleted.

    The following modifications also take effect if Index is VariableIndex:

    • If index used in the objective function, it is removed from the function, that is, it is substituted for zero.
    • For each func-in-set constraint of the model:
      • If func isa VariableIndex and func == index then the constraint is deleted.
      • If func isa VectorOfVariables and index in func.variables then
        • if length(func.variables) == 1 is one, the constraint is deleted;
        • if length(func.variables) > 1 and supports_dimension_update(set) then then the variable is removed from func and set is replaced by update_dimension(set, MOI.dimension(set) - 1).
        • Otherwise, a DeleteNotAllowed error is thrown.
      • Otherwise, the variable is removed from func, that is, it is substituted for zero.
    source
    MathOptInterface.deleteMethod
    delete(model::ModelLike, indices::Vector{R<:Index}) where {R}

    Delete the referenced objects in the vector indices from the model. It may be assumed that R is a concrete type. The default fallback sequentially deletes the individual items in indices, although specialized implementations may be more efficient.

    source

    Attributes

    MathOptInterface.VariableNameType
    VariableName()

    A variable attribute for a string identifying the variable. It is valid for two variables to have the same name; however, variables with duplicate names cannot be looked up using get. It has a default value of "" if not set`.

    source
    MathOptInterface.VariablePrimalStartType
    VariablePrimalStart()

    A variable attribute for the initial assignment to some primal variable's value that the optimizer may use to warm-start the solve. May be a number or nothing (unset).

    source
    MathOptInterface.VariablePrimalType
    VariablePrimal(result_index::Int = 1)

    A variable attribute for the assignment to some primal variable's value in result result_index. If result_index is omitted, it is 1 by default.

    If the solver does not have a primal value for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariablePrimal attribute.

    See ResultCount for information on how the results are ordered.

    source
    MathOptInterface.VariableBasisStatusType
    VariableBasisStatus(result_index::Int = 1)

    A variable attribute for the BasisStatusCode of a variable in result result_index, with respect to an available optimal solution basis.

    If the solver does not have a basis status for the variable because the result_index is beyond the available solutions (whose number is indicated by the ResultCount attribute), getting this attribute must throw a ResultIndexBoundsError. Otherwise, if the result is unavailable for another reason (for instance, only a dual solution is available), the result is undefined. Users should first check PrimalStatus before accessing the VariableBasisStatus attribute.

    See ResultCount for information on how the results are ordered.

    source
    diff --git a/previews/PR3913/moi/release_notes/index.html b/previews/PR3913/moi/release_notes/index.html index 12f810c6cf1..f1be83c9cac 100644 --- a/previews/PR3913/moi/release_notes/index.html +++ b/previews/PR3913/moi/release_notes/index.html @@ -31,4 +31,4 @@ end write(path, s) end -end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    +end

    v0.9.22 (May 22, 2021)

    This release contains backports from the ongoing development of the v0.10 release.

    • Improved type inference in Utilities, Bridges and FileFormats submodules to reduce latency.
    • Improved performance of Utilities.is_canonical.
    • Fixed Utilities.pass_nonvariable_constraints with bridged variables.
    • Fixed performance regression of Utilities.Model.
    • Fixed ordering of objective setting in parser.

    v0.9.21 (April 23, 2021)

    • Added supports_shift_constant.
    • Improve performance of bridging quadratic constraints.
    • Add precompilation statements.
    • Large improvements to the documentation.
    • Fix a variety of inference issues, benefiting precompilation and reducing initial latency.
    • RawParameters are now ignored when resetting a CachingOptimizer. Previously, changing the underlying optimizer after RawParameters were set would throw an error.
    • Utilities.AbstractModel is being refactored. This may break users interacting with private fields of a model generated using @model.

    v0.9.20 (February 20, 2021)

    • Improved performance of Utilities.ScalarFunctionIterator
    • Added support for compute_conflict to MOI layers
    • Added test with zero off-diagonal quadratic term in objective
    • Fixed double deletion of nested bridged SingleVariable/VectorOfVariables constraints
    • Fixed modification of un-set objective
    • Fixed function modification with duplicate terms
    • Made unit tests abort without failing if the problem class is not supported
    • Formatted code with JuliaFormatter
    • Clarified BasisStatusCode's docstring

    v0.9.19 (December 1, 2020)

    • Added CallbackNodeStatus attribute
    • Added bridge from GreaterThan or LessThan to Interval
    • Added tests for infeasibility certificates and double optimize
    • Fixed support for Julia v1.6
    • Re-organized MOI docs and added documentation for adding a test

    v0.9.18 (November 3, 2020)

    • Various improvements for working with complex numbers
    • Added GeoMeantoRelEntrBridge to bridge a GeometricMeanCone constraint to a relative entropy constraint

    v0.9.17 (September 21, 2020)

    • Fixed CleverDict with variable of negative index value
    • Implement supports_add_constrained_variable for MockOptimizer

    v0.9.16 (September 17, 2020)

    • Various fixes:
      • 32-bit support
      • CleverDict with abstract value type
      • Checks in test suite

    v0.9.15 (September 14, 2020)

    • Bridges improvements:
      • (R)SOCtoNonConvexQuad bridge
      • ZeroOne bridge
      • Use supports_add_constrained_variable in LazyBridgeOptimizer
      • Exposed VariableBridgeCost and ConstraintBridgeCost attributes
      • Prioritize constraining variables on creation according to these costs
      • Refactor bridge debugging
    • Large performance improvements across all submodules
    • Lots of documentation improvements
    • FileFormats improvements:
      • Update MathOptFormat to v0.5
      • Fix supported objectives in FileFormats
    • Testing improvements:
      • Add name option for basic_constraint_test
    • Bug fixes and missing methods
      • Add length for iterators
      • Fix bug with duplicate terms
      • Fix order of LinearOfConstraintIndices

    v0.9.14 (May 30, 2020)

    • Add a solver-independent interface for accessing the set of conflicting constraints an Irreducible Inconsistent Subsystem (#1056).
    • Bump JSONSchema dependency from v0.2 to v0.3 (#1090).
    • Documentation improvements:
      • Fix typos (#1054, #1060, #1061, #1064, #1069, #1070).
      • Remove the outdated recommendation for a package implementing MOI for a solver XXX to be called MathOptInterfaceXXX (#1087).
    • Utilities improvements:
      • Fix is_canonical for quadratic functions (#1081, #1089).
      • Implement add_constrained_variable[s] for CachingOptimizer so that it is added as constrained variables to the underlying optimizer (#1084).
      • Add support for custom objective functions for UniversalFallback (#1086).
      • Deterministic ordering of constraints in UniversalFallback (#1088).
    • Testing improvements:
      • Add NormOneCone/NormInfinityCone tests (#1045).
    • Bridges improvements:
      • Add bridges from Semiinteger and Semicontinuous (#1059).
      • Implement getting ConstraintSet for Variable.FlipSignBridge (#1066).
      • Fix setting ConstraintFunction for Constraint.ScalarizeBridge (#1093).
      • Fix NormOne/NormInf bridges with nonzero constants (#1045).
      • Fix StackOverflow in debug (#1063).
    • FileFormats improvements:
      • [SDPA] Implement the extension for integer variables (#1079).
      • [SDPA] Ignore comments after m and nblocks and detect dat-s extension (#1077).
      • [SDPA] No scaling of off-diagonal coefficient (#1076).
      • [SDPA] Add missing negation of constant (#1075).

    v0.9.13 (March 24, 2020)

    • Added tests for Semicontinuous and Semiinteger variables (#1033).
    • Added tests for using ExprGraphs from NLP evaluators (#1043).
    • Update version compatibilities of dependencies (#1034, #1051, #1052).
    • Fixed typos in documentation (#1044).

    v0.9.12 (February 28, 2020)

    • Fixed writing NLPBlock in MathOptFormat (#1037).
    • Fixed MockOptimizer for result attributes with non-one result index (#1039).
    • Updated test template with instantiate (#1032).

    v0.9.11 (February 21, 2020)

    • Add an option for the model created by Utilities.@model to be a subtype of AbstractOptimizer (#1031).
    • Described dual cone in docstrings of GeoMeanCone and RelativeEntropyCone (#1018, #1028).
    • Fixed typos in documentation (#1022, #1024).
    • Fixed warning of unsupported attribute (#1027).
    • Added more rootdet/logdet conic tests (#1026).
    • Implemented ConstraintDual for Constraint.GeoMeanBridge, Constraint.RootDetBridge and Constraint.LogDetBridge and test duals in tests with GeoMeanCone and RootDetConeTriangle and LogDetConeTriangle cones (#1025, #1026).

    v0.9.10 (January 31, 2020)

    • Added OptimizerWithAttributes grouping an optimizer constructor and a list of optimizer attributes (#1008).
    • Added RelativeEntropyCone with corresponding bridge into exponential cone constraints (#993).
    • Added NormSpectralCone and NormNuclearCone with corresponding bridges into positive semidefinite constraints (#976).
    • Added supports_constrained_variable(s) (#1004).
    • Added dual_set_type (#1002).
    • Added tests for vector specialized version of delete (#989, #1011).
    • Added PSD3 test (#1007).
    • Clarified dual solution of Tests.pow1v and Tests.pow1f (#1013).
    • Added support for EqualTo and Zero in Bridges.Constraint.SplitIntervalBridge (#1005).
    • Fixed Utilities.vectorize for empty vector (#1003).
    • Fixed free variables in LP writer (#1006).

    v0.9.9 (December 29, 2019)

    • Incorporated MathOptFormat.jl as the FileFormats submodule. FileFormats provides readers and writers for a number of standard file formats and MOF, a file format specialized for MOI (#969).
    • Improved performance of deletion of vector of variables in MOI.Utilities.Model (#983).
    • Updated to MutableArithmetics v0.2 (#981).
    • Added MutableArithmetics.promote_operation allocation tests (#975).
    • Fixed inference issue on Julia v1.1 (#982).

    v0.9.8 (December 19, 2019)

    • Implemented MutableArithmetics API (#924).
    • Fixed callbacks with CachingOptimizer (#959).
    • Fixed MOI.dimension for MOI.Complements (#948).
    • Added fallback for add_variables (#972).
    • Added is_diagonal_vectorized_index utility (#965).
    • Improved linear constraints display in manual (#963, #964).
    • Bridges improvements:
      • Added IndicatorSet to SOS1 bridge (#877).
      • Added support for starting values for Variable.VectorizeBridge (#944).
      • Fixed MOI.add_constraints with non-bridged variable constraint on bridged variable (#951).
      • Fixed corner cases and docstring of GeoMeanBridge (#961, #962, #966).
      • Fixed choice between variable or constraint bridges for constrained variables (#973).
      • Improve performance of bridge shortest path (#945, #946, #956).
      • Added docstring for test_delete_bridge (#954).
      • Added Variable bridge tests (#952).

    v0.9.7 (October 30, 2019)

    • Implemented _result_index_field for NLPBlockDual (#934).
    • Fixed copy of model with starting values for vector constraints (#941).
    • Bridges improvements:
      • Improved performance of add_bridge and added has_bridge (#935).
      • Added AbstractSetMapBridge for bridges between sets S1, S2 such that there is a linear map A such that A*S1 = S2 (#933).
      • Added support for starting values for FlipSignBridge, VectorizeBridge, ScalarizeBridge, SlackBridge, SplitIntervalBridge, RSOCBridge, SOCRBridge NormInfinityBridge, SOCtoPSDBridge and RSOCtoPSDBridge (#933, #936, #937, #938, #939).

    v0.9.6 (October 25, 2019)

    • Added complementarity constraints (#913).
    • Allowed ModelLike objects as value of attributes (#928).
    • Testing improvements:
      • Added dual_objective_value option to MOI.Test.TestConfig (#922).
      • Added InvalidIndex tests in basic_constraint_tests (#921).
      • Added tests for the constant term in indicator constraint (#929).
    • Bridges improvements:
      • Added support for starting values for Functionize bridges (#923).
      • Added variable indices context to variable bridges (#920).
      • Fixed a typo in printing o debug_supports (#927).

    v0.9.5 (October 9, 2019)

    • Clarified PrimalStatus/DualStatus to be NO_SOLUTION if result_index is out of bounds (#912).
    • Added tolerance for checks and use ResultCount + 1 for the result_index in MOI.Test.solve_result_status (#910, #917).
    • Use 0.5 instead of 2.0 for power in PowerCone in basic_constraint_test (#916).
    • Bridges improvements:
      • Added debug utilities for unsupported variable/constraint/objective (#861).
      • Fixed deletion of variables in bridged VectorOfVariables constraints (#909).
      • Fixed result_index with objective bridges (#911).

    v0.9.4 (October 2, 2019)

    • Added solver-independent MIP callbacks (#782).
    • Implements submit for Utilities.CachingOptimizer and Bridges.AbstractBridgeOptimizer (#906).
    • Added tests for result count of solution attributes (#901, #904).
    • Added NumberOfThreads attribute (#892).
    • Added Utilities.get_bounds to get the bounds on a variable (#890).
    • Added a note on duplicate coefficients in documentation (#581).
    • Added result index in ConstraintBasisStatus (#898).
    • Added extension dictionary to Utilities.Model (#884, #895).
    • Fixed deletion of constrained variables for CachingOptimizer (#905).
    • Implemented Utilities.shift_constraint for Test.UnknownScalarSet (#896).
    • Bridges improvements:
      • Added Variable.RSOCtoSOCBridge (#907).
      • Implemented MOI.get for ConstraintFunction/ConstraintSet for Bridges.Constraint.SquareBridge (#899).

    v0.9.3 (September 20, 2019)

    • Fixed ambiguity detected in Julia v1.3 (#891, #893).
    • Fixed missing sets from ListOfSupportedConstraints (#880).
    • Fixed copy of VectorOfVariables constraints with duplicate indices (#886).
    • Added extension dictionary to MOIU.Model (#884).
    • Implemented MOI.get for function and set for GeoMeanBridge (#888).
    • Updated documentation for SingleVariable indices and bridges (#885).
    • Testing improvements:
      • Added more comprehensive tests for names (#882).
      • Added tests for SingleVariable duals (#883).
      • Added tests for DualExponentialCone and DualPowerCone (#873).
    • Improvements for arbitrary coefficient type:
      • Fixed == for sets with mutable fields (#887).
      • Removed some Float64 assumptions in bridges (#878).
      • Automatic selection of Constraint.[Scalar|Vector]FunctionizeBridge (#889).

    v0.9.2 (September 5, 2019)

    • Implemented model printing for MOI.ModelLike and specialized it for models defined in MOI (864).
    • Generalized contlinear tests for arbitrary coefficient type (#855).
    • Fixed supports_constraint for Semiinteger and Semicontinuous and supports for ObjectiveFunction (#859).
    • Fixed Allocate-Load copy for single variable constraints (#856).
    • Bridges improvements:
      • Add objective bridges (#789).
      • Fixed Variable.RSOCtoPSDBridge for dimension 2 (#869).
      • Added Variable.SOCtoRSOCBridge (#865).
      • Added Constraint.SOCRBridge and disable MOI.Bridges.Constraint.SOCtoPSDBridge (#751).
      • Fixed added_constraint_types for Contraint.LogDetBridge and Constraint.RootDetBridge (#870).

    v0.9.1 (August 22, 2019)

    • Fix support for Julia v1.2 (#834).
    • L1 and L∞ norm epigraph cones and corresponding bridges to LP were added (#818).
    • Added tests to MOI.Test.nametest (#833).
    • Fix MOI.Test.soc3test for solvers not supporting infeasibility certificates (#839).
    • Implements operate for operators * and / between vector function and constant (#837).
    • Implements show for MOI.Utilities.IndexMap (#847).
    • Fix corner cases for mapping of variables in MOI.Utilities.CachingOptimizer and substitution of variables in MOI.Bridges.AbstractBridgeOptimizer (#848).
    • Fix transformation of constant terms for MOI.Bridges.Constraint.SOCtoPSDBridge and MOI.Bridges.Constraint.RSOCtoPSDBridge (#840).

    v0.9.0 (August 13, 2019)

    • Support for Julia v0.6 and v0.7 was dropped (#714, #717).
    • A MOI.Utilities.Model implementation of ModelLike, this should replace most use cases of MOI.Utilities.@model (#781).
    • add_constrained_variable and add_constrained_variables were added (#759).
    • Support for indicator constraints was added (#709, #712).
    • DualObjectiveValue attribute was added (#473).
    • RawParameter attribute was added (#733).
    • A dual_set function was added (#804).
    • A Benchmarks submodule was added to facilitate solver benchmarking (#769).
    • A submit function was added, this may for instance allow the user to submit solutions or cuts to the solver from a callback (#775).
    • The field of ObjectiveValue was renamed to result_index (#729).
    • The _constant and Utilities.getconstant function were renamed to constant
    • REDUCTION_CERTIFICATE result status was added (#734).
    • Abstract matrix sets were added (#731).
    • Testing improvements:
      • The testing guideline was updated (#728).
      • Quadratic tests were added (#697).
      • Unit tests for RawStatusString, SolveTime, Silent and SolverName were added (#726, #741).
      • A rotated second-order cone test was added (#759).
      • A power cone test was added (#768).
      • Tests for ZeroOne variables with variable bounds were added (#772).
      • An unbounded test was added (#773).
      • Existing tests had a few updates (#702, #703, #763).
    • Documentation improvements:
      • Added a section on CachingOptimizer (#777).
      • Added a section on UniversalFallback, Model and @model (#762).
      • Transition the knapsack example to a doctest with MockOptimizer (#786).
    • Utilities improvements:
      • A CleverDict utility was added for a vector that automatically transform into a dictionary once a first index is removed (#767).
      • The Utilities.constant function was renamed to Utilities.constant_vector (#740).
      • Implement optimizer attributes for CachingOptimizer (#745).
      • Rename Utilities.add_scalar_constraint to Utilities.normalize_and_add_constraint (#801).
      • operate with vcat, SingleVariable and VectorOfVariables now returns a VectorOfVariables (#616).
      • Fix a type piracy of operate (#784).
      • The load_constraint fallback signature was fixed (#760).
      • The set_dot function was extended to work with sparse arrays (#805).
    • Bridges improvements:
      • The bridges no longer store the constraint function and set before it is bridged, the bridges now have to implement ConstraintFunction and ConstraintSet if the user wants to recover them. As a consequence, the @bridge macro was removed (#722).
      • Bridge are now instantiated with a bridge_constraint function instead of using a constructor (#730).
      • Fix constraint attributes for bridges (#699).
      • Constraint bridges were moved to the Bridges/Constraint submodule so they should now inherit from MOI.Bridges.Constraint.Abstract and should implement MOI.Bridges.Constraint.concrete_bridge_type instead of MOI.Bridges.concrete_bridge_type (#756).
      • Variable bridges were added in (#759).
      • Various improvements (#746, #747).

    v0.8.4 (March 13, 2019)

    • Performance improvement in default_copy_to and bridge optimizer (#696).
    • Add Silent and implement setting optimizer attributes in caching and mock optimizers (#695).
    • Add Functionize bridges (SingleVariable and VectorOfVariables) (#659).
    • Minor typo fixes (#694).

    v0.8.3 (March 6, 2019)

    • Use zero constant in scalar constraint function of MOI.Test.copytest (#691).
    • Fix variable deletion with SingleVariable objective function (#690).
    • Fix LazyBridgeOptimizer with bridges that add no constraints (#689).
    • Error message improvements (#673, #685, #686, #688).
    • Documentation improvements (#682, #683, #687).
    • Basis status:
      • Remove VariableBasisStatus (#679).
      • Test ConstraintBasisStatus and implement it in bridges (#678).
    • Fix inference of NumberOfVariables and NumberOfConstraints (#677).
    • Implement division between a quadratic function and a number (#675).

    v0.8.2 (February 7, 2019)

    • Add RawStatusString attribute (#629).
    • Do not set names to the optimizer but only to the cache in CachingOptimizer (#638).
    • Make scalar MOI functions act as scalars in broadcast (#646).
    • Add function utilities:
      • Implement Base.zero (#634), Base.iszero (#643), add missing arithmetic operations (#644, #645) and fix division (#648).
      • Add a vectorize function that turns a vector of ScalarAffineFunction into a VectorAffineFunction (#642).
    • Improve support for starting values:
      • Show a warning in copy when starting values are not supported instead of throwing an error (#630).
      • Fix UniversalFallback for getting an variable or constraint attribute set to no indices (#623).
      • Add a test in contlineartest with partially set VariablePrimalStart.
    • Bridges improvements:
      • Fix StackOverFlow in LazyBridgeOptimizer when there is a cycle in the graph of bridges.
      • Add Slack bridges (#610, #650).
      • Add FlipSign bridges (#658).
    • Add tests with duplicate coefficients in ScalarAffineFunction and VectorAffineFunction (#639).
    • Use tolerance to compare VariablePrimal in rotatedsoc1 test (#632).
    • Use a zero constant in ScalarAffineFunction of constraints in psdt2 (#622).

    v0.8.1 (January 7, 2019)

    • Adding an NLP objective now overrides any objective set using the ObjectiveFunction attribute (#619).
    • Rename fullbridgeoptimizer into full_bridge_optimizer (#621).
    • Allow custom constraint types with full_bridge_optimizer (#617).
    • Add Vectorize bridge which transforms scalar linear constraints into vector linear constraints (#615).

    v0.8.0 (December 18, 2018)

    • Rename all enum values to follow the JuMP naming guidelines for constants, for example, Optimal becomes OPTIMAL, and DualInfeasible becomes DUAL_INFEASIBLE.
    • Rename CachingOptimizer methods for style compliance.
    • Add an MOI.TerminationStatusCode called ALMOST_DUAL_INFEASIBLE.

    v0.7.0 (December 13, 2018)

    • Test that MOI.TerminationStatus is MOI.OptimizeNotCalled before MOI.optimize! is called.
    • Check supports_default_copy_to in tests (#594).
    • Key pieces of information like optimality, infeasibility, etc., are now reported through TerminationStatusCode. It is typically no longer necessary to check the result statuses in addition to the termination status.
    • Add perspective dimension to log-det cone (#593).

    v0.6.4 (November 27, 2018)

    • Add OptimizeNotCalled termination status (#577) and improve documentation of other statuses (#575).
    • Add a solver naming guideline (#578).
    • Make FeasibilitySense the default ObjectiveSense (#579).
    • Fix Utilities.@model and Bridges.@bridge macros for functions and sets defined outside MOI (#582).
    • Document solver-specific attributes (#580) and implement them in Utilities.CachingOptimizer (#565).

    v0.6.3 (November 16, 2018)

    • Variables and constraints are now allowed to have duplicate names. An error is thrown only on lookup. This change breaks some existing tests. (#549)
    • Attributes may now be partially set (some values could be nothing). (#563)
    • Performance improvements in Utilities.Model (#549, #567, #568)
    • Fix bug in QuadtoSOC (#558).
    • New supports_default_copy_to method that optimizers should implement to control caching behavior.
    • Documentation improvements.

    v0.6.2 (October 26, 2018)

    • Improve hygiene of @model macro (#544).
    • Fix bug in copy tests (#543).
    • Fix bug in UniversalFallback attribute getter (#540).
    • Allow all correct solutions for solve_blank_obj unit test (#537).
    • Add errors for Allocate-Load and bad constraints (#534).
    • [performance] Add specialized implementation of hash for VariableIndex (#533).
    • [performance] Construct the name to object dictionaries lazily in model (#535).
    • Add the QuadtoSOC bridge which transforms ScalarQuadraticFunction constraints into RotatedSecondOrderCone (#483).

    v0.6.1 (September 22, 2018)

    • Enable PositiveSemidefiniteConeSquare set and quadratic functions in MOIB.fullbridgeoptimizer (#524).
    • Add warning in the bridge between PositiveSemidefiniteConeSquare and PositiveSemidefiniteConeTriangle when the matrix is almost symmetric (#522).
    • Modify MOIT.copytest to not add multiples constraints on the same variable (#521).
    • Add missing keyword argument in one of MOIU.add_scalar_constraint methods (#520).

    v0.6.0 (August 30, 2018)

    • The MOIU.@model and MOIB.@bridge macros now support functions and sets defined in external modules. As a consequence, function and set names in the macro arguments need to be prefixed by module name.
    • Rename functions according to the JuMP style guide:
      • copy! with keyword arguments copynames and warnattributes -> copy_to with keyword arguments copy_names and warn_attributes;
      • set! -> set;
      • addvariable[s]! -> add_variable[s];
      • supportsconstraint -> supports_constraint;
      • addconstraint[s]! -> add_constraint[s];
      • isvalid -> is_valid;
      • isempty -> is_empty;
      • Base.delete! -> delete;
      • modify! -> modify;
      • transform! -> transform;
      • initialize! -> initialize;
      • write -> write_to_file; and
      • read! -> read_from_file.
    • Remove free! (use Base.finalize instead).
    • Add the SquarePSD bridge which transforms PositiveSemidefiniteConeTriangle constraints into PositiveSemidefiniteConeTriangle.
    • Add result fallback for ConstraintDual of variable-wise constraint, ConstraintPrimal and ObjectiveValue.
    • Add tests for ObjectiveBound.
    • Add test for empty rows in vector linear constraint.
    • Rework errors: CannotError has been renamed NotAllowedError and the distinction between UnsupportedError and NotAllowedError is now about whether the element is not supported (for example, it cannot be copied a model containing this element) or the operation is not allowed (either because it is not implemented, because it cannot be performed in the current state of the model, or because it cannot be performed for a specific index)
    • canget is removed. NoSolution is added as a result status to indicate that the solver does not have either a primal or dual solution available (See #479).

    v0.5.0 (August 5, 2018)

    • Fix names with CachingOptimizer.
    • Cleanup thanks to @mohamed82008.
    • Added a universal fallback for constraints.
    • Fast utilities for function canonicalization thanks to @rdeits.
    • Renamed dimension field to side_dimension in the context of matrix-like sets.
    • New and improved tests for cases like duplicate terms and ObjectiveBound.
    • Removed cantransform, canaddconstraint, canaddvariable, canset, canmodify, and candelete functions from the API. They are replaced by a new set of errors that are thrown: Subtypes of UnsupportedError indicate unsupported operations, while subtypes of CannotError indicate operations that cannot be performed in the current state.
    • The API for copy! is updated to remove the CopyResult type.
    • Updates for the new JuMP style guide.

    v0.4.1 (June 28, 2018)

    • Fixes vector function modification on 32 bits.
    • Fixes Bellman-Ford algorithm for bridges.
    • Added an NLP test with FeasibilitySense.
    • Update modification documentation.

    v0.4.0 (June 23, 2018)

    • Helper constructors for VectorAffineTerm and VectorQuadraticTerm.
    • Added modify_lhs to TestConfig.
    • Additional unit tests for optimizers.
    • Added a type parameter to CachingOptimizer for the optimizer field.
    • New API for problem modification (#388)
    • Tests pass without deprecation warnings on Julia 0.7.
    • Small fixes and documentation updates.

    v0.3.0 (May 25, 2018)

    • Functions have been redefined to use arrays-of-structs instead of structs-of-arrays.
    • Improvements to MockOptimizer.
    • Significant changes to Bridges.
    • New and improved unit tests.
    • Fixes for Julia 0.7.

    v0.2.0 (April 24, 2018)

    • Improvements to and better coverage of Tests.
    • Documentation fixes.
    • SolverName attribute.
    • Changes to the NLP interface (new definition of variable order and arrays of structs for bound pairs and sparsity patterns).
    • Addition of NLP tests.
    • Introduction of UniversalFallback.
    • copynames keyword argument to MOI.copy!.
    • Add Bridges submodule.

    v0.1.0 (February 28, 2018)

    • Initial public release.
    • The framework for MOI was developed at the JuMP-dev workshop at MIT in June 2017 as a sorely needed replacement for MathProgBase.
    diff --git a/previews/PR3913/moi/submodules/Benchmarks/overview/index.html b/previews/PR3913/moi/submodules/Benchmarks/overview/index.html index 9a8e21f15c6..ad75322370e 100644 --- a/previews/PR3913/moi/submodules/Benchmarks/overview/index.html +++ b/previews/PR3913/moi/submodules/Benchmarks/overview/index.html @@ -21,4 +21,4 @@ MOI.Benchmarks.compare_against_baseline( suite, "current"; directory = "/tmp", verbose = true -)

    This comparison will create a report detailing improvements and regressions.

    +)

    This comparison will create a report detailing improvements and regressions.

    diff --git a/previews/PR3913/moi/submodules/Benchmarks/reference/index.html b/previews/PR3913/moi/submodules/Benchmarks/reference/index.html index 4354b456091..557fefc0107 100644 --- a/previews/PR3913/moi/submodules/Benchmarks/reference/index.html +++ b/previews/PR3913/moi/submodules/Benchmarks/reference/index.html @@ -37,4 +37,4 @@ "glpk_master"; directory = "/tmp", verbose = true, - )source + )source diff --git a/previews/PR3913/moi/submodules/Bridges/implementation/index.html b/previews/PR3913/moi/submodules/Bridges/implementation/index.html index b0d1b2d07db..7bf5460421f 100644 --- a/previews/PR3913/moi/submodules/Bridges/implementation/index.html +++ b/previews/PR3913/moi/submodules/Bridges/implementation/index.html @@ -33,4 +33,4 @@ Subject to: ScalarAffineFunction{Int64}-in-LessThan{Int64} - (0) - (1) x <= (-1) + (0) - (1) x <= (-1) diff --git a/previews/PR3913/moi/submodules/Bridges/list_of_bridges/index.html b/previews/PR3913/moi/submodules/Bridges/list_of_bridges/index.html index f38724d5a9a..109418bbff9 100644 --- a/previews/PR3913/moi/submodules/Bridges/list_of_bridges/index.html +++ b/previews/PR3913/moi/submodules/Bridges/list_of_bridges/index.html @@ -129,4 +129,4 @@ & & & x_{11} & x_{12} & x_{13} \\ & & & & x_{22} & x_{23} \\ & & & & & x_{33} -\end{bmatrix}\]

    is positive semidefinite.

    The bridge achieves this reformulation by adding a new set of variables in MOI.PositiveSemidefiniteConeTriangle(6), and then adding three groups of equality constraints to:

    • constrain the two x blocks to be equal
    • force the diagonal of the y blocks to be 0
    • force the lower triangular of the y block to be the negative of the upper triangle.
    source
    MathOptInterface.Bridges.Variable.RSOCtoPSDBridgeType
    RSOCtoPSDBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoPSDBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ where $t, u \ge 0$ into $Y \succeq 0$, with the substitution rule: $Y = \left[\begin{array}{c c}t & x^\top \\ x & 2u \mathbf{I}\end{array}\right].$

    Additional bounds are added to ensure the off-diagonals of the $2uI$ submatrix are 0, and linear constraints are added to ensure the diagonal of $2uI$ takes the same values.

    As a special case, if $|x|| = 0$, then RSOCtoPSDBridge reformulates into $(t, u) \in \mathbb{R}_+$.

    Source node

    RSOCtoPSDBridge supports:

    Target nodes

    RSOCtoPSDBridge creates:

    source
    MathOptInterface.Bridges.Variable.RSOCtoSOCBridgeType
    RSOCtoSOCBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoSOCBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ into $||v||_2 \le w$, with the substitution rules $t = \frac{w}{\sqrt 2} + \frac{v_1}{\sqrt 2}$, $u = \frac{w}{\sqrt 2} - \frac{v_1}{\sqrt 2}$, and $x = (v_2,\ldots,v_N)$.

    Source node

    RSOCtoSOCBridge supports:

    Target node

    RSOCtoSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SOCtoRSOCBridgeType
    SOCtoRSOCBridge{T} <: Bridges.Variable.AbstractBridge

    SOCtoRSOCBridge implements the following reformulation:

    • $||x||_2 \le t$ into $2uv \ge ||w||_2^2$, with the substitution rules $t = \frac{u}{\sqrt 2} + \frac{v}{\sqrt 2}$, $x = (\frac{u}{\sqrt 2} - \frac{v}{\sqrt 2}, w)$.

    Assumptions

    • SOCtoRSOCBridge assumes that $|x| \ge 1$.

    Source node

    SOCtoRSOCBridge supports:

    Target node

    SOCtoRSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SetMapBridgeType
    abstract type SetMapBridge{T,S1,S2} <: AbstractBridge end

    Consider two type of sets, S1 and S2, and a linear mapping A such that the image of a set of type S1 under A is a set of type S2.

    A SetMapBridge{T,S1,S2} is a bridge that substitutes constrained variables in S2 into the image through A of constrained variables in S1.

    The linear map A is described by:

    Implementing a method for these two functions is sufficient to bridge constrained variables. However, in order for the getters and setters of attributes such as dual solutions and starting values to work as well, a method for the following functions must be implemented:

    See the docstrings of each function to see which feature would be missing if it was not implemented for a given bridge.

    source
    MathOptInterface.Bridges.Variable.VectorizeBridgeType
    VectorizeBridge{T,S} <: Bridges.Variable.AbstractBridge

    VectorizeBridge implements the following reformulations:

    • $x \ge a$ into $[y] \in \mathbb{R}_+$ with the substitution rule $x = a + y$
    • $x \le a$ into $[y] \in \mathbb{R}_-$ with the substitution rule $x = a + y$
    • $x == a$ into $[y] \in \{0\}$ with the substitution rule $x = a + y$

    where T is the coefficient type of a + y.

    Source node

    VectorizeBridge supports:

    Target nodes

    VectorizeBridge creates:

    source
    MathOptInterface.Bridges.Variable.ZerosBridgeType
    ZerosBridge{T} <: Bridges.Variable.AbstractBridge

    ZerosBridge implements the following reformulation:

    • $x \in \{0\}$ into the substitution rule $x = 0$,

    where T is the coefficient type of 0.

    Source node

    ZerosBridge supports:

    Target nodes

    ZerosBridge does not create target nodes. It replaces all instances of x with 0 via substitution. This means that no variables are created in the underlying model.

    Caveats

    The bridged variables are similar to parameters with zero values. Parameters with non-zero values can be created with constrained variables in MOI.EqualTo by combining a VectorizeBridge and this bridge.

    However, functions modified by ZerosBridge cannot be unbridged. That is, for a given function, we cannot determine if the bridged variables were used.

    A related implication is that this bridge does not support MOI.ConstraintDual. However, if a MOI.Utilities.CachingOptimizer is used, the dual can be determined by the bridged optimizer using MOI.Utilities.get_fallback because the caching optimizer records the unbridged function.

    source
    +\end{bmatrix}\]

    is positive semidefinite.

    The bridge achieves this reformulation by adding a new set of variables in MOI.PositiveSemidefiniteConeTriangle(6), and then adding three groups of equality constraints to:

    • constrain the two x blocks to be equal
    • force the diagonal of the y blocks to be 0
    • force the lower triangular of the y block to be the negative of the upper triangle.
    source
    MathOptInterface.Bridges.Variable.RSOCtoPSDBridgeType
    RSOCtoPSDBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoPSDBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ where $t, u \ge 0$ into $Y \succeq 0$, with the substitution rule: $Y = \left[\begin{array}{c c}t & x^\top \\ x & 2u \mathbf{I}\end{array}\right].$

    Additional bounds are added to ensure the off-diagonals of the $2uI$ submatrix are 0, and linear constraints are added to ensure the diagonal of $2uI$ takes the same values.

    As a special case, if $|x|| = 0$, then RSOCtoPSDBridge reformulates into $(t, u) \in \mathbb{R}_+$.

    Source node

    RSOCtoPSDBridge supports:

    Target nodes

    RSOCtoPSDBridge creates:

    source
    MathOptInterface.Bridges.Variable.RSOCtoSOCBridgeType
    RSOCtoSOCBridge{T} <: Bridges.Variable.AbstractBridge

    RSOCtoSOCBridge implements the following reformulation:

    • $||x||_2^2 \le 2tu$ into $||v||_2 \le w$, with the substitution rules $t = \frac{w}{\sqrt 2} + \frac{v_1}{\sqrt 2}$, $u = \frac{w}{\sqrt 2} - \frac{v_1}{\sqrt 2}$, and $x = (v_2,\ldots,v_N)$.

    Source node

    RSOCtoSOCBridge supports:

    Target node

    RSOCtoSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SOCtoRSOCBridgeType
    SOCtoRSOCBridge{T} <: Bridges.Variable.AbstractBridge

    SOCtoRSOCBridge implements the following reformulation:

    • $||x||_2 \le t$ into $2uv \ge ||w||_2^2$, with the substitution rules $t = \frac{u}{\sqrt 2} + \frac{v}{\sqrt 2}$, $x = (\frac{u}{\sqrt 2} - \frac{v}{\sqrt 2}, w)$.

    Assumptions

    • SOCtoRSOCBridge assumes that $|x| \ge 1$.

    Source node

    SOCtoRSOCBridge supports:

    Target node

    SOCtoRSOCBridge creates:

    source
    MathOptInterface.Bridges.Variable.SetMapBridgeType
    abstract type SetMapBridge{T,S1,S2} <: AbstractBridge end

    Consider two type of sets, S1 and S2, and a linear mapping A such that the image of a set of type S1 under A is a set of type S2.

    A SetMapBridge{T,S1,S2} is a bridge that substitutes constrained variables in S2 into the image through A of constrained variables in S1.

    The linear map A is described by:

    Implementing a method for these two functions is sufficient to bridge constrained variables. However, in order for the getters and setters of attributes such as dual solutions and starting values to work as well, a method for the following functions must be implemented:

    See the docstrings of each function to see which feature would be missing if it was not implemented for a given bridge.

    source
    MathOptInterface.Bridges.Variable.VectorizeBridgeType
    VectorizeBridge{T,S} <: Bridges.Variable.AbstractBridge

    VectorizeBridge implements the following reformulations:

    • $x \ge a$ into $[y] \in \mathbb{R}_+$ with the substitution rule $x = a + y$
    • $x \le a$ into $[y] \in \mathbb{R}_-$ with the substitution rule $x = a + y$
    • $x == a$ into $[y] \in \{0\}$ with the substitution rule $x = a + y$

    where T is the coefficient type of a + y.

    Source node

    VectorizeBridge supports:

    Target nodes

    VectorizeBridge creates:

    source
    MathOptInterface.Bridges.Variable.ZerosBridgeType
    ZerosBridge{T} <: Bridges.Variable.AbstractBridge

    ZerosBridge implements the following reformulation:

    • $x \in \{0\}$ into the substitution rule $x = 0$,

    where T is the coefficient type of 0.

    Source node

    ZerosBridge supports:

    Target nodes

    ZerosBridge does not create target nodes. It replaces all instances of x with 0 via substitution. This means that no variables are created in the underlying model.

    Caveats

    The bridged variables are similar to parameters with zero values. Parameters with non-zero values can be created with constrained variables in MOI.EqualTo by combining a VectorizeBridge and this bridge.

    However, functions modified by ZerosBridge cannot be unbridged. That is, for a given function, we cannot determine if the bridged variables were used.

    A related implication is that this bridge does not support MOI.ConstraintDual. However, if a MOI.Utilities.CachingOptimizer is used, the dual can be determined by the bridged optimizer using MOI.Utilities.get_fallback because the caching optimizer records the unbridged function.

    source
    diff --git a/previews/PR3913/moi/submodules/Bridges/overview/index.html b/previews/PR3913/moi/submodules/Bridges/overview/index.html index d8b1dd92a69..8e6e589d7cf 100644 --- a/previews/PR3913/moi/submodules/Bridges/overview/index.html +++ b/previews/PR3913/moi/submodules/Bridges/overview/index.html @@ -66,4 +66,4 @@ julia> MOI.get(inner_optimizer, MOI.ListOfConstraintTypesPresent()) 1-element Vector{Tuple{Type, Type}}: - (MathOptInterface.VariableIndex, MathOptInterface.Interval{Float64}) + (MathOptInterface.VariableIndex, MathOptInterface.Interval{Float64}) diff --git a/previews/PR3913/moi/submodules/Bridges/reference/index.html b/previews/PR3913/moi/submodules/Bridges/reference/index.html index 9e49fc2d06e..23dfbd520d9 100644 --- a/previews/PR3913/moi/submodules/Bridges/reference/index.html +++ b/previews/PR3913/moi/submodules/Bridges/reference/index.html @@ -221,4 +221,4 @@ cost::Int, )

    As an alternative to variable_node, add a virtual edge to graph that represents adding a free variable, followed by a constraint of type constraint_node, with bridging cost cost.

    Why is this needed?

    Variables can either be added as a variable constrained on creation, or as a free variable which then has a constraint added to it.

    source
    MathOptInterface.Bridges.bridge_indexFunction
    bridge_index(graph::Graph, node::VariableNode)::Int
     bridge_index(graph::Graph, node::ConstraintNode)::Int
    -bridge_index(graph::Graph, node::ObjectiveNode)::Int

    Return the optimal index of the bridge to chose from node.

    source
    MathOptInterface.Bridges.is_variable_edge_bestFunction
    is_variable_edge_best(graph::Graph, node::VariableNode)::Bool

    Return a Bool indicating whether node should be added as a variable constrained on creation, or as a free variable followed by a constraint.

    source
    +bridge_index(graph::Graph, node::ObjectiveNode)::Int

    Return the optimal index of the bridge to chose from node.

    source
    MathOptInterface.Bridges.is_variable_edge_bestFunction
    is_variable_edge_best(graph::Graph, node::VariableNode)::Bool

    Return a Bool indicating whether node should be added as a variable constrained on creation, or as a free variable followed by a constraint.

    source
    diff --git a/previews/PR3913/moi/submodules/FileFormats/overview/index.html b/previews/PR3913/moi/submodules/FileFormats/overview/index.html index 8b17133e82e..ea7e4380e98 100644 --- a/previews/PR3913/moi/submodules/FileFormats/overview/index.html +++ b/previews/PR3913/moi/submodules/FileFormats/overview/index.html @@ -158,4 +158,4 @@ path: [variables][1] instance: Dict{String, Any}("NaMe" => "x") schema key: required -schema value: Any["name"] +schema value: Any["name"] diff --git a/previews/PR3913/moi/submodules/FileFormats/reference/index.html b/previews/PR3913/moi/submodules/FileFormats/reference/index.html index 4ab691d931f..73b7b685f1c 100644 --- a/previews/PR3913/moi/submodules/FileFormats/reference/index.html +++ b/previews/PR3913/moi/submodules/FileFormats/reference/index.html @@ -26,4 +26,4 @@ )

    Parse the .sol file filename created by solving model and return a SolFileResults struct.

    The returned struct supports the MOI.get API for querying result attributes such as MOI.TerminationStatus, MOI.VariablePrimal, and MOI.ConstraintDual.

    source
    SolFileResults(
         raw_status::String,
         termination_status::MOI.TerminationStatusCode,
    -)

    Return a SolFileResults struct with MOI.RawStatusString set to raw_status, MOI.TerminationStatus set to termination_status, and MOI.PrimalStatus and MOI.DualStatus set to NO_SOLUTION.

    All other attributes are un-set.

    source
    +)

    Return a SolFileResults struct with MOI.RawStatusString set to raw_status, MOI.TerminationStatus set to termination_status, and MOI.PrimalStatus and MOI.DualStatus set to NO_SOLUTION.

    All other attributes are un-set.

    source diff --git a/previews/PR3913/moi/submodules/Nonlinear/overview/index.html b/previews/PR3913/moi/submodules/Nonlinear/overview/index.html index b2417bc61b8..c2946127b3e 100644 --- a/previews/PR3913/moi/submodules/Nonlinear/overview/index.html +++ b/previews/PR3913/moi/submodules/Nonlinear/overview/index.html @@ -184,4 +184,4 @@ Node(NODE_VARIABLE, 1, 1), ], [2.0], - );

    The ordering of the nodes in the tape must satisfy two rules:

    • The children of a node must appear after the parent. This means that the tape is ordered topologically, so that a reverse pass of the nodes evaluates all children nodes before their parent
    • The arguments for a CALL node are ordered in the tape based on the order in which they appear in the function call.

    Design goals

    This is less readable than the other options, but does this data structure meet our design goals?

    Instead of a heap-allocated object for each node, we only have two Vectors for each expression, nodes and values, as well as two constant vectors for the OPERATORS. In addition, all fields are concretely typed, and there are no Union or Any types.

    For our third goal, it is not easy to identify the children of a node, but it is easy to identify the parent of any node. Therefore, we can use Nonlinear.adjacency_matrix to compute a sparse matrix that maps parents to their children.

    The design in practice

    In practice, Node and Expression are exactly Nonlinear.Node and Nonlinear.Expression. However, Nonlinear.NodeType has more fields to account for comparison operators such as :>= and :<=, logic operators such as :&& and :||, nonlinear parameters, and nested subexpressions.

    Moreover, instead of storing the operators as global constants, they are stored in Nonlinear.OperatorRegistry, and it also stores a vector of logic operators and a vector of comparison operators. In addition to Nonlinear.DEFAULT_UNIVARIATE_OPERATORS and Nonlinear.DEFAULT_MULTIVARIATE_OPERATORS, you can register user-defined functions using Nonlinear.register_operator.

    Nonlinear.Model is a struct that stores the Nonlinear.OperatorRegistry, as well as a list of parameters and subexpressions in the model.

    ReverseAD

    Nonlinear.ReverseAD is a submodule for computing derivatives of a nonlinear optimization problem using sparse reverse-mode automatic differentiation (AD).

    This section does not attempt to explain how sparse reverse-mode AD works, but instead explains why MOI contains its own implementation, and highlights notable differences from similar packages.

    Warning

    Don't use the API in ReverseAD to compute derivatives. Instead, create a Nonlinear.Evaluator object with Nonlinear.SparseReverseMode as the backend, and then query the MOI API methods.

    Design goals

    The JuliaDiff organization maintains a list of packages for doing AD in Julia. At last count, there were at least ten packages——not including ReverseAD——for reverse-mode AD in Julia. ReverseAD exists because it has a different set of design goals.

    • Goal: handle scale and sparsity. The types of nonlinear optimization problems that MOI represents can be large scale (10^5 or more functions across 10^5 or more variables) with very sparse derivatives. The ability to compute a sparse Hessian matrix is essential. To the best of our knowledge, ReverseAD is the only reverse-mode AD system in Julia that handles sparsity by default.
    • Goal: limit the scope to improve robustness. Most other AD packages accept arbitrary Julia functions as input and then trace an expression graph using operator overloading. This means they must deal (or detect and ignore) with control flow, I/O, and other vagaries of Julia. In contrast, ReverseAD only accepts functions in the form of Nonlinear.Expression, which greatly limits the range of syntax that it must deal with. By reducing the scope of what we accept as input to functions relevant for mathematical optimization, we can provide a simpler implementation with various performance optimizations.
    • Goal: provide outputs which match what solvers expect. Other AD packages focus on differentiating individual Julia functions. In contrast, ReverseAD has a very specific use-case: to generate outputs needed by the MOI nonlinear API. This means it needs to efficiently compute sparse Hessians, and it needs subexpression handling to avoid recomputing subexpressions that are shared between functions.

    History

    ReverseAD started life as ReverseDiffSparse.jl, development of which began in early 2014(!). This was well before the other AD packages started development. Because we had a well-tested, working AD in JuMP, there was less motivation to contribute to and explore other AD packages. The lack of historical interaction also meant that other packages were not optimized for the types of problems that JuMP is built for (that is, large-scale sparse problems). When we first created MathOptInterface, we kept the AD in JuMP to simplify the transition, and post-poned the development of a first-class nonlinear interface in MathOptInterface.

    Prior to the introduction of Nonlinear, JuMP's nonlinear implementation was a confusing mix of functions and types spread across the code base and in the private _Derivatives submodule. This made it hard to swap the AD system for another. The main motivation for refactoring JuMP to create the Nonlinear submodule in MathOptInterface was to abstract the interface between JuMP and the AD system, allowing us to swap-in and test new AD systems in the future.

    + );

    The ordering of the nodes in the tape must satisfy two rules:

    • The children of a node must appear after the parent. This means that the tape is ordered topologically, so that a reverse pass of the nodes evaluates all children nodes before their parent
    • The arguments for a CALL node are ordered in the tape based on the order in which they appear in the function call.

    Design goals

    This is less readable than the other options, but does this data structure meet our design goals?

    Instead of a heap-allocated object for each node, we only have two Vectors for each expression, nodes and values, as well as two constant vectors for the OPERATORS. In addition, all fields are concretely typed, and there are no Union or Any types.

    For our third goal, it is not easy to identify the children of a node, but it is easy to identify the parent of any node. Therefore, we can use Nonlinear.adjacency_matrix to compute a sparse matrix that maps parents to their children.

    The design in practice

    In practice, Node and Expression are exactly Nonlinear.Node and Nonlinear.Expression. However, Nonlinear.NodeType has more fields to account for comparison operators such as :>= and :<=, logic operators such as :&& and :||, nonlinear parameters, and nested subexpressions.

    Moreover, instead of storing the operators as global constants, they are stored in Nonlinear.OperatorRegistry, and it also stores a vector of logic operators and a vector of comparison operators. In addition to Nonlinear.DEFAULT_UNIVARIATE_OPERATORS and Nonlinear.DEFAULT_MULTIVARIATE_OPERATORS, you can register user-defined functions using Nonlinear.register_operator.

    Nonlinear.Model is a struct that stores the Nonlinear.OperatorRegistry, as well as a list of parameters and subexpressions in the model.

    ReverseAD

    Nonlinear.ReverseAD is a submodule for computing derivatives of a nonlinear optimization problem using sparse reverse-mode automatic differentiation (AD).

    This section does not attempt to explain how sparse reverse-mode AD works, but instead explains why MOI contains its own implementation, and highlights notable differences from similar packages.

    Warning

    Don't use the API in ReverseAD to compute derivatives. Instead, create a Nonlinear.Evaluator object with Nonlinear.SparseReverseMode as the backend, and then query the MOI API methods.

    Design goals

    The JuliaDiff organization maintains a list of packages for doing AD in Julia. At last count, there were at least ten packages——not including ReverseAD——for reverse-mode AD in Julia. ReverseAD exists because it has a different set of design goals.

    • Goal: handle scale and sparsity. The types of nonlinear optimization problems that MOI represents can be large scale (10^5 or more functions across 10^5 or more variables) with very sparse derivatives. The ability to compute a sparse Hessian matrix is essential. To the best of our knowledge, ReverseAD is the only reverse-mode AD system in Julia that handles sparsity by default.
    • Goal: limit the scope to improve robustness. Most other AD packages accept arbitrary Julia functions as input and then trace an expression graph using operator overloading. This means they must deal (or detect and ignore) with control flow, I/O, and other vagaries of Julia. In contrast, ReverseAD only accepts functions in the form of Nonlinear.Expression, which greatly limits the range of syntax that it must deal with. By reducing the scope of what we accept as input to functions relevant for mathematical optimization, we can provide a simpler implementation with various performance optimizations.
    • Goal: provide outputs which match what solvers expect. Other AD packages focus on differentiating individual Julia functions. In contrast, ReverseAD has a very specific use-case: to generate outputs needed by the MOI nonlinear API. This means it needs to efficiently compute sparse Hessians, and it needs subexpression handling to avoid recomputing subexpressions that are shared between functions.

    History

    ReverseAD started life as ReverseDiffSparse.jl, development of which began in early 2014(!). This was well before the other AD packages started development. Because we had a well-tested, working AD in JuMP, there was less motivation to contribute to and explore other AD packages. The lack of historical interaction also meant that other packages were not optimized for the types of problems that JuMP is built for (that is, large-scale sparse problems). When we first created MathOptInterface, we kept the AD in JuMP to simplify the transition, and post-poned the development of a first-class nonlinear interface in MathOptInterface.

    Prior to the introduction of Nonlinear, JuMP's nonlinear implementation was a confusing mix of functions and types spread across the code base and in the private _Derivatives submodule. This made it hard to swap the AD system for another. The main motivation for refactoring JuMP to create the Nonlinear submodule in MathOptInterface was to abstract the interface between JuMP and the AD system, allowing us to swap-in and test new AD systems in the future.

    diff --git a/previews/PR3913/moi/submodules/Nonlinear/reference/index.html b/previews/PR3913/moi/submodules/Nonlinear/reference/index.html index 1567d9ae5b7..462461e1124 100644 --- a/previews/PR3913/moi/submodules/Nonlinear/reference/index.html +++ b/previews/PR3913/moi/submodules/Nonlinear/reference/index.html @@ -236,4 +236,4 @@ julia> MOI.initialize(evaluator, Symbol[]) julia> MOI.Nonlinear.ordinal_index(evaluator, c2) # Returns 1 -1source +1source diff --git a/previews/PR3913/moi/submodules/Test/overview/index.html b/previews/PR3913/moi/submodules/Test/overview/index.html index 1b2ffb5458a..4f5ee261240 100644 --- a/previews/PR3913/moi/submodules/Test/overview/index.html +++ b/previews/PR3913/moi/submodules/Test/overview/index.html @@ -167,4 +167,4 @@ ), ) return -end

    Finally, you also need to implement Test.version_added. If we added this test when the latest released version of MOI was v0.10.5, define:

    version_added(::typeof(test_unit_optimize!_twice)) = v"0.10.6"

    Step 6

    Commit the changes to git from ~/.julia/dev/MathOptInterface and submit the PR for review.

    Tip

    If you need help writing a test, open an issue on GitHub, or ask the Developer Chatroom.

    +end

    Finally, you also need to implement Test.version_added. If we added this test when the latest released version of MOI was v0.10.5, define:

    version_added(::typeof(test_unit_optimize!_twice)) = v"0.10.6"

    Step 6

    Commit the changes to git from ~/.julia/dev/MathOptInterface and submit the PR for review.

    Tip

    If you need help writing a test, open an issue on GitHub, or ask the Developer Chatroom.

    diff --git a/previews/PR3913/moi/submodules/Test/reference/index.html b/previews/PR3913/moi/submodules/Test/reference/index.html index 6cfe602dae2..42a128b4092 100644 --- a/previews/PR3913/moi/submodules/Test/reference/index.html +++ b/previews/PR3913/moi/submodules/Test/reference/index.html @@ -63,4 +63,4 @@ \text{subject to}\ & x_1 * x_2 * x_3 * x_4 \ge 25 \\ & x_1^2 + x_2^2 + x_3^2 + x_4^2 = 40 \\ & 1 \le x_1, x_2, x_3, x_4 \le 5 -\end{aligned}\]

    The optimal solution is [1.000, 4.743, 3.821, 1.379].

    source +\end{aligned}\]

    The optimal solution is [1.000, 4.743, 3.821, 1.379].

    source diff --git a/previews/PR3913/moi/submodules/Utilities/overview/index.html b/previews/PR3913/moi/submodules/Utilities/overview/index.html index 3fa4a9df768..a74178da1fb 100644 --- a/previews/PR3913/moi/submodules/Utilities/overview/index.html +++ b/previews/PR3913/moi/submodules/Utilities/overview/index.html @@ -378,4 +378,4 @@ index_map = MOI.copy_to(dest, src) for (F, S) in MOI.get(src, MOI.ListOfConstraintTypesPresent()) function_barrier(dest, src, index_map[F, S]) -end +end diff --git a/previews/PR3913/moi/submodules/Utilities/reference/index.html b/previews/PR3913/moi/submodules/Utilities/reference/index.html index 1bfd84891e3..64556c07845 100644 --- a/previews/PR3913/moi/submodules/Utilities/reference/index.html +++ b/previews/PR3913/moi/submodules/Utilities/reference/index.html @@ -91,7 +91,7 @@ typeof(CleverDicts.key_to_index), typeof(CleverDicts.index_to_key), } -end

    A struct storing F-in-S constraints as a mapping between the constraint indices to the corresponding tuple of function and set.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_function_typesMacro
    Utilities.@struct_of_constraints_by_function_types(name, func_types...)

    Given a vector of n function types (F1, F2,..., Fn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of function type Fi.

    The expression Fi can also be a union in which case any constraint for which the function type is in the union is stored in the field with type Ci.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_set_typesMacro
    Utilities.@struct_of_constraints_by_set_types(name, func_types...)

    Given a vector of n set types (S1, S2,..., Sn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of set type Si. The expression Si can also be a union in which case any constraint for which the set type is in the union is stored in the field with type Ci. This can be useful if Ci is a MatrixOfConstraints in order to concatenate the coefficients of constraints of several different set types in the same matrix.

    source
    MathOptInterface.Utilities.struct_of_constraint_codeFunction
    struct_of_constraint_code(struct_name, types, field_types = nothing)

    Given a vector of n Union{SymbolFun,_UnionSymbolFS{SymbolFun}} or Union{SymbolSet,_UnionSymbolFS{SymbolSet}} in types, defines a subtype of StructOfConstraints of name name and which type parameters {T, F1, F2, ..., Fn} if field_types is nothing and a {T} otherwise. It contains n field where the ith field has type Ci if field_types is nothing and type field_types[i] otherwise. If types is vector of Union{SymbolFun,_UnionSymbolFS{SymbolFun}} (resp. Union{SymbolSet,_UnionSymbolFS{SymbolSet}}) then the constraints of that function (resp. set) type are stored in the corresponding field.

    This function is used by the macros @model, @struct_of_constraints_by_function_types and @struct_of_constraints_by_set_types.

    source

    Caching optimizer

    MathOptInterface.Utilities.CachingOptimizerType
    CachingOptimizer

    CachingOptimizer is an intermediate layer that stores a cache of the model and links it with an optimizer. It supports incremental model construction and modification even when the optimizer doesn't.

    Constructors

        CachingOptimizer(cache::MOI.ModelLike, optimizer::AbstractOptimizer)

    Creates a CachingOptimizer in AUTOMATIC mode, with the optimizer optimizer.

    The type of the optimizer returned is CachingOptimizer{typeof(optimizer), typeof(cache)} so it does not support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

        CachingOptimizer(cache::MOI.ModelLike, mode::CachingOptimizerMode)

    Creates a CachingOptimizer in the NO_OPTIMIZER state and mode mode.

    The type of the optimizer returned is CachingOptimizer{MOI.AbstractOptimizer,typeof(cache)} so it does support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

    About the type

    States

    A CachingOptimizer may be in one of three possible states (CachingOptimizerState):

    • NO_OPTIMIZER: The CachingOptimizer does not have any optimizer.
    • EMPTY_OPTIMIZER: The CachingOptimizer has an empty optimizer. The optimizer is not synchronized with the cached model.
    • ATTACHED_OPTIMIZER: The CachingOptimizer has an optimizer, and it is synchronized with the cached model.

    Modes

    A CachingOptimizer has two modes of operation (CachingOptimizerMode):

    • MANUAL: The only methods that change the state of the CachingOptimizer are Utilities.reset_optimizer, Utilities.drop_optimizer, and Utilities.attach_optimizer. Attempting to perform an operation in the incorrect state results in an error.
    • AUTOMATIC: The CachingOptimizer changes its state when necessary. For example, optimize! will automatically call attach_optimizer (an optimizer must have been previously set). Attempting to add a constraint or perform a modification not supported by the optimizer results in a drop to EMPTY_OPTIMIZER mode.
    source
    MathOptInterface.Utilities.attach_optimizerFunction
    attach_optimizer(model::CachingOptimizer)

    Attaches the optimizer to model, copying all model data into it. Can be called only from the EMPTY_OPTIMIZER state. If the copy succeeds, the CachingOptimizer will be in state ATTACHED_OPTIMIZER after the call, otherwise an error is thrown; see MOI.copy_to for more details on which errors can be thrown.

    source
    MOIU.attach_optimizer(model::GenericModel)

    Call MOIU.attach_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.reset_optimizerFunction
    reset_optimizer(m::CachingOptimizer, optimizer::MOI.AbstractOptimizer)

    Sets or resets m to have the given empty optimizer optimizer.

    Can be called from any state. An assertion error will be thrown if optimizer is not empty.

    The CachingOptimizer m will be in state EMPTY_OPTIMIZER after the call.

    source
    reset_optimizer(m::CachingOptimizer)

    Detaches and empties the current optimizer. Can be called from ATTACHED_OPTIMIZER or EMPTY_OPTIMIZER state. The CachingOptimizer will be in state EMPTY_OPTIMIZER after the call.

    source
    MOIU.reset_optimizer(model::GenericModel, optimizer::MOI.AbstractOptimizer)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MOIU.reset_optimizer(model::GenericModel)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.drop_optimizerFunction
    drop_optimizer(m::CachingOptimizer)

    Drops the optimizer, if one is present. Can be called from any state. The CachingOptimizer will be in state NO_OPTIMIZER after the call.

    source
    MOIU.drop_optimizer(model::GenericModel)

    Call MOIU.drop_optimizer on the backend of model.

    Cannot be called in direct mode.

    source

    Mock optimizer

    Printing

    MathOptInterface.Utilities.latex_formulationFunction
    latex_formulation(model::MOI.ModelLike; kwargs...)

    Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

    To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

    Possible keyword arguments are:

    • simplify_coefficients : Simplify coefficients if possible by omitting them or removing trailing zeros.
    • default_name : The name given to variables with an empty name.
    • print_types : Print the MOI type of each function and set for clarity.
    source

    Copy utilities

    MathOptInterface.Utilities.ModelFilterType
    ModelFilter(filter::Function, model::MOI.ModelLike)

    A layer to filter out various components of model.

    The filter function takes a single argument, which is each element from the list returned by the attributes below. It returns true if the element should be visible in the filtered model and false otherwise.

    The components that are filtered are:

    • Entire constraint types via:
      • MOI.ListOfConstraintTypesPresent
    • Individual constraints via:
      • MOI.ListOfConstraintIndices{F,S}
    • Specific attributes via:
      • MOI.ListOfModelAttributesSet
      • MOI.ListOfConstraintAttributesSet
      • MOI.ListOfVariableAttributesSet
    Warning

    The list of attributes filtered may change in a future release. You should write functions that are generic and not limited to the five types listed above. Thus, you should probably define a fallback filter(::Any) = true.

    See below for examples of how this works.

    Note

    This layer has a limited scope. It is intended by be used in conjunction with MOI.copy_to.

    Example: copy model excluding integer constraints

    Use the do syntax to provide a single function.

    filtered_src = MOI.Utilities.ModelFilter(src) do item
    +end

    A struct storing F-in-S constraints as a mapping between the constraint indices to the corresponding tuple of function and set.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_function_typesMacro
    Utilities.@struct_of_constraints_by_function_types(name, func_types...)

    Given a vector of n function types (F1, F2,..., Fn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of function type Fi.

    The expression Fi can also be a union in which case any constraint for which the function type is in the union is stored in the field with type Ci.

    source
    MathOptInterface.Utilities.@struct_of_constraints_by_set_typesMacro
    Utilities.@struct_of_constraints_by_set_types(name, func_types...)

    Given a vector of n set types (S1, S2,..., Sn) in func_types, defines a subtype of StructOfConstraints of name name and which type parameters {T, C1, C2, ..., Cn}. It contains n field where the ith field has type Ci and stores the constraints of set type Si. The expression Si can also be a union in which case any constraint for which the set type is in the union is stored in the field with type Ci. This can be useful if Ci is a MatrixOfConstraints in order to concatenate the coefficients of constraints of several different set types in the same matrix.

    source
    MathOptInterface.Utilities.struct_of_constraint_codeFunction
    struct_of_constraint_code(struct_name, types, field_types = nothing)

    Given a vector of n Union{SymbolFun,_UnionSymbolFS{SymbolFun}} or Union{SymbolSet,_UnionSymbolFS{SymbolSet}} in types, defines a subtype of StructOfConstraints of name name and which type parameters {T, F1, F2, ..., Fn} if field_types is nothing and a {T} otherwise. It contains n field where the ith field has type Ci if field_types is nothing and type field_types[i] otherwise. If types is vector of Union{SymbolFun,_UnionSymbolFS{SymbolFun}} (resp. Union{SymbolSet,_UnionSymbolFS{SymbolSet}}) then the constraints of that function (resp. set) type are stored in the corresponding field.

    This function is used by the macros @model, @struct_of_constraints_by_function_types and @struct_of_constraints_by_set_types.

    source

    Caching optimizer

    MathOptInterface.Utilities.CachingOptimizerType
    CachingOptimizer

    CachingOptimizer is an intermediate layer that stores a cache of the model and links it with an optimizer. It supports incremental model construction and modification even when the optimizer doesn't.

    Constructors

        CachingOptimizer(cache::MOI.ModelLike, optimizer::AbstractOptimizer)

    Creates a CachingOptimizer in AUTOMATIC mode, with the optimizer optimizer.

    The type of the optimizer returned is CachingOptimizer{typeof(optimizer), typeof(cache)} so it does not support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

        CachingOptimizer(cache::MOI.ModelLike, mode::CachingOptimizerMode)

    Creates a CachingOptimizer in the NO_OPTIMIZER state and mode mode.

    The type of the optimizer returned is CachingOptimizer{MOI.AbstractOptimizer,typeof(cache)} so it does support the function reset_optimizer(::CachingOptimizer, new_optimizer) if the type of new_optimizer is different from the type of optimizer.

    About the type

    States

    A CachingOptimizer may be in one of three possible states (CachingOptimizerState):

    • NO_OPTIMIZER: The CachingOptimizer does not have any optimizer.
    • EMPTY_OPTIMIZER: The CachingOptimizer has an empty optimizer. The optimizer is not synchronized with the cached model.
    • ATTACHED_OPTIMIZER: The CachingOptimizer has an optimizer, and it is synchronized with the cached model.

    Modes

    A CachingOptimizer has two modes of operation (CachingOptimizerMode):

    • MANUAL: The only methods that change the state of the CachingOptimizer are Utilities.reset_optimizer, Utilities.drop_optimizer, and Utilities.attach_optimizer. Attempting to perform an operation in the incorrect state results in an error.
    • AUTOMATIC: The CachingOptimizer changes its state when necessary. For example, optimize! will automatically call attach_optimizer (an optimizer must have been previously set). Attempting to add a constraint or perform a modification not supported by the optimizer results in a drop to EMPTY_OPTIMIZER mode.
    source
    MathOptInterface.Utilities.attach_optimizerFunction
    attach_optimizer(model::CachingOptimizer)

    Attaches the optimizer to model, copying all model data into it. Can be called only from the EMPTY_OPTIMIZER state. If the copy succeeds, the CachingOptimizer will be in state ATTACHED_OPTIMIZER after the call, otherwise an error is thrown; see MOI.copy_to for more details on which errors can be thrown.

    source
    MOIU.attach_optimizer(model::GenericModel)

    Call MOIU.attach_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.reset_optimizerFunction
    reset_optimizer(m::CachingOptimizer, optimizer::MOI.AbstractOptimizer)

    Sets or resets m to have the given empty optimizer optimizer.

    Can be called from any state. An assertion error will be thrown if optimizer is not empty.

    The CachingOptimizer m will be in state EMPTY_OPTIMIZER after the call.

    source
    reset_optimizer(m::CachingOptimizer)

    Detaches and empties the current optimizer. Can be called from ATTACHED_OPTIMIZER or EMPTY_OPTIMIZER state. The CachingOptimizer will be in state EMPTY_OPTIMIZER after the call.

    source
    MOIU.reset_optimizer(model::GenericModel, optimizer::MOI.AbstractOptimizer)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MOIU.reset_optimizer(model::GenericModel)

    Call MOIU.reset_optimizer on the backend of model.

    Cannot be called in direct mode.

    source
    MathOptInterface.Utilities.drop_optimizerFunction
    drop_optimizer(m::CachingOptimizer)

    Drops the optimizer, if one is present. Can be called from any state. The CachingOptimizer will be in state NO_OPTIMIZER after the call.

    source
    MOIU.drop_optimizer(model::GenericModel)

    Call MOIU.drop_optimizer on the backend of model.

    Cannot be called in direct mode.

    source

    Mock optimizer

    Printing

    MathOptInterface.Utilities.latex_formulationFunction
    latex_formulation(model::MOI.ModelLike; kwargs...)

    Wrap model in a type so that it can be pretty-printed as text/latex in a notebook like IJulia, or in Documenter.

    To render the model, end the cell with latex_formulation(model), or call display(latex_formulation(model)) in to force the display of the model from inside a function.

    Possible keyword arguments are:

    • simplify_coefficients : Simplify coefficients if possible by omitting them or removing trailing zeros.
    • default_name : The name given to variables with an empty name.
    • print_types : Print the MOI type of each function and set for clarity.
    source

    Copy utilities

    MathOptInterface.Utilities.ModelFilterType
    ModelFilter(filter::Function, model::MOI.ModelLike)

    A layer to filter out various components of model.

    The filter function takes a single argument, which is each element from the list returned by the attributes below. It returns true if the element should be visible in the filtered model and false otherwise.

    The components that are filtered are:

    • Entire constraint types via:
      • MOI.ListOfConstraintTypesPresent
    • Individual constraints via:
      • MOI.ListOfConstraintIndices{F,S}
    • Specific attributes via:
      • MOI.ListOfModelAttributesSet
      • MOI.ListOfConstraintAttributesSet
      • MOI.ListOfVariableAttributesSet
    Warning

    The list of attributes filtered may change in a future release. You should write functions that are generic and not limited to the five types listed above. Thus, you should probably define a fallback filter(::Any) = true.

    See below for examples of how this works.

    Note

    This layer has a limited scope. It is intended by be used in conjunction with MOI.copy_to.

    Example: copy model excluding integer constraints

    Use the do syntax to provide a single function.

    filtered_src = MOI.Utilities.ModelFilter(src) do item
         return item != (MOI.VariableIndex, MOI.Integer)
     end
     MOI.copy_to(dest, filtered_src)

    Example: copy model excluding names

    Use type dispatch to simplify the implementation:

    my_filter(::Any) = true  # Note the generic fallback
    @@ -343,4 +343,4 @@
     For performance, it is recommended that the inner loop lies in a separate
     function to guarantee type-stability.
     
    -If you want an iterator of all current outer keys, use [`outer_keys`](@ref).
    source
    +If you want an iterator of all current outer keys, use [`outer_keys`](@ref).source diff --git a/previews/PR3913/moi/tutorials/bridging_constraint/index.html b/previews/PR3913/moi/tutorials/bridging_constraint/index.html index 884f830de5d..a06a1220651 100644 --- a/previews/PR3913/moi/tutorials/bridging_constraint/index.html +++ b/previews/PR3913/moi/tutorials/bridging_constraint/index.html @@ -103,4 +103,4 @@ end

    Bridge deletion

    When a bridge is deleted, the constraints it added must be deleted too.

    function delete(model::ModelLike, bridge::SignBridge)
         delete(model, bridge.constraint)
         return
    -end
    +end diff --git a/previews/PR3913/moi/tutorials/example/index.html b/previews/PR3913/moi/tutorials/example/index.html index 14820938a1e..1d0ffb12486 100644 --- a/previews/PR3913/moi/tutorials/example/index.html +++ b/previews/PR3913/moi/tutorials/example/index.html @@ -46,4 +46,4 @@ 3-element Vector{Float64}: 1.0 1.0 - 1.0 + 1.0 diff --git a/previews/PR3913/moi/tutorials/implementing/index.html b/previews/PR3913/moi/tutorials/implementing/index.html index 0fffcbe07ef..b1ab926e619 100644 --- a/previews/PR3913/moi/tutorials/implementing/index.html +++ b/previews/PR3913/moi/tutorials/implementing/index.html @@ -115,4 +115,4 @@ n = # Code to get NumberOfObjectives return n end

    Then, the user can write:

    model = Gurobi.Optimizer()
    -MOI.set(model, Gurobi.NumberofObjectives(), 3)
    +MOI.set(model, Gurobi.NumberofObjectives(), 3) diff --git a/previews/PR3913/moi/tutorials/latency/index.html b/previews/PR3913/moi/tutorials/latency/index.html index b88d38a5283..f4d364c9a6f 100644 --- a/previews/PR3913/moi/tutorials/latency/index.html +++ b/previews/PR3913/moi/tutorials/latency/index.html @@ -130,4 +130,4 @@ end

    You can create a flame-graph via

    using SnoopCompile
     tinf = @snoopi_deep example_diet(GLPK.Optimizer, true)
     using ProfileView
    -ProfileView.view(flamegraph(tinf))

    Here's how things looked in mid-August 2021: flamegraph

    There are a few opportunities for improvement (non-red flames, particularly on the right). But the main problem is a large red (non-precompilable due to method ownership) flame.

    +ProfileView.view(flamegraph(tinf))

    Here's how things looked in mid-August 2021: flamegraph

    There are a few opportunities for improvement (non-red flames, particularly on the right). But the main problem is a large red (non-precompilable due to method ownership) flame.

    diff --git a/previews/PR3913/moi/tutorials/manipulating_expressions/index.html b/previews/PR3913/moi/tutorials/manipulating_expressions/index.html index 9763929937e..b065b2243ec 100644 --- a/previews/PR3913/moi/tutorials/manipulating_expressions/index.html +++ b/previews/PR3913/moi/tutorials/manipulating_expressions/index.html @@ -23,4 +23,4 @@ 2-element Vector{MathOptInterface.ScalarAffineFunction{Int64}}: (2) + (1) MOI.VariableIndex(1) (4) + (2) MOI.VariableIndex(1)
    Note

    Utilities.eachscalar returns an iterator on the dimensions, which serves the same purpose as Utilities.scalarize.

    output_dimension returns the number of dimensions of the output of a function:

    julia> MOI.output_dimension(g)
    -2
    +2 diff --git a/previews/PR3913/moi/tutorials/mathprogbase/index.html b/previews/PR3913/moi/tutorials/mathprogbase/index.html index 02b5709b7ff..07c5e6c4f2e 100644 --- a/previews/PR3913/moi/tutorials/mathprogbase/index.html +++ b/previews/PR3913/moi/tutorials/mathprogbase/index.html @@ -55,4 +55,4 @@ objval = objective_value(model), sol = value.(x) ) -end +end diff --git a/previews/PR3913/packages/Alpine/index.html b/previews/PR3913/packages/Alpine/index.html index a2b535fc0ac..fadc4db9ff4 100644 --- a/previews/PR3913/packages/Alpine/index.html +++ b/previews/PR3913/packages/Alpine/index.html @@ -46,4 +46,4 @@ author={Kim, Jongeun and Richard, Jean-Philippe P. and Tawarmalani, Mohit}, eprinttype={Optimization Online}, date={2022} -} +} diff --git a/previews/PR3913/packages/AmplNLWriter/index.html b/previews/PR3913/packages/AmplNLWriter/index.html index f0f6484b9cc..67f3536c10d 100644 --- a/previews/PR3913/packages/AmplNLWriter/index.html +++ b/previews/PR3913/packages/AmplNLWriter/index.html @@ -12,4 +12,4 @@ import Bonmin_jll model = Model(() -> AmplNLWriter.Optimizer(Bonmin_jll.amplexe)) set_attribute(model, "bonmin.nlp_log_level", 0)

    opt files

    Some options need to be specified via an .opt file.

    This file must be located in the current working directory whenever the model is solved.

    The .opt file must be named after the name of the solver, for example, bonmin.opt, and each line must contain an option name and the desired value, separated by a space.

    For example, to set the absolute and relative tolerances in Couenne to 1 and 0.05 respectively, the couenne.opt file should contain:

    allowable_gap 1
    -allowable_fraction_gap 0.05
    +allowable_fraction_gap 0.05 diff --git a/previews/PR3913/packages/BARON/index.html b/previews/PR3913/packages/BARON/index.html index 4a15672e547..3335a310a65 100644 --- a/previews/PR3913/packages/BARON/index.html +++ b/previews/PR3913/packages/BARON/index.html @@ -6,4 +6,4 @@

    BARON.jl

    Build Status codecov

    BARON.jl is a wrapper for BARON by The Optimization Firm.

    Affiliation

    This wrapper is maintained by the JuMP community and is not officially supported by The Optimization Firm.

    Getting help

    If you need help, please ask a question on the JuMP community forum.

    If you have a reproducible example of a bug, please open a GitHub issue.

    License

    BARON.jl is licensed under the MIT License.

    The underlying solver is a closed-source commercial product for which you must obtain a license from The Optimization Firm, although a small trial version is available for free.

    Installation

    First, download a copy of the BARON solver and unpack the executable in a location of your choosing.

    Once installed, set the BARON_EXEC environment variable pointing to the BARON executable (full path, including file name as it differs across platforms), and run Pkg.add("BARON"). For example:

    ENV["BARON_EXEC"] = "/path/to/baron.exe"
     using Pkg
     Pkg.add("BARON")

    The baronlice.txt license file should be placed in the same directory as the BARON executable, or in your current working directory.

    Use with JuMP

    using JuMP, BARON
    -model = Model(BARON.Optimizer)

    MathOptInterface API

    The BARON optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    +model = Model(BARON.Optimizer)

    MathOptInterface API

    The BARON optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    diff --git a/previews/PR3913/packages/BilevelJuMP/index.html b/previews/PR3913/packages/BilevelJuMP/index.html index b9368321fd7..830cd5d2633 100644 --- a/previews/PR3913/packages/BilevelJuMP/index.html +++ b/previews/PR3913/packages/BilevelJuMP/index.html @@ -34,4 +34,4 @@ objective_value(model) # = 3 * (3.5 * 8/15) + 8/15 # = 6.13... value(x) # = 3.5 * 8/15 # = 1.86... -value(y) # = 8/15 # = 0.53... +value(y) # = 8/15 # = 0.53... diff --git a/previews/PR3913/packages/CATrustRegionMethod/index.html b/previews/PR3913/packages/CATrustRegionMethod/index.html index 062605424cb..66af4a80a7b 100644 --- a/previews/PR3913/packages/CATrustRegionMethod/index.html +++ b/previews/PR3913/packages/CATrustRegionMethod/index.html @@ -18,4 +18,4 @@ # Retrieve the solver instance optimizer = backend(model).optimizer.model # Algorithm stats (total function evalation, ...) -algorithm_counter = optimizer.inner.algorithm_counter

    CUTEst test set

    To test our solver on CUTEst test set, please use the script:

    solve_cutest.jl

    To see the meaning of each argument:

    $ julia --project=. scripts/solve_cutest.jl --help

    Here is a simple example:

    $ julia --project=. scripts/solve_cutest.jl --output_dir ./scripts/benchmark/results/cutest --default_problems true

    Plots for CUTEst test set

    $ julia --project=. scripts/plot_CUTEst_results.jl --output_dir ./scripts/benchmark/results/cutest

    Instructions for reproducing our experiments

    CUTEst test set

    $ julia --project=. scripts/solve_cutest.jl --output_dir ./scripts/benchmark/results/cutest --default_problems true
    $ julia --project=. scripts/solve_cutest.jl --output_dir ./scripts/benchmark/results/cutest --default_problems true --θ 0.0
    $ julia --project=. scripts/run_ablation_study.jl --output_dir ./scripts/benchmark/results_ablation_study/cutest --default_problems true

    Examples

    Examples can be found under the test directory

    References

    Citing

    ```markdown If you use our method in your research, you are kindly asked to cite the relevant papers:

    @article{hamad2024simple, title={A simple and practical adaptive trust-region method}, author={Hamad, Fadi and Hinder, Oliver}, journal={arXiv preprint arXiv:2412.02079}, year={2024} }

    @article{hamad2022consistently, title={A consistently adaptive trust-region method}, author={Hamad, Fadi and Hinder, Oliver}, journal={Advances in Neural Information Processing Systems}, volume={35}, pages={6640–6653}, year={2022} }

    +algorithm_counter = optimizer.inner.algorithm_counter

    CUTEst test set

    To test our solver on CUTEst test set, please use the script:

    solve_cutest.jl

    To see the meaning of each argument:

    $ julia --project=. scripts/solve_cutest.jl --help

    Here is a simple example:

    $ julia --project=. scripts/solve_cutest.jl --output_dir ./scripts/benchmark/results/cutest --default_problems true

    Plots for CUTEst test set

    $ julia --project=. scripts/plot_CUTEst_results.jl --output_dir ./scripts/benchmark/results/cutest

    Instructions for reproducing our experiments

    CUTEst test set

    $ julia --project=. scripts/solve_cutest.jl --output_dir ./scripts/benchmark/results/cutest --default_problems true
    $ julia --project=. scripts/solve_cutest.jl --output_dir ./scripts/benchmark/results/cutest --default_problems true --θ 0.0
    $ julia --project=. scripts/run_ablation_study.jl --output_dir ./scripts/benchmark/results_ablation_study/cutest --default_problems true

    Examples

    Examples can be found under the test directory

    References

    Citing

    ```markdown If you use our method in your research, you are kindly asked to cite the relevant papers:

    @article{hamad2024simple, title={A simple and practical adaptive trust-region method}, author={Hamad, Fadi and Hinder, Oliver}, journal={arXiv preprint arXiv:2412.02079}, year={2024} }

    @article{hamad2022consistently, title={A consistently adaptive trust-region method}, author={Hamad, Fadi and Hinder, Oliver}, journal={Advances in Neural Information Processing Systems}, volume={35}, pages={6640–6653}, year={2022} }

    diff --git a/previews/PR3913/packages/CDCS/index.html b/previews/PR3913/packages/CDCS/index.html index d0beba106a9..5a6c6b5ca30 100644 --- a/previews/PR3913/packages/CDCS/index.html +++ b/previews/PR3913/packages/CDCS/index.html @@ -27,4 +27,4 @@ mat"cdcsInstall" end -julia> mat"savepath" +julia> mat"savepath" diff --git a/previews/PR3913/packages/CDDLib/index.html b/previews/PR3913/packages/CDDLib/index.html index 72377eb86ec..e736c660e26 100644 --- a/previews/PR3913/packages/CDDLib/index.html +++ b/previews/PR3913/packages/CDDLib/index.html @@ -6,4 +6,4 @@

    CDDLib

    CDDLib.jl is a wrapper for cddlib.

    CDDLib.jl can be used with C API of cddlib, the higher level interface of Polyhedra.jl, or as a linear programming solver with JuMP or MathOptInterface.

    Problem description

    As written in the README of cddlib:

    The C-library cddlib is a C implementation of the Double Description Method of Motzkin et al. for generating all vertices (that is, extreme points) and extreme rays of a general convex polyhedron in R^d given by a system of linear inequalities:

    P = { x=(x1, ..., xd)^T :  b - A  x  >= 0 }

    where A is a given m x d real matrix, b is a given m-vector and 0 is the m-vector of all zeros.

    The program can be used for the reverse operation (that is, convex hull computation). This means that one can move back and forth between an inequality representation and a generator (that is, vertex and ray) representation of a polyhedron with cdd. Also, cdd can solve a linear programming problem, that is, a problem of maximizing and minimizing a linear function over P.

    License

    CDDLib.jl is licensed under the GPL v2 license.

    The underlying solver, cddlib/cddlib is also licensed under the GPL v2 license.

    Installation

    Install CDDLib.jl using the Julia package manager:

    import Pkg
     Pkg.add("CDDLib")

    Building the package will download binaries of cddlib that are provided by cddlib_jll.jl.

    Use with JuMP

    Use CDDLib.Optimizer{Float64} to use CDDLib.jl with JuMP:

    using JuMP, CDDLib
     model = Model(CDDLib.Optimizer{Float64})

    When using CDDLib.jl with MathOptInterface, you can pass a different number type:

    using MathOptInterface, CDDLib
    -model = CDDLib.Optimizer{Rational{BigInt}}()

    Debugging

    CDDLib.jl uses two global Boolean variables to enable debugging outputs: debug and log.

    You can query the value of debug and log with get_debug and get_log, and set their values with set_debug and set_log.

    +model = CDDLib.Optimizer{Rational{BigInt}}()

    Debugging

    CDDLib.jl uses two global Boolean variables to enable debugging outputs: debug and log.

    You can query the value of debug and log with get_debug and get_log, and set their values with set_debug and set_log.

    diff --git a/previews/PR3913/packages/COPT/index.html b/previews/PR3913/packages/COPT/index.html index 65f2c93d1cc..7297bf5a367 100644 --- a/previews/PR3913/packages/COPT/index.html +++ b/previews/PR3913/packages/COPT/index.html @@ -39,4 +39,4 @@ @show value.(X) @show value.(z) @show shadow_price(c1) -@show shadow_price(c2) +@show shadow_price(c2) diff --git a/previews/PR3913/packages/COSMO/index.html b/previews/PR3913/packages/COSMO/index.html index b3954a146bf..aeca918fff1 100644 --- a/previews/PR3913/packages/COSMO/index.html +++ b/previews/PR3913/packages/COSMO/index.html @@ -34,4 +34,4 @@ publisher = {Springer}, doi = {10.1007/s10957-021-01896-x}, url = {https://doi.org/10.1007/s10957-021-01896-x} -}

    The article is available under Open Access here.

    Contributing

    • Contributions are always welcome. Our style guide can be found here.
    • Current issues, tasks and future ideas are listed in Issues. Please report any issues or bugs that you encounter.
    • As an open source project we are also interested in any projects and applications that use COSMO. Please let us know by opening a GitHub issue.

    Python - Interface

    COSMO can also be called from Python. Take a look at: cosmo-python

    Licence 🔍

    This project is licensed under the Apache License - see the LICENSE.md file for details.

    +}

    The article is available under Open Access here.

    Contributing

    • Contributions are always welcome. Our style guide can be found here.
    • Current issues, tasks and future ideas are listed in Issues. Please report any issues or bugs that you encounter.
    • As an open source project we are also interested in any projects and applications that use COSMO. Please let us know by opening a GitHub issue.

    Python - Interface

    COSMO can also be called from Python. Take a look at: cosmo-python

    Licence 🔍

    This project is licensed under the Apache License - see the LICENSE.md file for details.

    diff --git a/previews/PR3913/packages/CPLEX/index.html b/previews/PR3913/packages/CPLEX/index.html index 7e6e192e837..9605546ee49 100644 --- a/previews/PR3913/packages/CPLEX/index.html +++ b/previews/PR3913/packages/CPLEX/index.html @@ -163,4 +163,4 @@ x_optimal = value.(x) y_optimal = value.(y) println("x: $(x_optimal), y: $(y_optimal)") -end +end diff --git a/previews/PR3913/packages/CSDP/index.html b/previews/PR3913/packages/CSDP/index.html index 9ee692e6d94..a32652de5e0 100644 --- a/previews/PR3913/packages/CSDP/index.html +++ b/previews/PR3913/packages/CSDP/index.html @@ -10,4 +10,4 @@ A(X) = a X ⪰ 0

    where A(X) = [⟨A_1, X⟩, ..., ⟨A_m, X⟩]. The corresponding dual is:

    min ⟨a, y⟩
          A'(y) - C = Z
    -             Z ⪰ 0

    where A'(y) = y_1A_1 + ... + y_mA_m

    Termination criteria

    CSDP will terminate successfully (or partially) in the following cases:

    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied:
      • primal feasibility tolerance: ||A(x) - a||_2 / (1 + ||a||_2) < axtol
      • dual feasibility tolerance: ||A'(y) - C - Z||_F / (1 + ||C||_F) < atytol
      • relative duality gap tolerance: gap / (1 + |⟨a, y⟩| + |⟨C, X⟩|) < objtol
        • objective duality gap: if usexygap is 0, gap = ⟨a, y⟩ - ⟨C, X⟩
        • XY duality gap: if usexygap is 1, gap = ⟨Z, X⟩
      then it returns 0.
    • If CSDP finds y and Z ⪰ 0 such that -⟨a, y⟩ / ||A'(y) - Z||_F > pinftol, it returns 1 with y such that ⟨a, y⟩ = -1.
    • If CSDP finds X ⪰ 0 such that ⟨C, X⟩ / ||A(X)||_2 > dinftol, it returns 2 with X such that ⟨C, X⟩ = 1.
    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied with 1000*axtol, 1000*atytol and 1000*objtol but at least one of them is not satisfied with axtol, atytol and objtol and cannot make progress, then it returns 3.

    In addition, if the printlevel option is at least 1, the following will be printed:

    • If the return code is 1, CSDP will print ⟨a, y⟩ and ||A'(y) - Z||_F
    • If the return code is 2, CSDP will print ⟨C, X⟩ and ||A(X)||_F
    • Otherwise, CSDP will print
      • the primal/dual objective value,
      • the relative primal/dual infeasibility,
      • the objective duality gap ⟨a, y⟩ - ⟨C, X⟩ and objective relative duality gap (⟨a, y⟩ - ⟨C, X⟩) / (1 + |⟨a, y⟩| + |⟨C, X⟩|),
      • the XY duality gap ⟨Z, X⟩ and XY relative duality gap ⟨Z, X⟩ / (1 + |⟨a, y⟩| + |⟨C, X⟩|)
      • and the DIMACS error measures.

    In theory, for feasible primal and dual solutions, ⟨a, y⟩ - ⟨C, X⟩ = ⟨Z, X⟩, so the objective and XY duality gap should be equivalent. However, in practice, there are sometimes solution which satisfy primal and dual feasibility tolerances but have objective duality gap which are not close to XY duality gap. In some cases, the objective duality gap may even become negative (hence the tweakgap option). This is the reason usexygap is 1 by default.

    CSDP considers that X ⪰ 0 (resp. Z ⪰ 0) is satisfied when the Cholesky factorizations can be computed. In practice, this is somewhat more conservative than simply requiring all eigenvalues to be nonnegative.

    Status

    The table below shows how the different CSDP statuses are converted to the MathOptInterface statuses.

    CSDP codeStateDescriptionMOI status
    0SuccessSDP solvedMOI.OPTIMAL
    1SuccessThe problem is primal infeasible, and we have a certificateMOI.INFEASIBLE
    2SuccessThe problem is dual infeasible, and we have a certificateMOI.DUAL_INFEASIBLE
    3Partial SuccessA solution has been found, but full accuracy was not achievedMOI.ALMOST_OPTIMAL
    4FailureMaximum iterations reachedMOI.ITERATION_LIMIT
    5FailureStuck at edge of primal feasibilityMOI.SLOW_PROGRESS
    6FailureStuck at edge of dual infeasibilityMOI.SLOW_PROGRESS
    7FailureLack of progressMOI.SLOW_PROGRESS
    8FailureX, Z, or O was singularMOI.NUMERICAL_ERROR
    9FailureDetected NaN or Inf valuesMOI.NUMERICAL_ERROR
    + Z ⪰ 0

    where A'(y) = y_1A_1 + ... + y_mA_m

    Termination criteria

    CSDP will terminate successfully (or partially) in the following cases:

    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied:
      • primal feasibility tolerance: ||A(x) - a||_2 / (1 + ||a||_2) < axtol
      • dual feasibility tolerance: ||A'(y) - C - Z||_F / (1 + ||C||_F) < atytol
      • relative duality gap tolerance: gap / (1 + |⟨a, y⟩| + |⟨C, X⟩|) < objtol
        • objective duality gap: if usexygap is 0, gap = ⟨a, y⟩ - ⟨C, X⟩
        • XY duality gap: if usexygap is 1, gap = ⟨Z, X⟩
      then it returns 0.
    • If CSDP finds y and Z ⪰ 0 such that -⟨a, y⟩ / ||A'(y) - Z||_F > pinftol, it returns 1 with y such that ⟨a, y⟩ = -1.
    • If CSDP finds X ⪰ 0 such that ⟨C, X⟩ / ||A(X)||_2 > dinftol, it returns 2 with X such that ⟨C, X⟩ = 1.
    • If CSDP finds X, Z ⪰ 0 such that the following 3 tolerances are satisfied with 1000*axtol, 1000*atytol and 1000*objtol but at least one of them is not satisfied with axtol, atytol and objtol and cannot make progress, then it returns 3.

    In addition, if the printlevel option is at least 1, the following will be printed:

    • If the return code is 1, CSDP will print ⟨a, y⟩ and ||A'(y) - Z||_F
    • If the return code is 2, CSDP will print ⟨C, X⟩ and ||A(X)||_F
    • Otherwise, CSDP will print
      • the primal/dual objective value,
      • the relative primal/dual infeasibility,
      • the objective duality gap ⟨a, y⟩ - ⟨C, X⟩ and objective relative duality gap (⟨a, y⟩ - ⟨C, X⟩) / (1 + |⟨a, y⟩| + |⟨C, X⟩|),
      • the XY duality gap ⟨Z, X⟩ and XY relative duality gap ⟨Z, X⟩ / (1 + |⟨a, y⟩| + |⟨C, X⟩|)
      • and the DIMACS error measures.

    In theory, for feasible primal and dual solutions, ⟨a, y⟩ - ⟨C, X⟩ = ⟨Z, X⟩, so the objective and XY duality gap should be equivalent. However, in practice, there are sometimes solution which satisfy primal and dual feasibility tolerances but have objective duality gap which are not close to XY duality gap. In some cases, the objective duality gap may even become negative (hence the tweakgap option). This is the reason usexygap is 1 by default.

    CSDP considers that X ⪰ 0 (resp. Z ⪰ 0) is satisfied when the Cholesky factorizations can be computed. In practice, this is somewhat more conservative than simply requiring all eigenvalues to be nonnegative.

    Status

    The table below shows how the different CSDP statuses are converted to the MathOptInterface statuses.

    CSDP codeStateDescriptionMOI status
    0SuccessSDP solvedMOI.OPTIMAL
    1SuccessThe problem is primal infeasible, and we have a certificateMOI.INFEASIBLE
    2SuccessThe problem is dual infeasible, and we have a certificateMOI.DUAL_INFEASIBLE
    3Partial SuccessA solution has been found, but full accuracy was not achievedMOI.ALMOST_OPTIMAL
    4FailureMaximum iterations reachedMOI.ITERATION_LIMIT
    5FailureStuck at edge of primal feasibilityMOI.SLOW_PROGRESS
    6FailureStuck at edge of dual infeasibilityMOI.SLOW_PROGRESS
    7FailureLack of progressMOI.SLOW_PROGRESS
    8FailureX, Z, or O was singularMOI.NUMERICAL_ERROR
    9FailureDetected NaN or Inf valuesMOI.NUMERICAL_ERROR
    diff --git a/previews/PR3913/packages/Cbc/index.html b/previews/PR3913/packages/Cbc/index.html index f4c1c6951a5..8663f86a5fe 100644 --- a/previews/PR3913/packages/Cbc/index.html +++ b/previews/PR3913/packages/Cbc/index.html @@ -9,4 +9,4 @@ set_attribute(model, "logLevel", 1)

    MathOptInterface API

    The COIN Branch-and-Cut (Cbc) optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    List of supported optimizer attributes:

    List of supported variable attributes:

    List of supported constraint attributes:

    Options

    Options are, unfortunately, not well documented.

    The following options are likely to be the most useful:

    ParameterExampleExplanation
    seconds60.0Solution timeout limit
    logLevel2Set to 0 to disable solution output
    maxSolutions1Terminate after this many feasible solutions have been found
    maxNodes1Terminate after this many branch-and-bound nodes have been evaluated
    allowableGap0.05Terminate after optimality gap is less than this value (on an absolute scale)
    ratioGap0.05Terminate after optimality gap is smaller than this relative fraction
    threads1Set the number of threads to use for parallel branch & bound

    The complete list of parameters can be found by running the cbc executable and typing ? at the prompt.

    Start the cbc executable from Julia as follows:

    using Cbc_jll
     Cbc_jll.cbc() do exe
         run(`$(exe)`)
    -end
    +end diff --git a/previews/PR3913/packages/Clarabel/index.html b/previews/PR3913/packages/Clarabel/index.html index be3517fb858..2b49a8af07a 100644 --- a/previews/PR3913/packages/Clarabel/index.html +++ b/previews/PR3913/packages/Clarabel/index.html @@ -33,4 +33,4 @@

    eprint={2405.12762}, archivePrefix={arXiv}, primaryClass={math.OC} -}

    License 🔍

    This project is licensed under the Apache License 2.0 - see the LICENSE.md file for details.

    +}

    License 🔍

    This project is licensed under the Apache License 2.0 - see the LICENSE.md file for details.

    diff --git a/previews/PR3913/packages/Clp/index.html b/previews/PR3913/packages/Clp/index.html index a14bc10c599..bfb949b2192 100644 --- a/previews/PR3913/packages/Clp/index.html +++ b/previews/PR3913/packages/Clp/index.html @@ -7,4 +7,4 @@ Pkg.add("Clp")

    In addition to installing the Clp.jl package, this will also download and install the Clp binaries. You do not need to install Clp separately.

    To use a custom binary, read the Custom solver binaries section of the JuMP documentation.

    Use with JuMP

    To use Clp with JuMP, use Clp.Optimizer:

    using JuMP, Clp
     model = Model(Clp.Optimizer)
     set_attribute(model, "LogLevel", 1)
    -set_attribute(model, "Algorithm", 4)

    MathOptInterface API

    The Clp optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Options are, unfortunately, not well documented.

    The following options are likely to be the most useful:

    ParameterExampleExplanation
    PrimalTolerance1e-7Primal feasibility tolerance
    DualTolerance1e-7Dual feasibility tolerance
    DualObjectiveLimit1e308When using dual simplex (where the objective is monotonically changing), terminate when the objective exceeds this limit
    MaximumIterations2147483647Terminate after performing this number of simplex iterations
    MaximumSeconds-1.0Terminate after this many seconds have passed. A negative value means no time limit
    LogLevel1Set to 1, 2, 3, or 4 for increasing output. Set to 0 to disable output
    PresolveType0Set to 1 to disable presolve
    SolveType5Solution method: dual simplex (0), primal simplex (1), sprint (2), barrier with crossover (3), barrier without crossover (4), automatic (5)
    InfeasibleReturn0Set to 1 to return as soon as the problem is found to be infeasible (by default, an infeasibility proof is computed as well)
    Scaling30 -off, 1 equilibrium, 2 geometric, 3 auto, 4 dynamic(later)
    Perturbation100switch on perturbation (50), automatic (100), don't try perturbing (102)

    C API

    The C API can be accessed via Clp.Clp_XXX functions, where the names and arguments are identical to the C API.

    +set_attribute(model, "Algorithm", 4)

    MathOptInterface API

    The Clp optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Options are, unfortunately, not well documented.

    The following options are likely to be the most useful:

    ParameterExampleExplanation
    PrimalTolerance1e-7Primal feasibility tolerance
    DualTolerance1e-7Dual feasibility tolerance
    DualObjectiveLimit1e308When using dual simplex (where the objective is monotonically changing), terminate when the objective exceeds this limit
    MaximumIterations2147483647Terminate after performing this number of simplex iterations
    MaximumSeconds-1.0Terminate after this many seconds have passed. A negative value means no time limit
    LogLevel1Set to 1, 2, 3, or 4 for increasing output. Set to 0 to disable output
    PresolveType0Set to 1 to disable presolve
    SolveType5Solution method: dual simplex (0), primal simplex (1), sprint (2), barrier with crossover (3), barrier without crossover (4), automatic (5)
    InfeasibleReturn0Set to 1 to return as soon as the problem is found to be infeasible (by default, an infeasibility proof is computed as well)
    Scaling30 -off, 1 equilibrium, 2 geometric, 3 auto, 4 dynamic(later)
    Perturbation100switch on perturbation (50), automatic (100), don't try perturbing (102)

    C API

    The C API can be accessed via Clp.Clp_XXX functions, where the names and arguments are identical to the C API.

    diff --git a/previews/PR3913/packages/DAQP/index.html b/previews/PR3913/packages/DAQP/index.html index afe9b49646a..b51ad7bbf80 100644 --- a/previews/PR3913/packages/DAQP/index.html +++ b/previews/PR3913/packages/DAQP/index.html @@ -5,4 +5,4 @@ gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash});

    DAQP.jl

    DAQP.jl is a Julia wrapper for the Quadratic Programming solver DAQP.

    License

    DAQP.jl is licensed under the MIT license.

    The underlying solver, darnstrom/daqp is licensed under the MIT license.

    Installation

    Install DAQP.jl using the Julia package manager:

    import Pkg
     Pkg.add("DAQP")

    Use with JuMP

    To use DAQP with JuMP, do:

    using JuMP, DAQP
    -model = Model(DAQP.Optimizer)

    Documentation

    General information about the solver is available at https://darnstrom.github.io/daqp/, and specifics for the Julia interface are available at https://darnstrom.github.io/daqp/start/julia.

    +model = Model(DAQP.Optimizer)

    Documentation

    General information about the solver is available at https://darnstrom.github.io/daqp/, and specifics for the Julia interface are available at https://darnstrom.github.io/daqp/start/julia.

    diff --git a/previews/PR3913/packages/DSDP/index.html b/previews/PR3913/packages/DSDP/index.html index e345e98244f..4f9c3ff12ad 100644 --- a/previews/PR3913/packages/DSDP/index.html +++ b/previews/PR3913/packages/DSDP/index.html @@ -8,4 +8,4 @@ model = Model(DSDP.Optimizer)

    MathOptInterface API

    The DSDP optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Compile your own binaries

    In order to compile your own libdsdp.so to be used of DSDP.jl, use the following

    OB_DIR=$(julia --project=. -e 'import OpenBLAS32_jll; println(OpenBLAS32_jll.OpenBLAS32_jll.artifact_dir)')
     OB="-L${LIBOB_DIR}/lib -lopenblas"
     make DSDPCFLAGS="-g -Wall -fPIC -DPIC" LAPACKBLAS="$OB" dsdplibrary
    -make DSDPCFLAGS="-g -Wall -fPIC -DPIC" LAPACKBLAS="$OB" SH_LD="${CC} ${CFLAGS} -Wall -fPIC -DPIC -shared $OB" oshared
    +make DSDPCFLAGS="-g -Wall -fPIC -DPIC" LAPACKBLAS="$OB" SH_LD="${CC} ${CFLAGS} -Wall -fPIC -DPIC -shared $OB" oshared diff --git a/previews/PR3913/packages/DiffOpt/index.html b/previews/PR3913/packages/DiffOpt/index.html index 008fb5ae82a..9ac05557f8a 100644 --- a/previews/PR3913/packages/DiffOpt/index.html +++ b/previews/PR3913/packages/DiffOpt/index.html @@ -20,4 +20,4 @@ # fetch the gradients grad_exp = MOI.get(model, DiffOpt.ReverseConstraintFunction(), cons) # -3 x - 1 constant(grad_exp) # -1 -coefficient(grad_exp, x) # -3

    GSOC2020

    DiffOpt began as a NumFOCUS sponsored Google Summer of Code (2020) project

    +coefficient(grad_exp, x) # -3

    GSOC2020

    DiffOpt began as a NumFOCUS sponsored Google Summer of Code (2020) project

    diff --git a/previews/PR3913/packages/DisjunctiveProgramming/index.html b/previews/PR3913/packages/DisjunctiveProgramming/index.html index 7458c8aa139..ae4e4ddabb8 100644 --- a/previews/PR3913/packages/DisjunctiveProgramming/index.html +++ b/previews/PR3913/packages/DisjunctiveProgramming/index.html @@ -8,4 +8,4 @@ author={Perez, Hector D and Joshi, Shivank and Grossmann, Ignacio E}, journal={arXiv preprint arXiv:2304.10492}, year={2023} -} +} diff --git a/previews/PR3913/packages/Dualization/index.html b/previews/PR3913/packages/Dualization/index.html index c8cab0acc1b..9a38259b4d2 100644 --- a/previews/PR3913/packages/Dualization/index.html +++ b/previews/PR3913/packages/Dualization/index.html @@ -10,4 +10,4 @@ dual_model = dualize(model)

    To solve the dual formulation of a JuMP model, create a dual_optimizer:

    using JuMP, Dualization, SCS
     model = Model(dual_optimizer(SCS.Optimizer))
     # ... build model ...
    -optimize!(model)  # Solves the dual instead of the primal

    Documentation

    The documentation for Dualization.jl includes a detailed description of the dual reformulation, along with examples and an API reference.

    +optimize!(model) # Solves the dual instead of the primal

    Documentation

    The documentation for Dualization.jl includes a detailed description of the dual reformulation, along with examples and an API reference.

    diff --git a/previews/PR3913/packages/EAGO/index.html b/previews/PR3913/packages/EAGO/index.html index d60b0ad0b11..6c46ed4b51a 100644 --- a/previews/PR3913/packages/EAGO/index.html +++ b/previews/PR3913/packages/EAGO/index.html @@ -71,4 +71,4 @@ doi = {10.1080/10556788.2020.1786566}, URL = {https://doi.org/10.1080/10556788.2020.1786566}, eprint = {https://doi.org/10.1080/10556788.2020.1786566} -}

    References

    1. Mitsos, A., Chachuat, B., and Barton, P.I. McCormick-based relaxations of algorithms. SIAM Journal on Optimization. 20(2): 573—601 (2009).
    2. Khan, K.A., Watson, H.A.J., and Barton, P.I. Differentiable McCormick relaxations. Journal of Global Optimization. 67(4): 687—729 (2017).
    3. Stuber, M.D., Scott, J.K., and Barton, P.I.: Convex and concave relaxations of implicit functions. Optimization Methods and Software 30(3): 424—460 (2015).
    4. Wechsung, A., Scott, J.K., Watson, H.A.J., and Barton, P.I. Reverse propagation of McCormick relaxations. Journal of Global Optimization 63(1): 1—36 (2015).
    5. Bracken, J., and McCormick, G.P. Selected Applications of Nonlinear Programming. John Wiley and Sons, New York (1968).
    +}

    References

    1. Mitsos, A., Chachuat, B., and Barton, P.I. McCormick-based relaxations of algorithms. SIAM Journal on Optimization. 20(2): 573—601 (2009).
    2. Khan, K.A., Watson, H.A.J., and Barton, P.I. Differentiable McCormick relaxations. Journal of Global Optimization. 67(4): 687—729 (2017).
    3. Stuber, M.D., Scott, J.K., and Barton, P.I.: Convex and concave relaxations of implicit functions. Optimization Methods and Software 30(3): 424—460 (2015).
    4. Wechsung, A., Scott, J.K., Watson, H.A.J., and Barton, P.I. Reverse propagation of McCormick relaxations. Journal of Global Optimization 63(1): 1—36 (2015).
    5. Bracken, J., and McCormick, G.P. Selected Applications of Nonlinear Programming. John Wiley and Sons, New York (1968).
    diff --git a/previews/PR3913/packages/ECOS/index.html b/previews/PR3913/packages/ECOS/index.html index d2106001885..0816afb8707 100644 --- a/previews/PR3913/packages/ECOS/index.html +++ b/previews/PR3913/packages/ECOS/index.html @@ -6,4 +6,4 @@

    ECOS.jl

    Build Status codecov

    ECOS.jl is a wrapper for the ECOS solver.

    The wrapper has two components:

    Affiliation

    This wrapper is maintained by the JuMP community and is not a product of Embotech AG.

    License

    ECOS.jl is licensed under the MIT License.

    The underlying solver, embotech/ecos, is licensed under the GPL v3 license.

    Installation

    Install ECOS.jl using Pkg.add:

    import Pkg
     Pkg.add("ECOS")

    In addition to installing the ECOS.jl package, this will also download and install the ECOS binaries. You do not need to install ECOS separately.

    To use a custom binary, read the Custom solver binaries section of the JuMP documentation.

    Use with JuMP

    To use ECOS with JuMP, use ECOS.Optimizer:

    using JuMP, ECOS
     model = Model(ECOS.Optimizer)
    -set_attribute(model, "maxit", 100)

    MathOptInterface API

    The ECOS optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    The following options are supported:

    ParameterExplanation
    gammascaling the final step length
    deltaregularization parameter
    epsregularization threshold
    feastolprimal/dual infeasibility tolerance
    abstolabsolute tolerance on duality gap
    reltolrelative tolerance on duality gap
    feastol_inaccprimal/dual infeasibility relaxed tolerance
    abstol_inaccabsolute relaxed tolerance on duality gap
    reltol_inaccrelative relaxed tolerance on duality gap
    nitrefnumber of iterative refinement steps
    maxitmaximum number of iterations
    verboseverbosity bool for PRINTLEVEL < 3
    +set_attribute(model, "maxit", 100)

    MathOptInterface API

    The ECOS optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    The following options are supported:

    ParameterExplanation
    gammascaling the final step length
    deltaregularization parameter
    epsregularization threshold
    feastolprimal/dual infeasibility tolerance
    abstolabsolute tolerance on duality gap
    reltolrelative tolerance on duality gap
    feastol_inaccprimal/dual infeasibility relaxed tolerance
    abstol_inaccabsolute relaxed tolerance on duality gap
    reltol_inaccrelative relaxed tolerance on duality gap
    nitrefnumber of iterative refinement steps
    maxitmaximum number of iterations
    verboseverbosity bool for PRINTLEVEL < 3
    diff --git a/previews/PR3913/packages/GAMS/index.html b/previews/PR3913/packages/GAMS/index.html index 618f8ef2bcb..387d708ed9e 100644 --- a/previews/PR3913/packages/GAMS/index.html +++ b/previews/PR3913/packages/GAMS/index.html @@ -22,4 +22,4 @@ MOI.get(model, GAMS.GeneratedConstraintName(), c[2]) # returns eq2 MOI.get(model, GAMS.OriginalConstraintName("eq1")) # returns c[1] -MOI.get(model, GAMS.OriginalConstraintName("eq10")) # returns nothing

    Note that JuMP direct-mode is used.

    +MOI.get(model, GAMS.OriginalConstraintName("eq10")) # returns nothing

    Note that JuMP direct-mode is used.

    diff --git a/previews/PR3913/packages/GLPK/index.html b/previews/PR3913/packages/GLPK/index.html index 3e29faf6b6d..c78eb58b432 100644 --- a/previews/PR3913/packages/GLPK/index.html +++ b/previews/PR3913/packages/GLPK/index.html @@ -36,4 +36,4 @@ @test primal_status(model) == MOI.FEASIBLE_POINT @test value(x) == 1 @test value(y) == 2 -@show reasons

    C API

    The C API can be accessed via GLPK.glp_XXX functions, where the names and arguments are identical to the C API. See the /tests folder for inspiration.

    Thread safety

    GLPK is not thread-safe and should not be used with multithreading.

    +@show reasons

    C API

    The C API can be accessed via GLPK.glp_XXX functions, where the names and arguments are identical to the C API. See the /tests folder for inspiration.

    Thread safety

    GLPK is not thread-safe and should not be used with multithreading.

    diff --git a/previews/PR3913/packages/Gurobi/index.html b/previews/PR3913/packages/Gurobi/index.html index c8bdf9a70ce..b986d91e8bf 100644 --- a/previews/PR3913/packages/Gurobi/index.html +++ b/previews/PR3913/packages/Gurobi/index.html @@ -175,4 +175,4 @@ println(lower_bound(x[i])) end

    Common errors

    Using Gurobi v9.0 and you got an error like Q not PSD?

    You need to set the NonConvex parameter:

    model = Model(Gurobi.Optimizer)
     set_optimizer_attribute(model, "NonConvex", 2)

    Gurobi Error 1009: Version number is XX.X, license is for version XX.X

    Make sure that your license is correct for your Gurobi version. See the Gurobi documentation for details.

    Once you are sure that the license and Gurobi versions match, re-install Gurobi.jl by running:

    import Pkg
    -Pkg.build("Gurobi")
    +Pkg.build("Gurobi") diff --git a/previews/PR3913/packages/HiGHS/index.html b/previews/PR3913/packages/HiGHS/index.html index 7686bb59820..8c63e41ac88 100644 --- a/previews/PR3913/packages/HiGHS/index.html +++ b/previews/PR3913/packages/HiGHS/index.html @@ -11,4 +11,4 @@ set_attribute(model, "time_limit", 60.0)

    MathOptInterface API

    The HiGHS optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    See the HiGHS documentation for a full list of the available options.

    C API

    The C API can be accessed via HiGHS.Highs_xxx functions, where the names and arguments are identical to the C API.

    Threads

    HiGHS uses a global scheduler that is shared between threads.

    Before changing the number of threads using MOI.Threads(), you must call Highs_resetGlobalScheduler(1):

    using JuMP, HiGHS
     model = Model(HiGHS.Optimizer)
     Highs_resetGlobalScheduler(1)
    -set_attribute(model, MOI.NumberOfThreads(), 1)

    If modifying the number of HiGHS threads across different Julia threads, be sure to read the docstring of Highs_resetGlobalScheduler. In particular, resetting the scheduler is not thread-safe.

    +set_attribute(model, MOI.NumberOfThreads(), 1)

    If modifying the number of HiGHS threads across different Julia threads, be sure to read the docstring of Highs_resetGlobalScheduler. In particular, resetting the scheduler is not thread-safe.

    diff --git a/previews/PR3913/packages/Hypatia/index.html b/previews/PR3913/packages/Hypatia/index.html index 72617fea7a3..711fc1c6739 100644 --- a/previews/PR3913/packages/Hypatia/index.html +++ b/previews/PR3913/packages/Hypatia/index.html @@ -42,4 +42,4 @@ volume={15}, pages={53--101}, doi={https://doi.org/10.1007/s12532-022-00226-0} -} +} diff --git a/previews/PR3913/packages/InfiniteOpt/index.html b/previews/PR3913/packages/InfiniteOpt/index.html index 67e843b3b8f..6bb8dd3f6f1 100644 --- a/previews/PR3913/packages/InfiniteOpt/index.html +++ b/previews/PR3913/packages/InfiniteOpt/index.html @@ -12,4 +12,4 @@ doi = {https://doi.org/10.1016/j.compchemeng.2021.107567}, url = {https://www.sciencedirect.com/science/article/pii/S0098135421003458}, author = {Joshua L. Pulsipher and Weiqi Zhang and Tyler J. Hongisto and Victor M. Zavala}, -}

    A pre-print version is freely available though arXiv.

    +}

    A pre-print version is freely available though arXiv.

    diff --git a/previews/PR3913/packages/Ipopt/index.html b/previews/PR3913/packages/Ipopt/index.html index bf798337417..3327d37da00 100644 --- a/previews/PR3913/packages/Ipopt/index.html +++ b/previews/PR3913/packages/Ipopt/index.html @@ -124,4 +124,4 @@ LinearAlgebra.BLAS.lbt_forward(liblapack32) using Ipopt

    AppleAccelerate

    If you are using macOS ≥ v13.4 and you have AppleAccelerate.jl installed, add using AppleAccelerate to your code:

    using AppleAccelerate
     using Ipopt

    Display backends

    Check what backends are loaded using:

    import LinearAlgebra
    -LinearAlgebra.BLAS.lbt_get_config()
    +LinearAlgebra.BLAS.lbt_get_config() diff --git a/previews/PR3913/packages/Juniper/index.html b/previews/PR3913/packages/Juniper/index.html index 5e34b370295..8554bcc81c9 100644 --- a/previews/PR3913/packages/Juniper/index.html +++ b/previews/PR3913/packages/Juniper/index.html @@ -33,4 +33,4 @@ year="2018", publisher="Springer International Publishing", isbn="978-3-319-93031-2" -} +} diff --git a/previews/PR3913/packages/KNITRO/index.html b/previews/PR3913/packages/KNITRO/index.html index 300c67bde49..a7b080fc706 100644 --- a/previews/PR3913/packages/KNITRO/index.html +++ b/previews/PR3913/packages/KNITRO/index.html @@ -10,4 +10,4 @@ set_attribute(model, "algorithm", 4)

    Use with AMPL

    To use KNITRO with AmplNLWriter.jl, use KNITRO.amplexe:

    using JuMP
     import AmplNLWriter
     import KNITRO
    -model = Model(() -> AmplNLWriter.Optimizer(KNITRO.amplexe, ["outlev=3"]))

    Use with other packages

    A variety of packages extend KNITRO.jl to support other optimization modeling systems. These include:

    MathOptInterface API

    The Knitro optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    A list of available options is provided in the KNITRO reference manual.

    Low-level wrapper

    The complete C API can be accessed via KNITRO.KN_xx functions, where the names and arguments are identical to the C API.

    See the KNITRO documentation for details.

    As general rules when converting from Julia to C:

    • When KNITRO requires a Ptr{T} that holds one element, like double *, use a Ref{T}().
    • When KNITRO requires a Ptr{T} that holds multiple elements, use a Vector{T}.
    • When KNITRO requires a double, use Cdouble
    • When KNITRO requires an int, use Cint
    • When KNITRO requires a NULL, use C_NULL

    Extensive examples using the C wrapper can be found in examples/.

    Breaking changes

    KNITRO.jl v0.14.0 introduced a number of breaking changes to the low-level C API. The main changes were:

    1. removing Julia-specific functions like KN_set_param. Use the C API functions like KN_set_int_param and KN_set_double_param_by_name.
    2. removing intermediate methods that tried to make the C API more Julia-like. For example, we have removed the KN_add_var method that returned the index of the variable. There is now only the method from the C API.

    If you have trouble updating, please open a GitHub issue.

    Multi-threading

    Due to limitations in the interaction between Julia and C, KNITRO.jl disables multi-threading if the problem is nonlinear. This will override any options such as par_numthreads that you may have set.

    If you are using the low-level API, opt-in to enable multi-threading by calling KN_solve(model.env) instead of KN_solve(model), where model is the value returned by model = KN_new(). Note that calling KN_solve(model.env) is an advanced operation because it requires all callbacks you provide to be threadsafe.

    Read GitHub issue #93 for more details.

    +model = Model(() -> AmplNLWriter.Optimizer(KNITRO.amplexe, ["outlev=3"]))

    Use with other packages

    A variety of packages extend KNITRO.jl to support other optimization modeling systems. These include:

    MathOptInterface API

    The Knitro optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    A list of available options is provided in the KNITRO reference manual.

    Low-level wrapper

    The complete C API can be accessed via KNITRO.KN_xx functions, where the names and arguments are identical to the C API.

    See the KNITRO documentation for details.

    As general rules when converting from Julia to C:

    • When KNITRO requires a Ptr{T} that holds one element, like double *, use a Ref{T}().
    • When KNITRO requires a Ptr{T} that holds multiple elements, use a Vector{T}.
    • When KNITRO requires a double, use Cdouble
    • When KNITRO requires an int, use Cint
    • When KNITRO requires a NULL, use C_NULL

    Extensive examples using the C wrapper can be found in examples/.

    Breaking changes

    KNITRO.jl v0.14.0 introduced a number of breaking changes to the low-level C API. The main changes were:

    1. removing Julia-specific functions like KN_set_param. Use the C API functions like KN_set_int_param and KN_set_double_param_by_name.
    2. removing intermediate methods that tried to make the C API more Julia-like. For example, we have removed the KN_add_var method that returned the index of the variable. There is now only the method from the C API.

    If you have trouble updating, please open a GitHub issue.

    Multi-threading

    Due to limitations in the interaction between Julia and C, KNITRO.jl disables multi-threading if the problem is nonlinear. This will override any options such as par_numthreads that you may have set.

    If you are using the low-level API, opt-in to enable multi-threading by calling KN_solve(model.env) instead of KN_solve(model), where model is the value returned by model = KN_new(). Note that calling KN_solve(model.env) is an advanced operation because it requires all callbacks you provide to be threadsafe.

    Read GitHub issue #93 for more details.

    diff --git a/previews/PR3913/packages/Loraine/index.html b/previews/PR3913/packages/Loraine/index.html index 8343706af12..cf0e85c3700 100644 --- a/previews/PR3913/packages/Loraine/index.html +++ b/previews/PR3913/packages/Loraine/index.html @@ -37,4 +37,4 @@ www={https://hal.science/hal-04076509/} note={Preprint hal-04076509} year={2023} -}
    • 1https://www.youtube.com/watch?v=0D2wNf1lVrI
    +}
    • 1https://www.youtube.com/watch?v=0D2wNf1lVrI
    diff --git a/previews/PR3913/packages/MAiNGO/index.html b/previews/PR3913/packages/MAiNGO/index.html index 019e16e508a..bb4d90c7442 100644 --- a/previews/PR3913/packages/MAiNGO/index.html +++ b/previews/PR3913/packages/MAiNGO/index.html @@ -94,4 +94,4 @@ findMAiNGO(preferred=MAiNGO.C_API) # switch back to MAiNGO_jll findMAiNGO(preferred=MAiNGO.MAINGO_JLL)

    The findMAiNGO() function takes several optional arguments, which can be passed as keyword-arguments:

    • verbose: boolean, whether or not progress on finding MAiNGO is reported. (Default value: false)
    • preferred: either MAiNGO.MAINGOJLL or MAiNGO.CAPI, determines whether jll binaries or custom installation of MAiNGO is preferred. Note that the C-API is always preferred to the standalone version. If a custom standalone version should be used, set this value to C-API and pass an empty string as the capi argument (see next). (Default value: MAINGOJLL)
    • capi: string, path to C-API file. If set, this overrides the environment variable MAINGOLIB.
    • standalone: string, path to standalone executable file. If set, this overrides the environment variable MAINGO_EXEC.

    For example, to use the C-API at a new location, one could call:

    using MAiNGO
    -findMAiNGO(preferred=MAiNGO.C_API, c_api="path\\to\\c\\api\\shared_parser.dll")

    Currently working:

    • Integer and binary variables.
    • Affine, Quadratic and nonlinear constraints and objectives.
    • Operations: min,max,*,/,+,-,-(unary), exp,log,abs,sqrt,^
      • Other operations are easy to add if supported by MathOptInterface,ALE and MAiNGO.
    • Writing problem defined in JuMP syntax to an ALE problem.txt and calling MAiNGO.exe on a specified path.
    • Alternatively using a C-API to call MAiNGO.

    Restrictions compared to using the Python or C++ interface

    It is assumed that all variables are bounded. This interface assumes that integer variables are bounded between -1e6 and 1e6. For real variables these bounds are -1e8 and 1e8.

    Other functionality such as special support for growing datasets or MPI parallelization is not currently supported via this wrapper. Additionally, constraint formulations are simply passed from their representation in JuMP/MathOptInterface to MAiNGO. As such, there is no way to make use of advanced techniques such as defining constraints that are only used for the relaxations, using special relaxations for functions used in thermodynamics and process engineering or formulating reduced space formulations.

    Tests

    A subset of test cases for MathOptInterface solvers can be run by running the script ./test/runtests.jl. The current release was tested in the following combinations:

    • Julia 1.8.5 and MathOptInterface v1.18.0
    • Julia 1.9.4 and MathOptInterface v1.23.0.
    +findMAiNGO(preferred=MAiNGO.C_API, c_api="path\\to\\c\\api\\shared_parser.dll")

    Currently working:

    • Integer and binary variables.
    • Affine, Quadratic and nonlinear constraints and objectives.
    • Operations: min,max,*,/,+,-,-(unary), exp,log,abs,sqrt,^
      • Other operations are easy to add if supported by MathOptInterface,ALE and MAiNGO.
    • Writing problem defined in JuMP syntax to an ALE problem.txt and calling MAiNGO.exe on a specified path.
    • Alternatively using a C-API to call MAiNGO.

    Restrictions compared to using the Python or C++ interface

    It is assumed that all variables are bounded. This interface assumes that integer variables are bounded between -1e6 and 1e6. For real variables these bounds are -1e8 and 1e8.

    Other functionality such as special support for growing datasets or MPI parallelization is not currently supported via this wrapper. Additionally, constraint formulations are simply passed from their representation in JuMP/MathOptInterface to MAiNGO. As such, there is no way to make use of advanced techniques such as defining constraints that are only used for the relaxations, using special relaxations for functions used in thermodynamics and process engineering or formulating reduced space formulations.

    Tests

    A subset of test cases for MathOptInterface solvers can be run by running the script ./test/runtests.jl. The current release was tested in the following combinations:

    • Julia 1.8.5 and MathOptInterface v1.18.0
    • Julia 1.9.4 and MathOptInterface v1.23.0.
    diff --git a/previews/PR3913/packages/MadNLP/index.html b/previews/PR3913/packages/MadNLP/index.html index 148ea830869..00910035e50 100644 --- a/previews/PR3913/packages/MadNLP/index.html +++ b/previews/PR3913/packages/MadNLP/index.html @@ -43,4 +43,4 @@ author={Shin, Sungho and Coffrin, Carleton and Sundar, Kaarthik and Zavala, Victor M}, journal={arXiv preprint arXiv:2010.02404}, year={2020} -}

    Supporting MadNLP.jl

    +}

    Supporting MadNLP.jl

    diff --git a/previews/PR3913/packages/Manopt/index.html b/previews/PR3913/packages/Manopt/index.html index cbcd04cfa1a..980a66039bc 100644 --- a/previews/PR3913/packages/Manopt/index.html +++ b/previews/PR3913/packages/Manopt/index.html @@ -30,4 +30,4 @@ TITLE = {Manifolds.jl: An Extensible Julia Framework for Data Analysis on Manifolds}, VOLUME = {49}, YEAR = {2023} -}

    as well. Note that all citations are in BibLaTeX format.

    Manopt.jl belongs to the Manopt family:

    Did you use Manopt.jl somewhere? Let us know! We'd love to collect those here as well.

    +}

    as well. Note that all citations are in BibLaTeX format.

    Manopt.jl belongs to the Manopt family:

    Did you use Manopt.jl somewhere? Let us know! We'd love to collect those here as well.

    diff --git a/previews/PR3913/packages/MathOptAI/index.html b/previews/PR3913/packages/MathOptAI/index.html index 18e33684cc0..5a1cd7b3962 100644 --- a/previews/PR3913/packages/MathOptAI/index.html +++ b/previews/PR3913/packages/MathOptAI/index.html @@ -31,4 +31,4 @@ moai_SoftMax[7] moai_SoftMax[8] moai_SoftMax[9] - moai_SoftMax[10]

    Documentation

    Documentation is available at https://lanl-ansi.github.io/MathOptAI.jl.

    Getting help

    For help, questions, comments, and suggestions, please open a GitHub issue.

    Inspiration

    This project is mainly inspired by two existing projects:

    Other works, from which we took less inspiration, include:

    The 2024 paper of López-Flores et al. is an excellent summary of the state of the field at the time that we started development of MathOptAI.

    López-Flores, F.J., Ramírez-Márquez, C., Ponce-Ortega J.M. (2024). Process Systems Engineering Tools for Optimization of Trained Machine Learning Models: Comparative and Perspective. Industrial & Engineering Chemistry Research, 63(32), 13966-13979. DOI: 10.1021/acs.iecr.4c00632

    + moai_SoftMax[10]

    Documentation

    Documentation is available at https://lanl-ansi.github.io/MathOptAI.jl.

    Getting help

    For help, questions, comments, and suggestions, please open a GitHub issue.

    Inspiration

    This project is mainly inspired by two existing projects:

    Other works, from which we took less inspiration, include:

    The 2024 paper of López-Flores et al. is an excellent summary of the state of the field at the time that we started development of MathOptAI.

    López-Flores, F.J., Ramírez-Márquez, C., Ponce-Ortega J.M. (2024). Process Systems Engineering Tools for Optimization of Trained Machine Learning Models: Comparative and Perspective. Industrial & Engineering Chemistry Research, 63(32), 13966-13979. DOI: 10.1021/acs.iecr.4c00632

    diff --git a/previews/PR3913/packages/MathOptSymbolicAD/index.html b/previews/PR3913/packages/MathOptSymbolicAD/index.html index 27b9adbc989..ddc9e081bce 100644 --- a/previews/PR3913/packages/MathOptSymbolicAD/index.html +++ b/previews/PR3913/packages/MathOptSymbolicAD/index.html @@ -18,4 +18,4 @@ optimize!(model)

    Background

    MathOptSymbolicAD is inspired by Hassan Hijazi's work on coin-or/gravity, a high-performance algebraic modeling language in C++.

    Hassan made the following observations:

    • For large scale models, symbolic differentiation is slower than other automatic differentiation techniques.
    • However, most large-scale nonlinear programs have a lot of structure.
    • Gravity asks the user to provide structure in the form of template constraints, where the user gives the symbolic form of the constraint as well as a set of data to convert from a symbolic form to the numerical form.
    • Instead of differentiating each constraint in its numerical form, we can compute one symbolic derivative of the constraint in symbolic form, and then plug in the data in to get the numerical derivative of each function.
    • As a final step, if users don't provide the structure, we can still infer it –perhaps with less accuracy–by comparing the expression tree of each constraint.

    The symbolic differentiation approach of Gravity works well when the problem is large with few unique constraints. For example, a model like:

    model = Model()
     @variable(model, 0 <= x[1:10_000] <= 1)
     @constraint(model, [i=1:10_000], sin(x[i]) <= 1)
    -@objective(model, Max, sum(x))

    is ideal, because although the Jacobian matrix has 10,000 rows, we can compute the derivative of sin(x[i]) as cos(x[i]), and then fill in the Jacobian by evaluating the derivative function instead of having to differentiation 10,000 expressions.

    The symbolic differentiation approach of Gravity works poorly if there are a large number of unique constraints in the model (which would require a lot of expressions to be symbolically differentiated), or if the nonlinear functions contain a large number of nonlinear terms (which would make the symbolic derivative expensive to compute).

    For more details, see Oscar's JuMP-dev 2022 talk, although note that the syntax has changed since the original recording.

    +@objective(model, Max, sum(x))

    is ideal, because although the Jacobian matrix has 10,000 rows, we can compute the derivative of sin(x[i]) as cos(x[i]), and then fill in the Jacobian by evaluating the derivative function instead of having to differentiation 10,000 expressions.

    The symbolic differentiation approach of Gravity works poorly if there are a large number of unique constraints in the model (which would require a lot of expressions to be symbolically differentiated), or if the nonlinear functions contain a large number of nonlinear terms (which would make the symbolic derivative expensive to compute).

    For more details, see Oscar's JuMP-dev 2022 talk, although note that the syntax has changed since the original recording.

    diff --git a/previews/PR3913/packages/MiniZinc/index.html b/previews/PR3913/packages/MiniZinc/index.html index 64efceac077..2582942b309 100644 --- a/previews/PR3913/packages/MiniZinc/index.html +++ b/previews/PR3913/packages/MiniZinc/index.html @@ -53,4 +53,4 @@ @constraint(model, x in MOI.AllDifferent(3)) @objective(model, Max, sum(i * x[i] for i in 1:3)) optimize!(model) -@show value.(x)

    MathOptInterface API

    The MiniZinc Optimizer{T} supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Set options using MOI.RawOptimizerAttribute in MOI or set_attribute in JuMP.

    MiniZinc.jl supports the following options:

    • model_filename::String = "": the location at which to write out the .mzn file during optimization. This option can be helpful during debugging. If left empty, a temporary file will be used instead.

    • MOI.SolutionLimit: set this option to a positive integer to return up to the limit number of solutions.

    +@show value.(x)

    MathOptInterface API

    The MiniZinc Optimizer{T} supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Options

    Set options using MOI.RawOptimizerAttribute in MOI or set_attribute in JuMP.

    MiniZinc.jl supports the following options:

    • model_filename::String = "": the location at which to write out the .mzn file during optimization. This option can be helpful during debugging. If left empty, a temporary file will be used instead.

    • MOI.SolutionLimit: set this option to a positive integer to return up to the limit number of solutions.

    diff --git a/previews/PR3913/packages/MosekTools/index.html b/previews/PR3913/packages/MosekTools/index.html index 12291fc50c5..99b82966fa9 100644 --- a/previews/PR3913/packages/MosekTools/index.html +++ b/previews/PR3913/packages/MosekTools/index.html @@ -7,4 +7,4 @@ using MosekTools model = Model(Mosek.Optimizer) set_attribute(model, "QUIET", true) -set_attribute(model, "INTPNT_CO_TOL_DFEAS", 1e-7)

    Options

    The parameter QUIET is a special parameter that when set to true disables all Mosek printing output.

    All other parameters can be found in the Mosek documentation.

    Note that the prefix MSK_IPAR_ (for integer parameters), MSK_DPAR_ (for floating point parameters) or MSK_SPAR_ (for string parameters) are optional. If they are not given, they are inferred from the type of the value. For example, in the example above, as 1e-7 is a floating point number, the parameters name used is MSK_DPAR_INTPNT_CO_TOL_DFEAS.

    +set_attribute(model, "INTPNT_CO_TOL_DFEAS", 1e-7)

    Options

    The parameter QUIET is a special parameter that when set to true disables all Mosek printing output.

    All other parameters can be found in the Mosek documentation.

    Note that the prefix MSK_IPAR_ (for integer parameters), MSK_DPAR_ (for floating point parameters) or MSK_SPAR_ (for string parameters) are optional. If they are not given, they are inferred from the type of the value. For example, in the example above, as 1e-7 is a floating point number, the parameters name used is MSK_DPAR_INTPNT_CO_TOL_DFEAS.

    diff --git a/previews/PR3913/packages/MultiObjectiveAlgorithms/index.html b/previews/PR3913/packages/MultiObjectiveAlgorithms/index.html index 85618b3e444..fd795b53727 100644 --- a/previews/PR3913/packages/MultiObjectiveAlgorithms/index.html +++ b/previews/PR3913/packages/MultiObjectiveAlgorithms/index.html @@ -9,4 +9,4 @@ import MultiObjectiveAlgorithms as MOA model = JuMP.Model(() -> MOA.Optimizer(HiGHS.Optimizer)) set_attribute(model, MOA.Algorithm(), MOA.Dichotomy()) -set_attribute(model, MOA.SolutionLimit(), 4)

    Replace HiGHS.Optimizer with an optimizer capable of solving a single-objective instance of your optimization problem.

    You may set additional optimizer attributes, the supported attributes depend on the choice of solution algorithm.

    Algorithm

    Set the algorithm using the MOA.Algorithm() attribute.

    The value must be one of the algorithms supported by MOA:

    • MOA.Chalmet()
    • MOA.Dichotomy()
    • MOA.DominguezRios()
    • MOA.EpsilonConstraint()
    • MOA.Hierarchical()
    • MOA.KirlikSayin()
    • MOA.Lexicographic() [default]
    • MOA.TambyVanderpooten()

    Consult their docstrings for details.

    Other optimizer attributes

    There are a number of optimizer attributes supported by the algorithms in MOA.

    Each algorithm supports only a subset of the attributes. Consult the algorithm's docstring for details on which attributes it supports, and how it uses them in the solution process.

    • MOA.EpsilonConstraintStep()
    • MOA.LexicographicAllPermutations()
    • MOA.ObjectiveAbsoluteTolerance(index::Int)
    • MOA.ObjectivePriority(index::Int)
    • MOA.ObjectiveRelativeTolerance(index::Int)
    • MOA.ObjectiveWeight(index::Int)
    • MOA.SolutionLimit()
    • MOI.TimeLimitSec()
    +set_attribute(model, MOA.SolutionLimit(), 4)

    Replace HiGHS.Optimizer with an optimizer capable of solving a single-objective instance of your optimization problem.

    You may set additional optimizer attributes, the supported attributes depend on the choice of solution algorithm.

    Algorithm

    Set the algorithm using the MOA.Algorithm() attribute.

    The value must be one of the algorithms supported by MOA:

    • MOA.Chalmet()
    • MOA.Dichotomy()
    • MOA.DominguezRios()
    • MOA.EpsilonConstraint()
    • MOA.Hierarchical()
    • MOA.KirlikSayin()
    • MOA.Lexicographic() [default]
    • MOA.TambyVanderpooten()

    Consult their docstrings for details.

    Other optimizer attributes

    There are a number of optimizer attributes supported by the algorithms in MOA.

    Each algorithm supports only a subset of the attributes. Consult the algorithm's docstring for details on which attributes it supports, and how it uses them in the solution process.

    • MOA.EpsilonConstraintStep()
    • MOA.LexicographicAllPermutations()
    • MOA.ObjectiveAbsoluteTolerance(index::Int)
    • MOA.ObjectivePriority(index::Int)
    • MOA.ObjectiveRelativeTolerance(index::Int)
    • MOA.ObjectiveWeight(index::Int)
    • MOA.SolutionLimit()
    • MOI.TimeLimitSec()
    diff --git a/previews/PR3913/packages/NEOSServer/index.html b/previews/PR3913/packages/NEOSServer/index.html index b855886ffcf..1ac336ef687 100644 --- a/previews/PR3913/packages/NEOSServer/index.html +++ b/previews/PR3913/packages/NEOSServer/index.html @@ -27,4 +27,4 @@ results = neos_getFinalResults(server, job)

    Use with JuMP

    Use NEOSServer.jl with JuMP as follows:

    using JuMP, NEOSServer
     model = Model() do
         return NEOSServer.Optimizer(; email = "me@mydomain.com", solver = "Ipopt")
    -end

    Note: NEOSServer.Optimizer is limited to the following solvers:

    • "CPLEX"
    • "FICO-Xpress"
    • "Ipopt"
    • "Knitro"
    • "MOSEK"
    • "OCTERACT"
    • "SNOPT"

    NEOS Limits

    NEOS currently limits jobs to an 8 hour time limit, 3 GB of memory, and a 16 MB submission file. If your model exceeds these limits, NEOSServer.jl may be unable to return useful information to the user.

    +end

    Note: NEOSServer.Optimizer is limited to the following solvers:

    • "CPLEX"
    • "FICO-Xpress"
    • "Ipopt"
    • "Knitro"
    • "MOSEK"
    • "OCTERACT"
    • "SNOPT"

    NEOS Limits

    NEOS currently limits jobs to an 8 hour time limit, 3 GB of memory, and a 16 MB submission file. If your model exceeds these limits, NEOSServer.jl may be unable to return useful information to the user.

    diff --git a/previews/PR3913/packages/NLopt/index.html b/previews/PR3913/packages/NLopt/index.html index 68ba198ddb9..6d046a83c5f 100644 --- a/previews/PR3913/packages/NLopt/index.html +++ b/previews/PR3913/packages/NLopt/index.html @@ -120,4 +120,4 @@ opt = Opt(:LD_MMA, 2) # Define problem solutions[i] = optimize(opt, rand(2)) -end

    Author

    This module was initially written by Steven G. Johnson, with subsequent contributions by several other authors (see the git history).

    +end

    Author

    This module was initially written by Steven G. Johnson, with subsequent contributions by several other authors (see the git history).

    diff --git a/previews/PR3913/packages/OSQP/index.html b/previews/PR3913/packages/OSQP/index.html index ff48533a428..87efb37d631 100644 --- a/previews/PR3913/packages/OSQP/index.html +++ b/previews/PR3913/packages/OSQP/index.html @@ -6,4 +6,4 @@

    OSQP.jl

    Build Status codecov.io

    OSQP.jl is a Julia wrapper for OSQP: the Operator Splitting QP Solver.

    License

    OSQP.jl is licensed under the Apache-2.0 license.

    The upstream solver, osqp/osqp is also licensed under the Apache-2.0 license.

    Installation

    Install OSQP.jl using the Julia package manager

    import Pkg
     Pkg.add("OSQP")

    Problem class

    The OSQP (Operator Splitting Quadratic Program) solver is a numerical optimization package for solving problems in the form

    minimize        0.5 x' P x + q' x
     
    -subject to      l <= A x <= u

    where x in R^n is the optimization variable. The objective function is defined by a positive semidefinite matrix P in S^n_+ and vector q in R^n. The linear constraints are defined by matrix A in R^{m x n} and vectors l in R^m U {-inf}^m, u in R^m U {+inf}^m.

    Documentation

    Detailed documentation is available at https://osqp.org/.

    +subject to l <= A x <= u

    where x in R^n is the optimization variable. The objective function is defined by a positive semidefinite matrix P in S^n_+ and vector q in R^n. The linear constraints are defined by matrix A in R^{m x n} and vectors l in R^m U {-inf}^m, u in R^m U {+inf}^m.

    Documentation

    Detailed documentation is available at https://osqp.org/.

    diff --git a/previews/PR3913/packages/Optim/index.html b/previews/PR3913/packages/Optim/index.html index 86045dede5d..54b569e1de7 100644 --- a/previews/PR3913/packages/Optim/index.html +++ b/previews/PR3913/packages/Optim/index.html @@ -105,4 +105,4 @@ number = {24}, pages = {615}, doi = {10.21105/joss.00615} -} +} diff --git a/previews/PR3913/packages/PATHSolver/index.html b/previews/PR3913/packages/PATHSolver/index.html index 141bc783d3b..057c920240c 100644 --- a/previews/PR3913/packages/PATHSolver/index.html +++ b/previews/PR3913/packages/PATHSolver/index.html @@ -165,4 +165,4 @@ 0.8 1.2

    Thread safety

    PATH is not thread-safe and there are no known work-arounds. Do not run it in parallel using Threads.@threads. See issue #62 for more details.

    Factorization methods

    By default, PATHSolver.jl will download the LUSOL shared library. To use LUSOL, set the following options:

    model = Model(PATHSolver.Optimizer)
     set_optimizer_attribute(model, "factorization_method", "blu_lusol")
    -set_optimizer_attribute(model, "factorization_library_name", PATHSolver.LUSOL_LIBRARY_PATH)

    To use factorization_method umfpack you will need the umfpack shared library that is available directly from the developers of that code for academic use.

    Manual installation

    By default PATHSolver.jl will download a copy of the libpath library. If you already have one installed and want to use that, set the PATH_JL_LOCATION environment variable to point to the libpath50.xx library.

    +set_optimizer_attribute(model, "factorization_library_name", PATHSolver.LUSOL_LIBRARY_PATH)

    To use factorization_method umfpack you will need the umfpack shared library that is available directly from the developers of that code for academic use.

    Manual installation

    By default PATHSolver.jl will download a copy of the libpath library. If you already have one installed and want to use that, set the PATH_JL_LOCATION environment variable to point to the libpath50.xx library.

    diff --git a/previews/PR3913/packages/Pajarito/index.html b/previews/PR3913/packages/Pajarito/index.html index 53f751b178e..338cb11a140 100644 --- a/previews/PR3913/packages/Pajarito/index.html +++ b/previews/PR3913/packages/Pajarito/index.html @@ -27,4 +27,4 @@ pages={249--293}, year={2020}, publisher={Springer} -}

    Note this paper describes a legacy MathProgBase version of Pajarito, which is available on the mathprogbase branch of this repository. Starting with version v0.8.0, Pajarito supports MathOptInterface instead of MathProgBase.

    +}

    Note this paper describes a legacy MathProgBase version of Pajarito, which is available on the mathprogbase branch of this repository. Starting with version v0.8.0, Pajarito supports MathOptInterface instead of MathProgBase.

    diff --git a/previews/PR3913/packages/ParametricOptInterface/index.html b/previews/PR3913/packages/ParametricOptInterface/index.html index da8b08d238f..a47b73ecd00 100644 --- a/previews/PR3913/packages/ParametricOptInterface/index.html +++ b/previews/PR3913/packages/ParametricOptInterface/index.html @@ -13,4 +13,4 @@ @objective(model, Min, 2x) optimize!(model) MOI.set(model, POI.ParameterValue(), p, 2.0) -optimize!(model)

    GSOC2020

    ParametricOptInterface began as a NumFOCUS sponsored Google Summer of Code (2020) project.

    +optimize!(model)

    GSOC2020

    ParametricOptInterface began as a NumFOCUS sponsored Google Summer of Code (2020) project.

    diff --git a/previews/PR3913/packages/Pavito/index.html b/previews/PR3913/packages/Pavito/index.html index 5ea144049f6..a3c591ff347 100644 --- a/previews/PR3913/packages/Pavito/index.html +++ b/previews/PR3913/packages/Pavito/index.html @@ -13,4 +13,4 @@ "cont_solver" => optimizer_with_attributes(Ipopt.Optimizer, "print_level" => 0), ), -)

    The algorithm implemented by Pavito itself is relatively simple; most of the hard work is performed by the MILP solver passed as mip_solver and the NLP solver passed as cont_solver.

    The performance of Pavito depends on these two types of solvers.

    For better performance, you should use a commercial MILP solver such as CPLEX or Gurobi.

    Options

    The following optimizer attributes can set to a Pavito.Optimizer to modify its behavior:

    • log_level::Int Verbosity flag: 0 for quiet, higher for basic solve info
    • timeout::Float64 Time limit for algorithm (in seconds)
    • rel_gap::Float64 Relative optimality gap termination condition
    • mip_solver_drives::Bool Let MILP solver manage convergence ("branch and cut")
    • mip_solver::MOI.OptimizerWithAttributes MILP solver
    • cont_solver::MOI.OptimizerWithAttributes Continuous NLP solver

    Pavito is not yet numerically robust and may require tuning of parameters to improve convergence.

    If the default parameters don't work for you, please let us know by opening an issue.

    For improved Pavito performance, MILP solver integrality tolerance and feasibility tolerances should typically be tightened, for example to 1e-8.

    Bug reports and support

    Please report any issues via the GitHub issue tracker. All types of issues are welcome and encouraged; this includes bug reports, documentation typos, feature requests, etc. The Optimization (Mathematical) category on Discourse is appropriate for general discussion.

    +)

    The algorithm implemented by Pavito itself is relatively simple; most of the hard work is performed by the MILP solver passed as mip_solver and the NLP solver passed as cont_solver.

    The performance of Pavito depends on these two types of solvers.

    For better performance, you should use a commercial MILP solver such as CPLEX or Gurobi.

    Options

    The following optimizer attributes can set to a Pavito.Optimizer to modify its behavior:

    • log_level::Int Verbosity flag: 0 for quiet, higher for basic solve info
    • timeout::Float64 Time limit for algorithm (in seconds)
    • rel_gap::Float64 Relative optimality gap termination condition
    • mip_solver_drives::Bool Let MILP solver manage convergence ("branch and cut")
    • mip_solver::MOI.OptimizerWithAttributes MILP solver
    • cont_solver::MOI.OptimizerWithAttributes Continuous NLP solver

    Pavito is not yet numerically robust and may require tuning of parameters to improve convergence.

    If the default parameters don't work for you, please let us know by opening an issue.

    For improved Pavito performance, MILP solver integrality tolerance and feasibility tolerances should typically be tightened, for example to 1e-8.

    Bug reports and support

    Please report any issues via the GitHub issue tracker. All types of issues are welcome and encouraged; this includes bug reports, documentation typos, feature requests, etc. The Optimization (Mathematical) category on Discourse is appropriate for general discussion.

    diff --git a/previews/PR3913/packages/Percival/index.html b/previews/PR3913/packages/Percival/index.html index 98ae8e7138e..6dc89bd4b05 100644 --- a/previews/PR3913/packages/Percival/index.html +++ b/previews/PR3913/packages/Percival/index.html @@ -22,4 +22,4 @@ [1.0], [1.0], ) -output = percival(nlp, verbose = 1)

    Bug reports and discussions

    If you think you found a bug, feel free to open an issue. Focused suggestions and requests can also be opened as issues. Before opening a pull request, start an issue or a discussion on the topic, please.

    If you want to ask a question not suited for a bug report, feel free to start a discussion here. This forum is for general discussion about this repository and the JuliaSmoothOptimizers, so questions about any of our packages are welcome.

    +output = percival(nlp, verbose = 1)

    Bug reports and discussions

    If you think you found a bug, feel free to open an issue. Focused suggestions and requests can also be opened as issues. Before opening a pull request, start an issue or a discussion on the topic, please.

    If you want to ask a question not suited for a bug report, feel free to start a discussion here. This forum is for general discussion about this repository and the JuliaSmoothOptimizers, so questions about any of our packages are welcome.

    diff --git a/previews/PR3913/packages/PiecewiseLinearOpt/index.html b/previews/PR3913/packages/PiecewiseLinearOpt/index.html index 1005cfd79eb..e3844d2abf1 100644 --- a/previews/PR3913/packages/PiecewiseLinearOpt/index.html +++ b/previews/PR3913/packages/PiecewiseLinearOpt/index.html @@ -41,4 +41,4 @@ (u, v) -> exp(u + v); method = :DisaggLogarithmic, ) -@objective(model, Min, z)

    Methods

    Supported univariate formulations:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic; default)
    • Disaggregated Logarithmic (:DisaggLogarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)

    Supported bivariate formulations for entire constraint:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Disaggregated Logarithmic (:DisaggLogarithmic)

    Also, you can use any univariate formulation for bivariate functions as well. They will be used to impose two axis-aligned SOS2 constraints, along with the "6-stencil" formulation for the triangle selection portion of the constraint. See the associated paper for more details. In particular, the following are also acceptable bivariate formulation choices:

    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)
    +@objective(model, Min, z)

    Methods

    Supported univariate formulations:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic; default)
    • Disaggregated Logarithmic (:DisaggLogarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)

    Supported bivariate formulations for entire constraint:

    • Convex combination (:CC)
    • Multiple choice (:MC)
    • Disaggregated Logarithmic (:DisaggLogarithmic)

    Also, you can use any univariate formulation for bivariate functions as well. They will be used to impose two axis-aligned SOS2 constraints, along with the "6-stencil" formulation for the triangle selection portion of the constraint. See the associated paper for more details. In particular, the following are also acceptable bivariate formulation choices:

    • Native SOS2 branching (:SOS2)
    • Incremental (:Incremental)
    • Logarithmic (:Logarithmic)
    • Binary zig-zag (:ZigZag)
    • General integer zig-zag (:ZigZagInteger)
    diff --git a/previews/PR3913/packages/Plasmo/index.html b/previews/PR3913/packages/Plasmo/index.html index 840b0754a9a..466fca7d2d8 100644 --- a/previews/PR3913/packages/Plasmo/index.html +++ b/previews/PR3913/packages/Plasmo/index.html @@ -50,4 +50,4 @@ volume = {125}, year = {2019}, doi = {10.1016/j.compchemeng.2019.03.009} -}

    A pre-print of this paper can be found here

    +}

    A pre-print of this paper can be found here

    diff --git a/previews/PR3913/packages/PolyJuMP/index.html b/previews/PR3913/packages/PolyJuMP/index.html index 76ce40dd37f..80f46c57281 100644 --- a/previews/PR3913/packages/PolyJuMP/index.html +++ b/previews/PR3913/packages/PolyJuMP/index.html @@ -17,4 +17,4 @@ model = Model(optimizer_with_attributes( PolyJuMP.KKT.Optimizer, "solver" => HomotopyContinuation.SemialgebraicSetsHCSolver(), -))

    Documentation

    Documentation for PolyJuMP.jl is included in the documentation for SumOfSquares.jl.

    +))

    Documentation

    Documentation for PolyJuMP.jl is included in the documentation for SumOfSquares.jl.

    diff --git a/previews/PR3913/packages/ProxSDP/index.html b/previews/PR3913/packages/ProxSDP/index.html index 6e9fe69e11e..4f06312303c 100644 --- a/previews/PR3913/packages/ProxSDP/index.html +++ b/previews/PR3913/packages/ProxSDP/index.html @@ -56,4 +56,4 @@ publisher = {Taylor & Francis}, doi = {10.1080/02331934.2020.1823387}, URL = {https://doi.org/10.1080/02331934.2020.1823387} -}

    The preprint version of the paper can be found here.

    Disclaimer

    • ProxSDP is a research software, therefore it should not be used in production.
    • Please open an issue if you find any problems, developers will try to fix and find alternatives.
    • There is no continuous development for 32-bit systems, the package should work, but might reach some issues.
    • ProxSDP assumes primal and dual feasibility.

    ROAD MAP

    • Support for exponential and power cones
    • Warm start
    +}

    The preprint version of the paper can be found here.

    Disclaimer

    • ProxSDP is a research software, therefore it should not be used in production.
    • Please open an issue if you find any problems, developers will try to fix and find alternatives.
    • There is no continuous development for 32-bit systems, the package should work, but might reach some issues.
    • ProxSDP assumes primal and dual feasibility.

    ROAD MAP

    • Support for exponential and power cones
    • Warm start
    diff --git a/previews/PR3913/packages/SCIP/index.html b/previews/PR3913/packages/SCIP/index.html index ca91c251f5c..a8453e26b21 100644 --- a/previews/PR3913/packages/SCIP/index.html +++ b/previews/PR3913/packages/SCIP/index.html @@ -14,4 +14,4 @@ julia> Pkg.build("SCIP")

    Use with JuMP

    Use SCIP with JuMP as follows:

    using JuMP, SCIP
     model = Model(SCIP.Optimizer)
     set_attribute(model, "display/verblevel", 0)
    -set_attribute(model, "limits/gap", 0.05)

    Options

    See the SCIP documentation for a list of supported options.

    MathOptInterface API

    The SCIP optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Design considerations

    Wrapping the public API

    All of the public API methods are wrapped and available within the SCIP package. This includes the scip_*.h and pub_*.h headers that are collected in scip.h, as well as all default constraint handlers (cons_*.h.)

    The wrapped functions do not transform any data structures and work on the raw pointers (for example, SCIP* in C, Ptr{SCIP_} in Julia). Convenience wrapper functions based on Julia types are added as needed.

    Memory management

    Programming with SCIP requires dealing with variable and constraint objects that use reference counting for memory management.

    The SCIP.Optimizer wrapper type collects lists of SCIP_VAR* and SCIP_CONS* under the hood, and it releases all references when it is garbage collected itself (via finalize).

    When adding a variable (add_variable) or a constraint (add_linear_constraint), an integer index is returned. This index can be used to retrieve the SCIP_VAR* or SCIP_CONS* pointer via get_var and get_cons respectively.

    Supported nonlinear operators

    Supported operators in nonlinear expressions are as follows:

    • +
    • -
    • *
    • /
    • ^
    • sqrt
    • exp
    • log
    • abs
    • cos
    • sin
    +set_attribute(model, "limits/gap", 0.05)

    Options

    See the SCIP documentation for a list of supported options.

    MathOptInterface API

    The SCIP optimizer supports the following constraints and attributes.

    List of supported objective functions:

    List of supported variable types:

    List of supported constraint types:

    List of supported model attributes:

    Design considerations

    Wrapping the public API

    All of the public API methods are wrapped and available within the SCIP package. This includes the scip_*.h and pub_*.h headers that are collected in scip.h, as well as all default constraint handlers (cons_*.h.)

    The wrapped functions do not transform any data structures and work on the raw pointers (for example, SCIP* in C, Ptr{SCIP_} in Julia). Convenience wrapper functions based on Julia types are added as needed.

    Memory management

    Programming with SCIP requires dealing with variable and constraint objects that use reference counting for memory management.

    The SCIP.Optimizer wrapper type collects lists of SCIP_VAR* and SCIP_CONS* under the hood, and it releases all references when it is garbage collected itself (via finalize).

    When adding a variable (add_variable) or a constraint (add_linear_constraint), an integer index is returned. This index can be used to retrieve the SCIP_VAR* or SCIP_CONS* pointer via get_var and get_cons respectively.

    Supported nonlinear operators

    Supported operators in nonlinear expressions are as follows:

    • +
    • -
    • *
    • /
    • ^
    • sqrt
    • exp
    • log
    • abs
    • cos
    • sin
    diff --git a/previews/PR3913/packages/SCS/index.html b/previews/PR3913/packages/SCS/index.html index f19b3d63332..944b38b6a45 100644 --- a/previews/PR3913/packages/SCS/index.html +++ b/previews/PR3913/packages/SCS/index.html @@ -53,4 +53,4 @@ julia> SCS.is_available(SCS.GpuIndirectSolver) true

    The GpuIndirectSolver is available on Linux x86_64 platform only.

    Low-level wrapper

    SCS.jl provides a low-level interface to solve a problem directly, without interfacing through MathOptInterface.

    This is an advanced interface with a risk of incorrect usage. For new users, we recommend that you use the JuMP or Convex interfaces instead.

    SCS solves a problem of the form:

    minimize        1/2 * x' * P * x + c' * x
     subject to      A * x + s = b
    -                s in K

    where K is a product cone of:

    • zero cone
    • positive orthant { x | x ≥ 0 }
    • box cone { (t,x) | t*l ≤ x ≤ t*u}
    • second-order cone (SOC) { (t,x) | ||x||_2 ≤ t }
    • semi-definite cone (SDC) { X | X is psd }
    • exponential cone { (x,y,z) | y e^(x/y) ≤ z, y>0 }
    • power cone { (x,y,z) | x^a * y^(1-a) ≥ |z|, x ≥ 0, y ≥ 0 }
    • dual power cone { (u,v,w) | (u/a)^a * (v/(1-a))^(1-a) ≥ |w|, u ≥ 0, v ≥ 0 }.

    To solve this problem with SCS, call SCS.scs_solve; see the docstring for details.

    + s in K

    where K is a product cone of:

    • zero cone
    • positive orthant { x | x ≥ 0 }
    • box cone { (t,x) | t*l ≤ x ≤ t*u}
    • second-order cone (SOC) { (t,x) | ||x||_2 ≤ t }
    • semi-definite cone (SDC) { X | X is psd }
    • exponential cone { (x,y,z) | y e^(x/y) ≤ z, y>0 }
    • power cone { (x,y,z) | x^a * y^(1-a) ≥ |z|, x ≥ 0, y ≥ 0 }
    • dual power cone { (u,v,w) | (u/a)^a * (v/(1-a))^(1-a) ≥ |w|, u ≥ 0, v ≥ 0 }.

    To solve this problem with SCS, call SCS.scs_solve; see the docstring for details.

    diff --git a/previews/PR3913/packages/SDDP/index.html b/previews/PR3913/packages/SDDP/index.html index 4a3ec340a25..ebb3e62788d 100644 --- a/previews/PR3913/packages/SDDP/index.html +++ b/previews/PR3913/packages/SDDP/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -
    +
    diff --git a/previews/PR3913/packages/SDPA/index.html b/previews/PR3913/packages/SDPA/index.html index 925a1ece13c..c7d6bfd09a6 100644 --- a/previews/PR3913/packages/SDPA/index.html +++ b/previews/PR3913/packages/SDPA/index.html @@ -13,4 +13,4 @@ set_attribute(model, "Mode", SDPA.PARAMETER_STABLE_BUT_SLOW)

    Note that the parameters are set in the order they are given, so you can set a mode and then modify parameters from this mode.

    using JuMP, SDPA
     model = Model(SDPA.Optimizer)
     set_attribute(model, "Mode", SDPA.PARAMETER_STABLE_BUT_SLOW)
    -set_attribute(model, "MaxIteration", 100)

    The choice of parameter mode has a large impact on the performance and stability of SDPA, and not necessarily in the way implied by the names of the modes; for example, PARAMETER_UNSTABLE_BUT_FAST can be more stable than the other modes for some problems. You should try each mode to see how it performs on your specific problem. See SDPA.jl#17 for more details.

    +set_attribute(model, "MaxIteration", 100)

    The choice of parameter mode has a large impact on the performance and stability of SDPA, and not necessarily in the way implied by the names of the modes; for example, PARAMETER_UNSTABLE_BUT_FAST can be more stable than the other modes for some problems. You should try each mode to see how it performs on your specific problem. See SDPA.jl#17 for more details.

    diff --git a/previews/PR3913/packages/SDPLR/index.html b/previews/PR3913/packages/SDPLR/index.html index c52b0cfcbe8..7923fda3703 100644 --- a/previews/PR3913/packages/SDPLR/index.html +++ b/previews/PR3913/packages/SDPLR/index.html @@ -50,4 +50,4 @@ sigma *= 2 end lambdaupdate = 0 -end +end diff --git a/previews/PR3913/packages/SDPNAL/index.html b/previews/PR3913/packages/SDPNAL/index.html index 14299683e17..a9d9124f3cc 100644 --- a/previews/PR3913/packages/SDPNAL/index.html +++ b/previews/PR3913/packages/SDPNAL/index.html @@ -18,4 +18,4 @@ '/path/to/SDPNALv1.0/solver:', ... '/path/to/SDPNALv1.0/solver_main_default:', ... '/path/to/SDPNALv1.0/util:', ... -% (...)

    If you have SDPT3 in addition to SDPNAL in the MATLAB path (that is, the toolbox/local/pathdef.m file) then you might have issues because both solvers define a validate function, and this might make SDPNAL call SDPT3's validate function instead of SDPT3's validate function.

    +% (...)

    If you have SDPT3 in addition to SDPNAL in the MATLAB path (that is, the toolbox/local/pathdef.m file) then you might have issues because both solvers define a validate function, and this might make SDPNAL call SDPT3's validate function instead of SDPT3's validate function.

    diff --git a/previews/PR3913/packages/SDPT3/index.html b/previews/PR3913/packages/SDPT3/index.html index fbe1392f850..91aeb5cb61b 100644 --- a/previews/PR3913/packages/SDPT3/index.html +++ b/previews/PR3913/packages/SDPT3/index.html @@ -29,4 +29,4 @@ julia> MATLAB.restoredefaultpath() -julia> MATLAB.mat"savepath" +julia> MATLAB.mat"savepath" diff --git a/previews/PR3913/packages/SeDuMi/index.html b/previews/PR3913/packages/SeDuMi/index.html index d5d44441183..21c87ab3b89 100644 --- a/previews/PR3913/packages/SeDuMi/index.html +++ b/previews/PR3913/packages/SeDuMi/index.html @@ -17,4 +17,4 @@ MATLAB.mat"install_sedumi" end -julia> MATLAB.mat"savepath" +julia> MATLAB.mat"savepath" diff --git a/previews/PR3913/packages/SumOfSquares/index.html b/previews/PR3913/packages/SumOfSquares/index.html index 0b6957e57d2..921fc854535 100644 --- a/previews/PR3913/packages/SumOfSquares/index.html +++ b/previews/PR3913/packages/SumOfSquares/index.html @@ -4,4 +4,4 @@ gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash});

    SumOfSquares.jl

    Build Status codecov

    SumOfSquares.jl is a JuMP extension that, when used in conjunction with MultivariatePolynomial and PolyJuMP, implements a sum of squares reformulation for polynomial optimization.

    License

    SumOfSquares.jl is licensed under the MIT license.

    Installation

    Install SumOfSquares using Pkg.add:

    import Pkg
    -Pkg.add("SumOfSquares")

    Documentation

    See https://jump.dev/SumOfSquares.jl/stable for the most recently tagged version of the documentation.

    See https://jump.dev/SumOfSquares.jl/dev for the in-development version of the documentation.

    Presentations

    Some presentations on, or using, SumOfSquares (see blegat/SumOfSquaresSlides for the source code of the presentations):

    Citing

    See CITATION.bib.

    +Pkg.add("SumOfSquares")

    Documentation

    See https://jump.dev/SumOfSquares.jl/stable for the most recently tagged version of the documentation.

    See https://jump.dev/SumOfSquares.jl/dev for the in-development version of the documentation.

    Presentations

    Some presentations on, or using, SumOfSquares (see blegat/SumOfSquaresSlides for the source code of the presentations):

    Citing

    See CITATION.bib.

    diff --git a/previews/PR3913/packages/Tulip/index.html b/previews/PR3913/packages/Tulip/index.html index 502dab45046..7112fee3c08 100644 --- a/previews/PR3913/packages/Tulip/index.html +++ b/previews/PR3913/packages/Tulip/index.html @@ -28,4 +28,4 @@ language = {en}, url = {https://doi.org/10.1007/s12532-020-00200-8}, urldate = {2021-03-07}, -} +} diff --git a/previews/PR3913/packages/Xpress/index.html b/previews/PR3913/packages/Xpress/index.html index e7980cdd606..536a67f9afb 100644 --- a/previews/PR3913/packages/Xpress/index.html +++ b/previews/PR3913/packages/Xpress/index.html @@ -58,4 +58,4 @@ @test termination_status(model) == MOI.OPTIMAL @test primal_status(model) == MOI.FEASIBLE_POINT @test value(x) == 1 -@test value(y) == 2

    Environment variables

    • XPRESS_JL_SKIP_LIB_CHECK: Used to skip build lib check as previously described.
    • XPRESS_JL_NO_INFO: Disable license info log.
    • XPRESS_JL_NO_DEPS_ERROR: Disable error when do deps.jl file is found.
    • XPRESS_JL_NO_AUTO_INIT: Disable automatic run of Xpress.initialize(). Specially useful for explicitly loading the dynamic library.
    • XPRESS_JL_LIBRARY: Provide a custom path to libxprs
    • XPAUTH_PATH: Provide a custom path to the license file

    C API

    The C API can be accessed via Xpress.Lib.XPRSxx functions, where the names and arguments are identical to the C API.

    See the Xpress documentation for details.

    Documentation

    For more information, consult the FICO optimizer manual.

    +@test value(y) == 2

    Environment variables

    • XPRESS_JL_SKIP_LIB_CHECK: Used to skip build lib check as previously described.
    • XPRESS_JL_NO_INFO: Disable license info log.
    • XPRESS_JL_NO_DEPS_ERROR: Disable error when do deps.jl file is found.
    • XPRESS_JL_NO_AUTO_INIT: Disable automatic run of Xpress.initialize(). Specially useful for explicitly loading the dynamic library.
    • XPRESS_JL_LIBRARY: Provide a custom path to libxprs
    • XPAUTH_PATH: Provide a custom path to the license file

    C API

    The C API can be accessed via Xpress.Lib.XPRSxx functions, where the names and arguments are identical to the C API.

    See the Xpress documentation for details.

    Documentation

    For more information, consult the FICO optimizer manual.

    diff --git a/previews/PR3913/packages/solvers/index.html b/previews/PR3913/packages/solvers/index.html index 95a3ed3ff27..cbb1ec83cfd 100644 --- a/previews/PR3913/packages/solvers/index.html +++ b/previews/PR3913/packages/solvers/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Introduction

    This section of the documentation contains brief documentation for some of the solvers that JuMP supports. The list of solvers is not exhaustive, but instead is intended to help you discover commonly used solvers.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers. In many cases, these packages wrap external solvers that are not developed by the JuMP developers and, while the Julia packages are all open-source, in some cases the solvers themselves are closed source commercial products.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new solvers

    Written a solver? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    +

    Introduction

    This section of the documentation contains brief documentation for some of the solvers that JuMP supports. The list of solvers is not exhaustive, but instead is intended to help you discover commonly used solvers.

    Affiliation

    Packages beginning with jump-dev/ are developed and maintained by the JuMP developers. In many cases, these packages wrap external solvers that are not developed by the JuMP developers and, while the Julia packages are all open-source, in some cases the solvers themselves are closed source commercial products.

    Packages that do not begin with jump-dev/ are developed independently. The developers of these packages requested or consented to the inclusion of their README contents in the JuMP documentation for the benefit of users.

    Adding new solvers

    Written a solver? Add it to this section of the JuMP documentation by making a pull request to the docs/packages.toml file.

    diff --git a/previews/PR3913/release_notes/index.html b/previews/PR3913/release_notes/index.html index 4e82e38a001..0c9289ee0a3 100644 --- a/previews/PR3913/release_notes/index.html +++ b/previews/PR3913/release_notes/index.html @@ -12,4 +12,4 @@ new_b = backend(model)
  • All usages of @SDconstraint are deprecated. The new syntax is @constraint(model, X >= Y, PSDCone()).
  • Creating a DenseAxisArray with a Number as an axis will now display a warning. This catches a common error in which users write @variable(model, x[length(S)]) instead of @variable(model, x[1:length(S)]).
  • The caching_mode argument to Model, for example, Model(caching_mode = MOIU.MANUAL) mode has been removed. For more control over the optimizer, use direct_model instead.
  • The previously deprecated lp_objective_perturbation_range and lp_rhs_perturbation_range functions have been removed. Use lp_sensitivity_report instead.
  • The .m fields of NonlinearExpression and NonlinearParameter have been renamed to .model.
  • Infinite variable bounds are now ignored. Thus, @variable(model, x <= Inf) will show has_upper_bound(x) == false. Previously, these bounds were passed through to the solvers which caused numerical issues for solvers expecting finite bounds.
  • The variable_type and constraint_type functions were removed. This should only affect users who previously wrote JuMP extensions. The functions can be deleted without consequence.
  • The internal functions moi_mode, moi_bridge_constraints, moi_add_constraint, and moi_add_to_function_constant are no longer exported.
  • The un-used method Containers.generate_container has been deleted.
  • The Containers API has been refactored, and _build_ref_sets is now public as Containers.build_ref_sets.
  • The parse_constraint_ methods for extending @constraint at parse time have been refactored in a breaking way. Consult the Extensions documentation for more details and examples.
  • Added

    • The TerminationStatusCode and ResultStatusCode enums are now exported by JuMP. Prefer termination_status(model) == OPTIMAL instead of == MOI.OPTIMAL, although the MOI. prefix way still works.
    • Copy a x::DenseAxisArray to an Array by calling Array(x).
    • NonlinearExpression is now a subtype of AbstractJuMPScalar
    • Constraints such as @constraint(model, x + 1 in MOI.Integer()) are now supported.
    • primal_feasibility_report now accepts a function as the first argument.
    • Scalar variables @variable(model, x[1:2] in MOI.Integer()) creates two variables, both of which are constrained to be in the set MOI.Integer.
    • Conic constraints can now be specified as inequalities under a different partial ordering. So @constraint(model, x - y in MOI.Nonnegatives()) can now be written as @constraint(model, x >= y, MOI.Nonnegatives()).
    • Names are now set for vectorized constraints.

    Fixed

    • Fixed a performance issue when show was called on a SparseAxisArray with a large number of elements.
    • Fixed a bug displaying barrier and simplex iterations in solution_summary.
    • Fixed a bug by implementing hash for DenseAxisArray and SparseAxisArray.
    • Names are now only set if the solver supports them. Previously, this prevented solvers such as Ipopt from being used with direct_model.
    • MutableArithmetics.Zero is converted into a 0.0 before being returned to the user. Previously, some calls to @expression would return the undocumented MutableArithmetics.Zero() object. One example is summing over an empty set @expression(model, sum(x[i] for i in 1:0)). You will now get 0.0 instead.
    • AffExpr and QuadExpr can now be used with == 0 instead of iszero. This fixes a number of issues relating to Julia standard libraries such as LinearAlgebra and SparseArrays.
    • Fixed a bug when registering a user-defined function with splatting.

    Other

    • The documentation is now available as a PDF.
    • The documentation now includes a full copy of the MathOptInterface documentation to make it easy to link concepts between the docs. (The MathOptInterface documentation has also been significantly improved.)
    • The documentation contains a large number of improvements and clarifications on a range of topics. Thanks to @sshin23, @DilumAluthge, and @jlwether.
    • The documentation is now built with Julia 1.6 instead of 1.0.
    • Various error messages have been improved to be more readable.

    Version 0.21.10 (September 4, 2021)

    Added

    • Added add_NL_expression
    • add_NL_xxx functions now support AffExpr and QuadExpr as terms

    Fixed

    • Fixed a bug in solution_summary
    • Fixed a bug in relax_integrality

    Other

    • Improved error message in lp_sensitivity_report

    Version 0.21.9 (August 1, 2021)

    Added

    • Containers now support arbitrary container types by passing the type to the container keyword and overloading Containers.container.
    • is_valid now supports nonlinear constraints
    • Added unsafe_backend for querying the inner-most optimizer of a JuMP model.
    • Nonlinear parameters now support the plural @NLparameters macro.
    • Containers (for example, DenseAxisArray) can now be used in vector-valued constraints.

    Other

    • Various improvements to the documentation.

    Version 0.21.8 (May 8, 2021)

    Added

    • The @constraint macro is now extendable in the same way as @variable.
    • AffExpr and QuadExpr can now be used in nonlinear macros.

    Fixed

    • Fixed a bug in lp_sensitivity_report.
    • Fixed an inference issue when creating empty SparseAxisArrays.

    Version 0.21.7 (April 12, 2021)

    Added

    • Added primal_feasibility_report, which can be used to check whether a primal point satisfies primal feasibility.
    • Added coefficient, which returns the coefficient associated with a variable in affine and quadratic expressions.
    • Added copy_conflict, which returns the IIS of an infeasible model.
    • Added solution_summary, which returns (and prints) a struct containing a summary of the solution.
    • Allow AbstractVector in vector constraints instead of just Vector.
    • Added latex_formulation(model) which returns an object representing the latex formulation of a model. Use print(latex_formulation(model)) to print the formulation as a string.
    • User-defined functions in nonlinear expressions are now automatically registered to aid quick model prototyping. However, a warning is printed to encourage the manual registration.
    • DenseAxisArray's now support broadcasting over multiple arrays.
    • Container indices can now be iterators of Base.SizeUnknown.

    Fixed

    • Fixed bug in rad2deg and deg2rad in nonlinear expressions.
    • Fixed a MethodError bug in Containers when forcing container type.
    • Allow partial slicing of a DenseAxisArray, resolving an issue from 2014.
    • Fixed a bug printing variable names in IJulia.
    • Ending an IJulia cell with model now prints a summary of the model (like in the REPL) not the latex formulation. Use print(model) to print the latex formulation.
    • Fixed a bug when copying models containing nested arrays.

    Other

    • Tutorials are now part of the documentation, and more refactoring has taken place.
    • Added JuliaFormatter added as a code formatter.
    • Added some precompilation statements to reduce initial latency.
    • Various improvements to error messages to make them more helpful.
    • Improved performance of value(::NonlinearExpression).
    • Improved performance of fix(::VariableRef).

    Version 0.21.6 (January 29, 2021)

    Added

    • Added support for skew symmetric variables via @variable(model, X[1:2, 1:2] in SkewSymmetricMatrixSpace()).
    • lp_sensitivity_report has been added which significantly improves the performance of querying the sensitivity summary of an LP. lp_objective_perturbation_range and lp_rhs_perturbation_range are deprecated.
    • Dual warm-starts are now supported with set_dual_start_value and dual_start_value.
    • (\in<tab>) can now be used in macros instead of = or in.
    • Use haskey(model::Model, key::Symbol) to check if a name key is registered in a model.
    • Added unregister(model::Model, key::Symbol) to unregister a name key from model.
    • Added callback_node_status for use in callbacks.
    • Added print_bridge_graph to visualize the bridging graph generated by MathOptInterface.
    • Improved error message for containers with duplicate indices.

    Fixed

    • Various fixes to pass tests on Julia 1.6.
    • Fixed a bug in the printing of nonlinear expressions in IJulia.
    • Fixed a bug when nonlinear expressions are passed to user-defined functions.
    • Some internal functions that were previously exported are now no longer exported.
    • Fixed a bug when relaxing a fixed binary variable.
    • Fixed a StackOverflowError that occurred when SparseAxisArrays had a large number of elements.
    • Removed an unnecessary type assertion in list_of_constraint_types.
    • Fixed a bug when copying models with registered expressions.

    Other

    • The documentation has been significantly overhauled. It now has distinct sections for the manual, API reference, and examples. The existing examples in /examples have now been moved to /docs/src/examples and rewritten using Literate.jl, and they are now included in the documentation.
    • JuliaFormatter has been applied to most of the codebase. This will continue to roll out over time, as we fix upstream issues in the formatter, and will eventually become compulsory.
    • The root cause of a large number of method invalidations has been resolved.
    • We switched continuous integration from Travis and Appveyor to GitHub Actions.

    Version 0.21.5 (September 18, 2020)

    Fixed

    • Fixed deprecation warnings
    • Throw DimensionMismatch for incompatibly sized functions and sets
    • Unify treatment of keys(x) on JuMP containers

    Version 0.21.4 (September 14, 2020)

    Added

    • Add debug info when adding unsupported constraints
    • Add relax_integrality for solving continuous relaxation
    • Allow querying constraint conflicts

    Fixed

    • Dispatch on Real for MOI.submit
    • Implement copy for CustomSet in tests
    • Don't export private macros
    • Fix invalid assertion in nonlinear
    • Error if constraint has NaN right-hand side
    • Improve speed of tests
    • Lots of work modularizing files in /test
    • Improve line numbers in macro error messages
    • Print nonlinear subexpressions
    • Various documentation updates
    • Dependency updates:
      • Datastructures 0.18
      • MathOptFormat v0.5
      • Prep for MathOptInterface 0.9.15

    Version 0.21.3 (June 18, 2020)

    • Added Special Order Sets (SOS1 and SOS2) to JuMP with default weights to ease the creation of such constraints (#2212).
    • Added functions simplex_iterations, barrier_iterations and node_count (#2201).
    • Added function reduced_cost (#2205).
    • Implemented callback_value for affine and quadratic expressions (#2231).
    • Support MutableArithmetics.Zero in objective and constraints (#2219).
    • Documentation improvements:
      • Mention tutorials in the docs (#2223).
      • Update COIN-OR links (#2242).
      • Explicit link to the documentation of MOI.FileFormats (#2253).
      • Typo fixes (#2261).
    • Containers improvements:
      • Fix Base.map for DenseAxisArray (#2235).
      • Throw BoundsError if number of indices is incorrect for DenseAxisArray and SparseAxisArray (#2240).
    • Extensibility improvements:
      • Implement a set_objective method fallback that redirects to set_objective_sense and set_objective_function (#2247).
      • Add parse_constraint method with arbitrary number of arguments (#2051).
      • Add parse_constraint_expr and parse_constraint_head (#2228).

    Version 0.21.2 (April 2, 2020)

    • Added relative_gap() to access MOI.RelativeGap() attribute (#2199).
    • Documentation fixes:
      • Added link to source for docstrings in the documentation (#2207).
      • Added docstring for @variables macro (#2216).
      • Typo fixes (#2177, #2184, #2182).
    • Implementation of methods for Base functions:
      • Implemented Base.empty! for JuMP.Model (#2198).
      • Implemented Base.conj for JuMP scalar types (#2209).

    Fixed

    • Fixed sum of expression with scalar product in macro (#2178).
    • Fixed writing of nonlinear models to MathOptFormat (#2181).
    • Fixed construction of empty SparseAxisArray (#2179).
    • Fixed constraint with zero function (#2188).

    Version 0.21.1 (Feb 18, 2020)

    • Improved the clarity of the with_optimizer deprecation warning.

    Version 0.21.0 (Feb 16, 2020)

    Breaking

    • Deprecated with_optimizer (#2090, #2084, #2141). You can replace with_optimizer by either nothing, optimizer_with_attributes or a closure:

      • replace with_optimizer(Ipopt.Optimizer) by Ipopt.Optimizer.
      • replace with_optimizer(Ipopt.Optimizer, max_cpu_time=60.0) by optimizer_with_attributes(Ipopt.Optimizer, "max_cpu_time" => 60.0).
      • replace with_optimizer(Gurobi.Optimizer, env) by () -> Gurobi.Optimizer(env).
      • replace with_optimizer(Gurobi.Optimizer, env, Presolve=0) by optimizer_with_attributes(() -> Gurobi.Optimizer(env), "Presolve" => 0).

      alternatively to optimizer_with_attributes, you can also set the attributes separately with set_optimizer_attribute.

    • Renamed set_parameter and set_parameters to set_optimizer_attribute and set_optimizer_attributes (#2150).

    • Broadcast should now be explicit inside macros. @SDconstraint(model, x >= 1) and @constraint(model, x + 1 in SecondOrderCone()) now throw an error instead of broadcasting 1 along the dimension of x (#2107).

    • @SDconstraint(model, x >= 0) is now equivalent to @constraint(model, x in PSDCone()) instead of @constraint(model, (x .- 0) in PSDCone()) (#2107).

    • The macros now create the containers with map instead of for loops, as a consequence, containers created by @expression can now have any element type and containers of constraint references now have concrete element types when possible. This fixes a long-standing issue where @expression could only be used to generate a collection of linear expressions. Now it works for quadratic expressions as well (#2070).

    • Calling deepcopy(::AbstractModel) now throws an error.

    • The constraint name is now printed in the model string (#2108).

    Added

    • Added support for solver-independent and solver-specific callbacks (#2101).
    • Added write_to_file and read_from_file, supported formats are CBF, LP, MathOptFormat, MPS and SDPA (#2114).
    • Added support for complementarity constraints (#2132).
    • Added support for indicator constraints (#2092).
    • Added support for querying multiple solutions with the result keyword (#2100).
    • Added support for constraining variables on creation (#2128).
    • Added method delete that deletes a vector of variables at once if it is supported by the underlying solver (#2135).
    • The arithmetic between JuMP expression has be refactored into the MutableArithmetics package (#2107).
    • Improved error on complex values in NLP (#1978).
    • Added an example of column generation (#2010).

    Fixed

    • Incorrect coefficients generated when using Symmetric variables (#2102)

    Version 0.20.1 (Oct 18, 2019)

    • Add sections on @variables and @constraints in the documentation (#2062).
    • Fixed product of sparse matrices for Julia v1.3 (#2063).
    • Added set_objective_coefficient to modify the coefficient of a linear term of the objective function (#2008).
    • Added set_time_limit_sec, unset_time_limit_sec and time_limit_sec to set and query the time limit for the solver in seconds (#2053).

    Version 0.20.0 (Aug 24, 2019)

    • Documentation updates.
    • Numerous bug fixes.
    • Better error messages (#1977, #1978, #1997, #2017).
    • Performance improvements (#1947, #2032).
    • Added LP sensitivity summary functions lp_objective_perturbation_range and lp_rhs_perturbation_range (#1917).
    • Added functions dual_objective_value, raw_status and set_parameter.
    • Added function set_objective_coefficient to modify the coefficient of a linear term of the objective (#2008).
    • Added functions set_normalized_rhs, normalized_rhs, and add_to_function_constant to modify and get the constant part of a constraint (#1935, #1960).
    • Added functions set_normalized_coefficient and normalized_coefficient to modify and get the coefficient of a linear term of a constraint (#1935, #1960).
    • Numerous other improvements in MOI 0.9, see the NEWS.md file of MOI for more details.

    Version 0.19.2 (June 8, 2019)

    • Fix a bug in derivatives that could arise in models with nested nonlinear subexpressions.

    Version 0.19.1 (May 12, 2019)

    • Usability and performance improvements.
    • Bug fixes.

    Version 0.19.0 (February 15, 2019)

    JuMP 0.19 contains significant breaking changes.

    Breaking

    • JuMP's abstraction layer for communicating with solvers changed from MathProgBase (MPB) to MathOptInterface (MOI). MOI addresses many longstanding design issues. (See @mlubin's slides from JuMP-dev 2018.) JuMP 0.19 is compatible only with solvers that have been updated for MOI. See the installation guide for a list of solvers that have and have not yet been updated.

    • Most solvers have been renamed to PackageName.Optimizer. For example, GurobiSolver() is now Gurobi.Optimizer.

    • Solvers are no longer added to a model via Model(solver = XXX(kwargs...)). Instead use Model(with_optimizer(XXX, kwargs...)). For example, Model(with_optimizer(Gurobi.Optimizer, OutputFlag=0)).

    • JuMP containers (for example, the objects returned by @variable) have been redesigned. Containers.SparseAxisArray replaces JuMPDict, JuMPArray was rewritten (inspired by AxisArrays) and renamed Containers.DenseAxisArray, and you can now request a container type with the container= keyword to the macros. See the corresponding documentation for more details.

    • The statuses returned by solvers have changed. See the possible status values here. The MOI statuses are much richer than the MPB statuses and can be used to distinguish between previously indistinguishable cases (for example, did the solver have a feasible solution when it stopped because of the time limit?).

    • Starting values are separate from result values. Use value to query the value of a variable in a solution. Use start_value and set_start_value to get and set an initial starting point provided to the solver. The solutions from previous solves are no longer automatically set as the starting points for the next solve.

    • The data structures for affine and quadratic expressions AffExpr and QuadExpr have changed. Internally, terms are stored in dictionaries instead of lists. Duplicate coefficients can no longer exist. Accessors and iteration methods have changed.

    • JuMPNLPEvaluator no longer includes the linear and quadratic parts of the model in the evaluation calls. These are now handled separately to allow NLP solvers that support various types of constraints.

    • JuMP solver-independent callbacks have been replaced by solver-specific callbacks. See your favorite solver for more details. (See the note below: No solver-specific callbacks are implemented yet.)

    • The norm() syntax is no longer recognized inside macros. Use the SecondOrderCone() set instead.

    • JuMP no longer performs automatic transformation between special quadratic forms and second-order cone constraints. Support for these constraint classes depends on the solver.

    • The symbols :Min and :Max are no longer used as optimization senses. Instead, JuMP uses the OptimizationSense enum from MathOptInterface. @objective(model, Max, ...), @objective(model, Min, ...), @NLobjective(model, Max, ...), and @objective(model, Min, ...) remain valid, but @objective(m, :Max, ...) is no longer accepted.

    • The sign conventions for duals has changed in some cases for consistency with conic duality (see the documentation). The shadow_price helper method returns duals with signs that match conventional LP interpretations of dual values as sensitivities of the objective value to relaxations of constraints.

    • @constraintref is no longer defined. Instead, create the appropriate container to hold constraint references manually. For example,

      constraints = Dict() # Optionally, specify types for improved performance.
       for i in 1:N
         constraints[i] = @constraint(model, ...)
      -end
    • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

    • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

    Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    +end
  • The lowerbound, upperbound, and basename keyword arguments to the @variable macro have been renamed to lower_bound, upper_bound, and base_name, for consistency with JuMP's new style recommendations.

  • We rely on broadcasting syntax to apply accessors to collections of variables, for example, value.(x) instead of getvalue(x) for collections. (Use value(x) when x is a scalar object.)

  • Added

    • Splatting (like f(x...)) is recognized in restricted settings in nonlinear expressions.

    • Support for deleting constraints and variables.

    • The documentation has been completely rewritten using docstrings and Documenter.

    • Support for modeling mixed conic and quadratic models (for example, conic models with quadratic objectives and bi-linear matrix inequalities).

    • Significantly improved support for modeling new types of constraints and for extending JuMP's macros.

    • Support for providing dual warm starts.

    • Improved support for accessing solver-specific attributes (for example, the irreducible inconsistent subsystem).

    • Explicit control of whether symmetry-enforcing constraints are added to PSD constraints.

    • Support for modeling exponential cones.

    • Significant improvements in internal code quality and testing.

    • Style and naming guidelines.

    • Direct mode and manual mode provide explicit control over when copies of a model are stored or regenerated. See the corresponding documentation.

    Regressions

    There are known regressions from JuMP 0.18 that will be addressed in a future release (0.19.x or later):

    • Performance regressions in model generation (issue). Please file an issue anyway if you notice a significant performance regression. We have plans to address a number of performance issues, but we might not be aware of all of them.

    • Fast incremental NLP solves are not yet reimplemented (issue).

    • We do not yet have an implementation of solver-specific callbacks.

    • The column generation syntax in @variable has been removed (that is, the objective, coefficients, and inconstraints keyword arguments). Support for column generation will be re-introduced in a future release.

    • The ability to solve the continuous relaxation (that is, via solve(model; relaxation = true)) is not yet reimplemented (issue).

    Version 0.18.5 (December 1, 2018)

    • Support views in some derivative evaluation functions.
    • Improved compatibility with PackageCompiler.

    Version 0.18.4 (October 8, 2018)

    • Fix a bug in model printing on Julia 0.7 and 1.0.

    Version 0.18.3 (October 1, 2018)

    • Add support for Julia v1.0 (Thanks @ExpandingMan)
    • Fix matrix expressions with quadratic functions (#1508)

    Version 0.18.2 (June 10, 2018)

    • Fix a bug in second-order derivatives when expressions are present (#1319)
    • Fix a bug in @constraintref (#1330)

    Version 0.18.1 (April 9, 2018)

    • Fix for nested tuple destructuring (#1193)
    • Preserve internal model when relaxation=true (#1209)
    • Minor bug fixes and updates for example

    Version 0.18.0 (July 27, 2017)

    • Drop support for Julia 0.5.
    • Update for ForwardDiff 0.5.
    • Minor bug fixes.

    Version 0.17.1 (June 9, 2017)

    • Use of constructconstraint! in @SDconstraint.
    • Minor bug fixes.

    Version 0.17.0 (May 27, 2017)

    • Breaking change: Mixing quadratic and conic constraints is no longer supported.
    • Breaking change: The getvariable and getconstraint functions are replaced by indexing on the corresponding symbol. For instance, to access the variable with name x, one should now write m[:x] instead of getvariable(m, :x). As a consequence, creating a variable and constraint with the same name now triggers a warning, and accessing one of them afterwards throws an error. This change is breaking only in the latter case.
    • Addition of the getobjectivebound function that mirrors the functionality of the MathProgBase getobjbound function except that it takes into account transformations performed by JuMP.
    • Minor bug fixes.

    The following changes are primarily of interest to developers of JuMP extensions:

    • The new syntax @constraint(model, expr in Cone) creates the constraint ensuring that expr is inside Cone. The Cone argument is passed to constructconstraint! which enables the call to the dispatched to an extension.
    • The @variable macro now calls constructvariable! instead of directly calling the Variable constructor. Extra arguments and keyword arguments passed to @variable are passed to constructvariable! which enables the call to be dispatched to an extension.
    • Refactor the internal function conicdata (used build the MathProgBase conic model) into smaller sub-functions to make these parts reusable by extensions.

    Version 0.16.2 (March 28, 2017)

    • Minor bug fixes and printing tweaks
    • Address deprecation warnings for Julia 0.6

    Version 0.16.1 (March 7, 2017)

    • Better support for AbstractArray in JuMP (Thanks @tkoolen)
    • Minor bug fixes

    Version 0.16.0 (February 23, 2017)

    • Breaking change: JuMP no longer has a mechanism for selecting solvers by default (the previous mechanism was flawed and incompatible with Julia 0.6). Not specifying a solver before calling solve() will result in an error.
    • Breaking change: User-defined functions are no longer global. The first argument to JuMP.register is now a JuMP Model object within whose scope the function will be registered. Calling JuMP.register without a Model now produces an error.
    • Breaking change: Use the new JuMP.fix method to fix a variable to a value or to update the value to which a variable is fixed. Calling setvalue on a fixed variable now results in an error in order to avoid silent behavior changes. (Thanks @joaquimg)
    • Nonlinear expressions now print out similarly to linear/quadratic expressions (useful for debugging!)
    • New category keyword to @variable. Used for specifying categories of anonymous variables.
    • Compatibility with Julia 0.6-dev.
    • Minor fixes and improvements (Thanks @cossio, @ccoffrin, @blegat)

    Version 0.15.1 (January 31, 2017)

    • Bugfix for @LinearConstraints and friends

    Version 0.15.0 (December 22, 2016)

    • Julia 0.5.0 is the minimum required version for this release.
    • Document support for BARON solver
    • Enable info callbacks in more states than before, for example, for recording solutions. New when argument to addinfocallback (#814, thanks @yeesian)
    • Improved support for anonymous variables. This includes new warnings for potentially confusing use of the traditional non-anonymous syntax:
      • When multiple variables in a model are given the same name
      • When non-symbols are used as names, for example, @variable(m, x[1][1:N])
    • Improvements in iterating over JuMP containers (#836, thanks @IssamT)
    • Support for writing variable names in .lp file output (Thanks @leethargo)
    • Support for querying duals to SDP problems (Thanks @blegat)
    • The comprehension syntax with curly braces sum{}, prod{}, and norm2{} has been deprecated in favor of Julia's native comprehension syntax sum(), prod() and norm() as previously announced. (For early adopters of the new syntax, norm2() was renamed to norm() without deprecation.)
    • Unit tests rewritten to use Base.Test instead of FactCheck
    • Improved support for operations with matrices of JuMP types (Thanks @ExpandingMan)
    • The syntax to halt a solver from inside a callback has changed from throw(CallbackAbort()) to return JuMP.StopTheSolver
    • Minor bug fixes

    Version 0.14.2 (December 12, 2016)

    • Allow singleton anonymous variables (includes bugfix)

    Version 0.14.1 (September 12, 2016)

    • More consistent handling of states in informational callbacks, includes a new when parameter to addinfocallback for specifying in which state an informational callback should be called.

    Version 0.14.0 (August 7, 2016)

    • Compatibility with Julia 0.5 and ForwardDiff 0.2
    • Support for "anonymous" variables, constraints, expressions, and parameters, for example, x = @variable(m, [1:N]) instead of @variable(m, x[1:N])
    • Support for retrieving constraints from a model by name via getconstraint
    • @NLconstraint now returns constraint references (as expected).
    • Support for vectorized expressions within lazy constraints
    • On Julia 0.5, parse new comprehension syntax sum(x[i] for i in 1:N if isodd(i)) instead of sum{ x[i], i in 1:N; isodd(i) }. The old syntax with curly braces will be deprecated in JuMP 0.15.
    • Now possible to provide nonlinear expressions as "raw" Julia Expr objects instead of using JuMP's nonlinear macros. This input format is useful for programmatically generated expressions.
    • s/Mathematical Programming/Mathematical Optimization/
    • Support for local cuts (Thanks to @madanim, Mehdi Madani)
    • Document Xpress interface developed by @joaquimg, Joaquim Dias Garcia
    • Minor bug and deprecation fixes (Thanks @odow, @jrevels)

    Version 0.13.2 (May 16, 2016)

    • Compatibility update for MathProgBase

    Version 0.13.1 (May 3, 2016)

    • Fix broken deprecation for registerNLfunction.

    Version 0.13.0 (April 29, 2016)

    • Most exported methods and macros have been renamed to avoid camelCase. See the list of changes here. There is a 1-1 mapping from the old names to the new, and it is safe to simply replace the names to update existing models.
    • Specify variable lower/upper bounds in @variable using the lowerbound and upperbound keyword arguments.
    • Change name printed for variable using the basename keyword argument to @variable.
    • New @variables macro allows multi-line declaration of groups of variables.
    • A number of solver methods previously available only through MathProgBase are now exposed directly in JuMP. The fix was recorded live.
    • Compatibility fixes with Julia 0.5.
    • The "end" indexing syntax is no longer supported within JuMPArrays which do not use 1-based indexing until upstream issues are resolved, see here.

    Version 0.12.2 (March 9, 2016)

    • Small fixes for nonlinear optimization

    Version 0.12.1 (March 1, 2016)

    • Fix a regression in slicing for JuMPArrays (when not using 1-based indexing)

    Version 0.12.0 (February 27, 2016)

    • The automatic differentiation functionality has been completely rewritten with a number of user-facing changes:
      • @defExpr and @defNLExpr now take the model as the first argument. The previous one-argument version of @defExpr is deprecated; all expressions should be named. For example, replace @defExpr(2x+y) with @defExpr(jump_model, my_expr, 2x+y).
      • JuMP no longer uses Julia's variable binding rules for efficiently re-solving a sequence of nonlinear models. Instead, we have introduced nonlinear parameters. This is a breaking change, so we have added a warning message when we detect models that may depend on the old behavior.
      • Support for user-defined functions integrated within nonlinear JuMP expressions.
    • Replaced iteration over AffExpr with Number-like scalar iteration; previous iteration behavior is now available via linearterms(::AffExpr).
    • Stopping the solver via throw(CallbackAbort()) from a callback no longer triggers an exception. Instead, solve() returns UserLimit status.
    • getDual() now works for conic problems (Thanks @emreyamangil.)

    Version 0.11.3 (February 4, 2016)

    • Bug-fix for problems with quadratic objectives and semidefinite constraints

    Version 0.11.2 (January 14, 2016)

    • Compatibility update for Mosek

    Version 0.11.1 (December 1, 2015)

    • Remove usage of @compat in tests.
    • Fix updating quadratic objectives for nonlinear models.

    Version 0.11.0 (November 30, 2015)

    • Julia 0.4.0 is the minimum required version for this release.
    • Fix for scoping semantics of index variables in sum{}. Index variables no longer leak into the surrounding scope.
    • Addition of the solve(m::Model, relaxation=true) keyword argument to solve the standard continuous relaxation of model m
    • The getConstraintBounds() method allows access to the lower and upper bounds of all constraints in a (nonlinear) model.
    • Update for breaking changes in MathProgBase

    Version 0.10.3 (November 20, 2015)

    • Fix a rare error when parsing quadratic expressions
    • Fix Variable() constructor with default arguments
    • Detect unrecognized keywords in solve()

    Version 0.10.2 (September 28, 2015)

    • Fix for deprecation warnings

    Version 0.10.1 (September 3, 2015)

    • Fixes for ambiguity warnings.
    • Fix for breaking change in precompilation syntax in Julia 0.4-pre

    Version 0.10.0 (August 31, 2015)

    • Support (on Julia 0.4 and later) for conditions in indexing @defVar and @addConstraint constructs, for example, @defVar(m, x[i=1:5,j=1:5; i+j >= 3])
    • Support for vectorized operations on Variables and expressions. See the documentation for details.
    • New getVar() method to access variables in a model by name
    • Support for semidefinite programming.
    • Dual solutions are now available for general nonlinear problems. You may call getDual on a reference object for a nonlinear constraint, and getDual on a variable object for Lagrange multipliers from active bounds.
    • Introduce warnings for two common performance traps: too many calls to getValue() on a collection of variables and use of the + operator in a loop to sum expressions.
    • Second-order cone constraints can be written directly with the norm() and norm2{} syntax.
    • Implement MathProgBase interface for querying Hessian-vector products.
    • Iteration over JuMPContainers is deprecated; instead, use the keys and values functions, and zip(keys(d),values(d)) for the old behavior.
    • @defVar returns Array{Variable,N} when each of N index sets are of the form 1:nᵢ.
    • Module precompilation: on Julia 0.4 and later, using JuMP is now much faster.

    Version 0.9.3 (August 11, 2015)

    • Fixes for FactCheck testing on julia v0.4.

    Version 0.9.2 (June 27, 2015)

    • Fix bug in @addConstraints.

    Version 0.9.1 (April 25, 2015)

    • Fix for Julia 0.4-dev.
    • Small infrastructure improvements for extensions.

    Version 0.9.0 (April 18, 2015)

    • Comparison operators for constructing constraints (for example, 2x >= 1) have been deprecated. Instead, construct the constraints explicitly in the @addConstraint macro to add them to the model, or in the @LinearConstraint macro to create a stand-alone linear constraint instance.
    • getValue() method implemented to compute the value of a nonlinear subexpression
    • JuMP is now released under the Mozilla Public License version 2.0 (was previously LGPL). MPL is a copyleft license which is less restrictive than LGPL, especially for embedding JuMP within other applications.
    • A number of performance improvements in ReverseDiffSparse for computing derivatives.
    • MathProgBase.getsolvetime(m) now returns the solution time reported by the solver, if available. (Thanks @odow, Oscar Dowson)
    • Formatting fix for LP format output. (Thanks @sbebo, Leonardo Taccari).

    Version 0.8.0 (February 17, 2015)

    • Nonlinear subexpressions now supported with the @defNLExpr macro.
    • SCS supported for solving second-order conic problems.
    • setXXXCallback family deprecated in favor of addXXXCallback.
    • Multiple callbacks of the same type can be registered.
    • Added support for informational callbacks via addInfoCallback.
    • A CallbackAbort exception can be thrown from callback to safely exit optimization.

    Version 0.7.4 (February 4, 2015)

    • Reduced costs and linear constraint duals are now accessible when quadratic constraints are present.
    • Two-sided nonlinear constraints are supported.
    • Methods for accessing the number of variables and constraints in a model are renamed.
    • New default procedure for setting initial values in nonlinear optimization: project zero onto the variable bounds.
    • Small bug fixes.

    Version 0.7.3 (January 14, 2015)

    • Fix a method ambiguity conflict with Compose.jl (cosmetic fix)

    Version 0.7.2 (January 9, 2015)

    • Fix a bug in sum(::JuMPDict)
    • Added the setCategory function to change a variables category (for example, continuous or binary)

    after construction, and getCategory to retrieve the variable category.

    Version 0.7.1 (January 2, 2015)

    • Fix a bug in parsing linear expressions in macros. Affects only Julia 0.4 and later.

    Version 0.7.0 (December 29, 2014)

    Linear/quadratic/conic programming

    • Breaking change: The syntax for column-wise model generation has been changed to use keyword arguments in @defVar.
    • On Julia 0.4 and later, variables and coefficients may be multiplied in any order within macros. That is, variable*coefficient is now valid syntax.
    • ECOS supported for solving second-order conic problems.

    Nonlinear programming

    • Support for skipping model generation when solving a sequence of nonlinear models with changing data.
    • Fix a memory leak when solving a sequence of nonlinear models.
    • The @addNLConstraint macro now supports the three-argument version to define sets of nonlinear constraints.
    • KNITRO supported as a nonlinear solver.
    • Speed improvements for model generation.
    • The @addNLConstraints macro supports adding multiple (groups of) constraints at once. Syntax is similar to @addConstraints.
    • Discrete variables allowed in nonlinear problems for solvers which support them (currently only KNITRO).

    General

    • Starting values for variables may now be specified with @defVar(m, x, start=value).
    • The setSolver function allows users to change the solver subsequent to model creation.
    • Support for "fixed" variables via the @defVar(m, x == 1) syntax.
    • Unit tests rewritten to use FactCheck.jl, improved testing across solvers.

    Version 0.6.3 (October 19, 2014)

    • Fix a bug in multiplying two AffExpr objects.

    Version 0.6.2 (October 11, 2014)

    • Further improvements and bug fixes for printing.
    • Fixed a bug in @defExpr.
    • Support for accessing expression graphs through the MathProgBase NLP interface.

    Version 0.6.1 (September 19, 2014)

    • Improvements and bug fixes for printing.

    Version 0.6.0 (September 9, 2014)

    • Julia 0.3.0 is the minimum required version for this release.
    • buildInternalModel(m::Model) added to build solver-level model in memory without optimizing.
    • Deprecate load_model_only keyword argument to solve.
    • Add groups of constraints with @addConstraints macro.
    • Unicode operators now supported, including for sum, for prod, and /
    • Quadratic constraints supported in @addConstraint macro.
    • Quadratic objectives supported in @setObjective macro.
    • MathProgBase solver-independent interface replaces Ipopt-specific interface for nonlinear problems
      • Breaking change: IpoptOptions no longer supported to specify solver options, use m = Model(solver=IpoptSolver(options...)) instead.
    • New solver interfaces: ECOS, NLopt, and nonlinear support for MOSEK
    • New option to control whether the lazy constraint callback is executed at each node in the B&B tree or just when feasible solutions are found
    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
    • Add support for index dependencies (for example, triangular indexing) in @defVar, @addConstraint, and @defExpr (for example, @defVar(m, x[i=1:10,j=i:10])).
      • This required some changes to the internal structure of JuMP containers, which may break code that explicitly stored JuMPDict objects.

    Version 0.5.8 (September 24, 2014)

    • Fix a bug with specifying solvers (affects Julia 0.2 only)

    Version 0.5.7 (September 5, 2014)

    • Fix a bug in printing models

    Version 0.5.6 (September 2, 2014)

    • Add support for semicontinuous and semi-integer variables for those solvers that support them.
      • Breaking change: Syntax for Variable() constructor has changed (use of this interface remains discouraged)
    • Update for breaking changes in MathProgBase

    Version 0.5.5 (July 6, 2014)

    • Fix bug with problem modification: adding variables that did not appear in existing constraints or objective.

    Version 0.5.4 (June 19, 2014)

    • Update for breaking change in MathProgBase which reduces loading times for using JuMP
    • Fix error when MIPs not solved to optimality

    Version 0.5.3 (May 21, 2014)

    • Update for breaking change in ReverseDiffSparse

    Version 0.5.2 (May 9, 2014)

    • Fix compatibility with Julia 0.3 prerelease

    Version 0.5.1 (May 5, 2014)

    • Fix a bug in coefficient handling inside lazy constraints and user cuts

    Version 0.5.0 (May 2, 2014)

    • Support for nonlinear optimization with exact, sparse second-order derivatives automatically computed. Ipopt is currently the only solver supported.
    • getValue for AffExpr and QuadExpr
    • Breaking change: getSolverModel replaced by getInternalModel, which returns the internal MathProgBase-level model
    • Groups of constraints can be specified with @addConstraint (see documentation for details). This is not a breaking change.
    • dot(::JuMPDict{Variable},::JuMPDict{Variable}) now returns the corresponding quadratic expression.

    Version 0.4.1 (March 24, 2014)

    • Fix bug where change in objective sense was ignored when re-solving a model.
    • Fix issue with handling zero coefficients in AffExpr.

    Version 0.4.0 (March 10, 2014)

    • Support for SOS1 and SOS2 constraints.
    • Solver-independent callback for user heuristics.
    • dot and sum implemented for JuMPDict objects. Now you can say @addConstraint(m, dot(a,x) <= b).
    • Developers: support for extensions to JuMP. See definition of Model in src/JuMP.jl for more details.
    • Option to construct the low-level model before optimizing.

    Version 0.3.2 (February 17, 2014)

    • Improved model printing
      • Preliminary support for IJulia output

    Version 0.3.1 (January 30, 2014)

    • Documentation updates
    • Support for MOSEK
    • CPLEXLink renamed to CPLEX

    Version 0.3.0 (January 21, 2014)

    • Unbounded/infeasibility rays: getValue() will return the corresponding components of an unbounded ray when a model is unbounded, if supported by the selected solver. getDual() will return an infeasibility ray (Farkas proof) if a model is infeasible and the selected solver supports this feature.
    • Solver-independent callbacks for user generated cuts.
    • Use new interface for solver-independent QCQP.
    • setlazycallback renamed to setLazyCallback for consistency.

    Version 0.2.0 (December 15, 2013)

    Breaking

    • Objective sense is specified in setObjective instead of in the Model constructor.
    • lpsolver and mipsolver merged into single solver option.

    Added

    • Problem modification with efficient LP restarts and MIP warm-starts.
    • Relatedly, column-wise modeling now supported.
    • Solver-independent callbacks supported. Currently we support only a "lazy constraint" callback, which works with Gurobi, CPLEX, and GLPK. More callbacks coming soon.

    Version 0.1.2 (November 16, 2013)

    • Bug fixes for printing, improved error messages.
    • Allow AffExpr to be used in macros; for example, ex = y + z; @addConstraint(m, x + 2*ex <= 3)

    Version 0.1.1 (October 23, 2013)

    • Update for solver specification API changes in MathProgBase.

    Version 0.1.0 (October 3, 2013)

    • Initial public release.
    diff --git a/previews/PR3913/should_i_use/index.html b/previews/PR3913/should_i_use/index.html index 026c47afccc..0217281cb05 100644 --- a/previews/PR3913/should_i_use/index.html +++ b/previews/PR3913/should_i_use/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Should you use JuMP?

    JuMP is an algebraic modeling language for mathematical optimization written in the Julia language.

    This page explains when you should consider using JuMP, and importantly, when you should not use JuMP.

    When should you use JuMP?

    You should use JuMP if you have a constrained optimization problem that is formulated using the language of mathematical programming, that is, the problem has:

    • a set of real- or complex-valued decision variables
    • a scalar- or vector-valued real objective function
    • a set of constraints.

    Key reasons to use JuMP include:

    • User friendliness
    • Solver independence
      • JuMP uses a generic solver-independent interface provided by the MathOptInterface package, making it easy to change between a number of open-source and commercial optimization software packages ("solvers"). The Supported solvers section contains a table of the currently supported solvers.
    • Ease of embedding
      • JuMP itself is written purely in Julia. Solvers are the only binary dependencies.
      • JuMP provides automatic installation of most solvers.
      • Because it is embedded in a general-purpose programming language, JuMP makes it easy to solve optimization problems as part of a larger workflow, for example, inside a simulation, behind a web server, or as a subproblem in a decomposition algorithm. As a trade-off, JuMP's syntax is constrained by the syntax and functionality available in Julia.
      • JuMP is MPL licensed, meaning that it can be embedded in commercial software that complies with the terms of the license.
    • Speed
      • Benchmarking has shown that JuMP can create problems at similar speeds to special-purpose modeling languages such as AMPL.
      • JuMP communicates with most solvers in memory, avoiding the need to write intermediary files.
    • Access to advanced algorithmic techniques
      • JuMP supports efficient in-memory re-solves of models.
      • JuMP provides access to solver-independent and solver-dependent Callbacks.

    When should you not use JuMP?

    JuMP supports a broad range of optimization classes. However, there are still some that it doesn't support, or that are better supported by other software packages.

    You want to optimize a complicated Julia function

    Packages in Julia compose well. It's common for people to pick two unrelated packages and use them in conjunction to create novel behavior. JuMP isn't one of those packages.

    If you want to optimize an ordinary differential equation from DifferentialEquations.jl or tune a neural network from Flux.jl, consider using other packages such as:

    Black-box, derivative free, or unconstrained optimization

    JuMP supports nonlinear programs with constraints and objectives containing user-defined operators. However, the functions must be automatically differentiable, or you need to provide explicit derivatives. (See User-defined operators for more information.)

    If your function is a black-box that is non-differentiable (for example, the function calls a simulation written in C++), JuMP is not the right tool for the job. This also applies if you want to use a derivative free method.

    Even if your problem is differentiable, if it is unconstrained there is limited benefit (and downsides in the form of more overhead) to using JuMP over tools which are concerned only with function minimization.

    Alternatives to consider are:

    Disciplined convex programming

    JuMP does not support disciplined convex programming (DCP).

    Alternatives to consider are:

    Note

    Convex.jl is also built on MathOptInterface, and shares the same set of underlying solvers. However, you input problems differently, and Convex.jl checks that the problem is DCP.

    Stochastic programming

    JuMP requires deterministic input data.

    If you have stochastic input data, consider using a JuMP extension such as:

    Polyhedral computations

    JuMP does not provide tools for working with the polyhedron formed by the set of linear constraints.

    Alternatives to consider are:

    +

    Should you use JuMP?

    JuMP is an algebraic modeling language for mathematical optimization written in the Julia language.

    This page explains when you should consider using JuMP, and importantly, when you should not use JuMP.

    When should you use JuMP?

    You should use JuMP if you have a constrained optimization problem that is formulated using the language of mathematical programming, that is, the problem has:

    • a set of real- or complex-valued decision variables
    • a scalar- or vector-valued real objective function
    • a set of constraints.

    Key reasons to use JuMP include:

    • User friendliness
    • Solver independence
      • JuMP uses a generic solver-independent interface provided by the MathOptInterface package, making it easy to change between a number of open-source and commercial optimization software packages ("solvers"). The Supported solvers section contains a table of the currently supported solvers.
    • Ease of embedding
      • JuMP itself is written purely in Julia. Solvers are the only binary dependencies.
      • JuMP provides automatic installation of most solvers.
      • Because it is embedded in a general-purpose programming language, JuMP makes it easy to solve optimization problems as part of a larger workflow, for example, inside a simulation, behind a web server, or as a subproblem in a decomposition algorithm. As a trade-off, JuMP's syntax is constrained by the syntax and functionality available in Julia.
      • JuMP is MPL licensed, meaning that it can be embedded in commercial software that complies with the terms of the license.
    • Speed
      • Benchmarking has shown that JuMP can create problems at similar speeds to special-purpose modeling languages such as AMPL.
      • JuMP communicates with most solvers in memory, avoiding the need to write intermediary files.
    • Access to advanced algorithmic techniques
      • JuMP supports efficient in-memory re-solves of models.
      • JuMP provides access to solver-independent and solver-dependent Callbacks.

    When should you not use JuMP?

    JuMP supports a broad range of optimization classes. However, there are still some that it doesn't support, or that are better supported by other software packages.

    You want to optimize a complicated Julia function

    Packages in Julia compose well. It's common for people to pick two unrelated packages and use them in conjunction to create novel behavior. JuMP isn't one of those packages.

    If you want to optimize an ordinary differential equation from DifferentialEquations.jl or tune a neural network from Flux.jl, consider using other packages such as:

    Black-box, derivative free, or unconstrained optimization

    JuMP supports nonlinear programs with constraints and objectives containing user-defined operators. However, the functions must be automatically differentiable, or you need to provide explicit derivatives. (See User-defined operators for more information.)

    If your function is a black-box that is non-differentiable (for example, the function calls a simulation written in C++), JuMP is not the right tool for the job. This also applies if you want to use a derivative free method.

    Even if your problem is differentiable, if it is unconstrained there is limited benefit (and downsides in the form of more overhead) to using JuMP over tools which are concerned only with function minimization.

    Alternatives to consider are:

    Disciplined convex programming

    JuMP does not support disciplined convex programming (DCP).

    Alternatives to consider are:

    Note

    Convex.jl is also built on MathOptInterface, and shares the same set of underlying solvers. However, you input problems differently, and Convex.jl checks that the problem is DCP.

    Stochastic programming

    JuMP requires deterministic input data.

    If you have stochastic input data, consider using a JuMP extension such as:

    Polyhedral computations

    JuMP does not provide tools for working with the polyhedron formed by the set of linear constraints.

    Alternatives to consider are:

    diff --git a/previews/PR3913/tutorials/algorithms/benders_decomposition/index.html b/previews/PR3913/tutorials/algorithms/benders_decomposition/index.html index ba990c2aa0e..ddaf4a33a3e 100644 --- a/previews/PR3913/tutorials/algorithms/benders_decomposition/index.html +++ b/previews/PR3913/tutorials/algorithms/benders_decomposition/index.html @@ -66,7 +66,7 @@ Dual objective value : NaN * Work counters - Solve time (sec) : 1.55663e-03 + Solve time (sec) : 1.90449e-03 Simplex iterations : 15 Barrier iterations : -1 Node count : 1 @@ -417,4 +417,4 @@ (3, 6) => 1.0 (4, 6) => 1.0 (5, 8) => 4.0 - (6, 8) => 2.0

    which is the same as the monolithic solution (because sum(y) >= 1 in the monolithic solution):

    feasible_inplace_solution == monolithic_solution
    true
    + (6, 8) => 2.0

    which is the same as the monolithic solution (because sum(y) >= 1 in the monolithic solution):

    feasible_inplace_solution == monolithic_solution
    true
    diff --git a/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/044e7623.svg b/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/09820ee9.svg similarity index 69% rename from previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/044e7623.svg rename to previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/09820ee9.svg index 865a977fc8f..a2bf8b2891a 100644 --- a/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/044e7623.svg +++ b/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/09820ee9.svg @@ -1,516 +1,516 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/37cf2941.svg b/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/509b86df.svg similarity index 72% rename from previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/37cf2941.svg rename to previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/509b86df.svg index acef2b0eb6e..93051511c7f 100644 --- a/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/37cf2941.svg +++ b/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/509b86df.svg @@ -1,350 +1,350 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/index.html b/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/index.html index 68d241475b4..337adb7122c 100644 --- a/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/index.html +++ b/previews/PR3913/tutorials/algorithms/cutting_stock_column_generation/index.html @@ -118,8 +118,8 @@ Dual objective value : NaN * Work counters - Solve time (sec) : 5.04970e+00 - Simplex iterations : 20396 + Solve time (sec) : 5.05041e+00 + Simplex iterations : 20589 Barrier iterations : -1 Node count : 0

    However, there is a formulation that solves much faster, and that is to use a column generation scheme.

    Column generation theory

    The key insight for column generation is to recognize that feasible columns in the $x$ matrix of variables encode cutting patterns.

    For example, if we look only at the roll $j=1$, then a feasible solution is:

    • $x_{1,1} = 1$ (1 unit of piece #1)
    • $x_{13,1} = 1$ (1 unit of piece #13)
    • All other $x_{i,1} = 0$

    Another solution is

    • $x_{20,1} = 19$ (19 unit of piece #20)
    • All other $x_{i,1} = 0$

    Cutting patterns like $x_{1,1} = 1$ and $x_{2,1} = 1$ are infeasible because the combined length is greater than $W$.

    Since there are a finite number of ways that we could cut a roll into a valid cutting pattern, we could create a set of all possible cutting patterns $p = 1,\ldots,P$, with data $a_{i,p}$ indicating how many units of piece $i$ we cut in pattern $p$. Then, we can formulate our mixed-integer linear program as:

    \[\begin{align} @@ -189,7 +189,7 @@ return plot end -plot_patterns(data, patterns)Example block output

    The base problem

    Using the initial set of patterns, we can create and optimize our base model:

    model = Model(HiGHS.Optimizer)
    +plot_patterns(data, patterns)
    Example block output

    The base problem

    Using the initial set of patterns, we can create and optimize our base model:

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, x[1:length(patterns)] >= 0, Int)
     @objective(model, Min, sum(x))
    @@ -213,7 +213,7 @@
       Dual objective value : NaN
     
     * Work counters
    -  Solve time (sec)   : 2.08855e-04
    +  Solve time (sec)   : 1.45674e-04
       Simplex iterations : 0
       Barrier iterations : -1
       Node count         : 0
    @@ -285,7 +285,7 @@
     [ Info: No new patterns, terminating the algorithm.

    We found lots of new patterns. Here's pattern 21:

    patterns[21]
    20-element SparseArrays.SparseVector{Int64, Int64} with 3 stored entries:
       [9 ]  =  1
       [13]  =  2
    -  [17]  =  1

    Let's have a look at the patterns now:

    plot_patterns(data, patterns)
    Example block output

    Looking at the solution

    Let's see how many of each column we need:

    solution = DataFrames.DataFrame([
    +  [17]  =  1

    Let's have a look at the patterns now:

    plot_patterns(data, patterns)
    Example block output

    Looking at the solution

    Let's see how many of each column we need:

    solution = DataFrames.DataFrame([
         (pattern = p, rolls = value(x_p)) for (p, x_p) in enumerate(x)
     ])
     filter!(row -> row.rolls > 0, solution)
    16×2 DataFrame
    Rowpatternrolls
    Int64Float64
    1138.0
    2244.0
    3330.0
    4210.5
    52210.2
    62314.65
    72423.1
    82511.25
    92621.35
    10284.3
    112919.55
    123011.25
    133117.45
    143336.0
    153411.4
    163541.0

    Since we solved a linear program, some of our columns have fractional solutions. We can create a integer feasible solution by rounding up the orders. This requires 341 rolls:

    sum(ceil.(Int, solution.rolls))
    341

    Alternatively, we can re-introduce the integrality constraints and resolve the problem:

    set_integer.(x)
    @@ -294,4 +294,4 @@
     solution = DataFrames.DataFrame([
         (pattern = p, rolls = value(x_p)) for (p, x_p) in enumerate(x)
     ])
    -filter!(row -> row.rolls > 0, solution)
    16×2 DataFrame
    Rowpatternrolls
    Int64Float64
    1138.0
    2244.0
    3330.0
    4211.0
    5229.0
    62319.0
    72419.0
    82513.0
    92617.0
    10282.0
    112919.0
    123013.0
    133118.0
    143336.0
    153415.0
    163541.0

    This now requires 334 rolls:

    sum(solution.rolls)
    333.99999999999994

    Note that this may not be the global minimum because we are not adding new columns during the solution of the mixed-integer problem model (an algorithm known as branch and price). Nevertheless, the column generation algorithm typically finds good integer feasible solutions to an otherwise intractable optimization problem.

    Next steps

    • Our objective function is to minimize the total number of rolls. What is the total length of waste? How does that compare to the total demand?
    • Writing the optimization algorithm is only part of the challenge. Can you develop a better way to communicate the solution to stakeholders?
    +filter!(row -> row.rolls > 0, solution)
    16×2 DataFrame
    Rowpatternrolls
    Int64Float64
    1138.0
    2244.0
    3330.0
    4211.0
    5229.0
    62319.0
    72419.0
    82513.0
    92617.0
    10282.0
    112919.0
    123013.0
    133118.0
    143336.0
    153415.0
    163541.0

    This now requires 334 rolls:

    sum(solution.rolls)
    333.99999999999994

    Note that this may not be the global minimum because we are not adding new columns during the solution of the mixed-integer problem model (an algorithm known as branch and price). Nevertheless, the column generation algorithm typically finds good integer feasible solutions to an otherwise intractable optimization problem.

    Next steps

    • Our objective function is to minimize the total number of rolls. What is the total length of waste? How does that compare to the total demand?
    • Writing the optimization algorithm is only part of the challenge. Can you develop a better way to communicate the solution to stakeholders?
    diff --git a/previews/PR3913/tutorials/algorithms/parallelism/index.html b/previews/PR3913/tutorials/algorithms/parallelism/index.html index 2f284c266a0..81d466e2567 100644 --- a/previews/PR3913/tutorials/algorithms/parallelism/index.html +++ b/previews/PR3913/tutorials/algorithms/parallelism/index.html @@ -177,4 +177,4 @@ model = Model(Gurobi.Optimizer) set_attribute(model, MOI.NumberOfThreads(), 4)

    GPU parallelism

    JuMP does not support GPU programming, but some solvers support execution on a GPU.

    One example is SCS.jl, which supports using a GPU to internally solve a system of linear equations. If you are on x86_64 Linux machine, do:

    using JuMP, SCS, SCS_GPU_jll
     model = Model(SCS.Optimizer)
    -set_attribute(model, "linear_solver", SCS.GpuIndirectSolver)
    +set_attribute(model, "linear_solver", SCS.GpuIndirectSolver) diff --git a/previews/PR3913/tutorials/algorithms/pdhg/index.html b/previews/PR3913/tutorials/algorithms/pdhg/index.html index 024218dbde1..a98f43abadc 100644 --- a/previews/PR3913/tutorials/algorithms/pdhg/index.html +++ b/previews/PR3913/tutorials/algorithms/pdhg/index.html @@ -314,7 +314,7 @@ c3 : [-1.93193e-06,2.50002e-01,1.50000e+00] * Work counters - Solve time (sec) : 2.15682e-01 + Solve time (sec) : 2.10877e-01 Barrier iterations : 8365

    But we could also have written:

    model = Model(Optimizer)
     @variable(model, x >= 0)
    @@ -352,7 +352,7 @@
         c2 : 1.50000e+00
     
     * Work counters
    -  Solve time (sec)   : 1.75595e-03
    +  Solve time (sec)   : 1.74499e-03
       Barrier iterations : 8365
     

    Other variations are also possible:

    model = Model(Optimizer)
     @variable(model, x[1:5] >= 0)
    @@ -390,6 +390,6 @@
         c4 : multiple constraints with the same name
     
     * Work counters
    -  Solve time (sec)   : 1.78480e-03
    +  Solve time (sec)   : 1.67394e-03
       Barrier iterations : 8365
    -

    Behind the scenes, JuMP and MathOptInterface reformulate the problem from the modeller's form into the standard form defined by our Optimizer.

    +

    Behind the scenes, JuMP and MathOptInterface reformulate the problem from the modeller's form into the standard form defined by our Optimizer.

    diff --git a/previews/PR3913/tutorials/algorithms/rolling_horizon/b7eca051.svg b/previews/PR3913/tutorials/algorithms/rolling_horizon/10c2f496.svg similarity index 87% rename from previews/PR3913/tutorials/algorithms/rolling_horizon/b7eca051.svg rename to previews/PR3913/tutorials/algorithms/rolling_horizon/10c2f496.svg index 998ae0641d1..07fcf980e1b 100644 --- a/previews/PR3913/tutorials/algorithms/rolling_horizon/b7eca051.svg +++ b/previews/PR3913/tutorials/algorithms/rolling_horizon/10c2f496.svg @@ -1,360 +1,360 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/rolling_horizon/cd050494.svg b/previews/PR3913/tutorials/algorithms/rolling_horizon/121e9cd2.svg similarity index 86% rename from previews/PR3913/tutorials/algorithms/rolling_horizon/cd050494.svg rename to previews/PR3913/tutorials/algorithms/rolling_horizon/121e9cd2.svg index 1bda164e7a2..16a02e0e106 100644 --- a/previews/PR3913/tutorials/algorithms/rolling_horizon/cd050494.svg +++ b/previews/PR3913/tutorials/algorithms/rolling_horizon/121e9cd2.svg @@ -1,118 +1,118 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/rolling_horizon/1fb109f8.svg b/previews/PR3913/tutorials/algorithms/rolling_horizon/b5882ca1.svg similarity index 90% rename from previews/PR3913/tutorials/algorithms/rolling_horizon/1fb109f8.svg rename to previews/PR3913/tutorials/algorithms/rolling_horizon/b5882ca1.svg index 435d7502cb8..6f76d95ee67 100644 --- a/previews/PR3913/tutorials/algorithms/rolling_horizon/1fb109f8.svg +++ b/previews/PR3913/tutorials/algorithms/rolling_horizon/b5882ca1.svg @@ -1,80 +1,80 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/rolling_horizon/index.html b/previews/PR3913/tutorials/algorithms/rolling_horizon/index.html index 346fbb7a183..9306ae27341 100644 --- a/previews/PR3913/tutorials/algorithms/rolling_horizon/index.html +++ b/previews/PR3913/tutorials/algorithms/rolling_horizon/index.html @@ -29,7 +29,7 @@ xticks = 0:12:total_time_length, xlabel = "Hours", ylabel = "MW", -)Example block output

    JuMP model

    We have all the information we need to create a JuMP model to solve a single window of our rolling horizon problem.

    As the optimizer, we use POI.Optimizer, which is part of ParametricOptInterface.jl. POI.Optimizer converts the Parameter decision variables into constants in the underlying optimization model, and it efficiently updates the solver in-place when we call set_parameter_value which avoids having to rebuild the problem each time we call optimize!.

    model = Model(() -> POI.Optimizer(HiGHS.Optimizer()))
    +)
    Example block output

    JuMP model

    We have all the information we need to create a JuMP model to solve a single window of our rolling horizon problem.

    As the optimizer, we use POI.Optimizer, which is part of ParametricOptInterface.jl. POI.Optimizer converts the Parameter decision variables into constants in the underlying optimization model, and it efficiently updates the solver in-place when we call set_parameter_value which avoids having to rebuild the problem each time we call optimize!.

    model = Model(() -> POI.Optimizer(HiGHS.Optimizer()))
     set_silent(model)
     @variables(model, begin
         0 <= r[1:optimization_window]
    @@ -118,4 +118,4 @@
         layout = (length(sol_windows), 1),
         size = (600, 800),
         margin = 3Plots.mm,
    -)
    Example block output

    We can re-use the function to plot the recovered solution of the full problem:

    plot_solution(sol_complete; offset = 0, xlabel = "Hour")
    Example block output

    Final remark

    ParametricOptInterface.jl offers an easy way to update the parameters of an optimization problem that will be solved several times, as in the rolling horizon implementation. It has the benefit of avoiding rebuilding the model each time we want to solve it with new information in a new window.

    +)Example block output

    We can re-use the function to plot the recovered solution of the full problem:

    plot_solution(sol_complete; offset = 0, xlabel = "Hour")
    Example block output

    Final remark

    ParametricOptInterface.jl offers an easy way to update the parameters of an optimization problem that will be solved several times, as in the rolling horizon implementation. It has the benefit of avoiding rebuilding the model each time we want to solve it with new information in a new window.

    diff --git a/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/18c34496.svg b/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/0c3aa301.svg similarity index 72% rename from previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/18c34496.svg rename to previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/0c3aa301.svg index a8303e0a537..62f2693ea39 100644 --- a/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/18c34496.svg +++ b/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/0c3aa301.svg @@ -1,242 +1,242 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/6412e860.svg b/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/a2c31288.svg similarity index 72% rename from previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/6412e860.svg rename to previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/a2c31288.svg index 5eeb14ed8b4..4a6a260ea69 100644 --- a/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/6412e860.svg +++ b/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/a2c31288.svg @@ -1,242 +1,242 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/index.html b/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/index.html index 36c523e3802..1cbb5ccde0a 100644 --- a/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/index.html +++ b/previews/PR3913/tutorials/algorithms/tsp_lazy_constraints/index.html @@ -97,7 +97,7 @@ Found cycle of length 22 Found cycle of length 3 Found cycle of length 5 -Found cycle of length 21
    objective_value(iterative_model)
    744.6016576596794
    time_iterated
    4.166288137435913

    As a quick sanity check, we visualize the optimal tour to verify that no subtour is present:

    function plot_tour(X, Y, x)
    +Found cycle of length 21
    objective_value(iterative_model)
    744.6016576596794
    time_iterated
    4.096730947494507

    As a quick sanity check, we visualize the optimal tour to verify that no subtour is present:

    function plot_tour(X, Y, x)
         plot = Plots.plot()
         for (i, j) in selected_edges(x, size(x, 1))
             Plots.plot!([X[i], X[j]], [Y[i], Y[j]]; legend = false)
    @@ -105,7 +105,7 @@
         return plot
     end
     
    -plot_tour(X, Y, value.(iterative_model[:x]))
    Example block output

    Lazy constraint method

    A more sophisticated approach makes use of lazy constraints. To be more precise, we do this through the subtour_elimination_callback() below, which is only run whenever we encounter a new integer-feasible solution.

    lazy_model = build_tsp_model(d, n)
    +plot_tour(X, Y, value.(iterative_model[:x]))
    Example block output

    Lazy constraint method

    A more sophisticated approach makes use of lazy constraints. To be more precise, we do this through the subtour_elimination_callback() below, which is only run whenever we encounter a new integer-feasible solution.

    lazy_model = build_tsp_model(d, n)
     function subtour_elimination_callback(cb_data)
         status = callback_node_status(cb_data, lazy_model)
         if status != MOI.CALLBACK_NODE_STATUS_INTEGER
    @@ -132,4 +132,4 @@
     Set parameter LicenseID to value 722777
     Set parameter GURO_PAR_SPECIAL
     WLS license 722777 - registered to JuMP Development
    @assert is_solved_and_feasible(lazy_model)
    -objective_value(lazy_model)
    744.6016576596794
    time_lazy = solve_time(lazy_model)
    2.1133909225463867

    This finds the same optimal tour:

    plot_tour(X, Y, value.(lazy_model[:x]))
    Example block output

    The solution time is faster than the iterative approach:

    Test.@test time_lazy < time_iterated
    Test Passed
    +objective_value(lazy_model)
    744.6016576596794
    time_lazy = solve_time(lazy_model)
    2.038374185562134

    This finds the same optimal tour:

    plot_tour(X, Y, value.(lazy_model[:x]))
    Example block output

    The solution time is faster than the iterative approach:

    Test.@test time_lazy < time_iterated
    Test Passed
    diff --git a/previews/PR3913/tutorials/applications/optimal_power_flow/index.html b/previews/PR3913/tutorials/applications/optimal_power_flow/index.html index 16180e58dd2..6962df679fe 100644 --- a/previews/PR3913/tutorials/applications/optimal_power_flow/index.html +++ b/previews/PR3913/tutorials/applications/optimal_power_flow/index.html @@ -129,7 +129,7 @@ Objective value : 3.08784e+03 * Work counters - Solve time (sec) : 5.45096e-03 + Solve time (sec) : 5.37205e-03 Barrier iterations : 16
    objval_solution = round(objective_value(model); digits = 2)
     println("Objective value (feasible solution) : $(objval_solution)")
    Objective value (feasible solution) : 3087.84

    The solution's power generation (in rectangular form) and complex voltage values (in polar form using degrees) are:

    DataFrames.DataFrame(;
    @@ -215,7 +215,7 @@
       9   1.5653e+03   1.5641e+03  7.67e-04  2.80e-08  3.75e-06  5.96e-03  1.74e-02  4.38e-01
     ---------------------------------------------------------------------------------------------
     Terminated with status = solved
    -solve time = 61.7ms
    Test.@test is_solved_and_feasible(model; allow_almost = true)
    +solve time =  133ms
    Test.@test is_solved_and_feasible(model; allow_almost = true)
     sdp_relaxation_lower_bound = round(objective_value(model); digits = 2)
     println(
         "Objective value (W & V relax. lower bound): $sdp_relaxation_lower_bound",
    @@ -232,4 +232,4 @@
         Bus = 1:N,
         Magnitude = round.(abs.(value.(V)); digits = 2),
         AngleDeg = round.(rad2deg.(angle.(value.(V))); digits = 2),
    -)
    9×3 DataFrame
    RowBusMagnitudeAngleDeg
    Int64Float64Float64
    110.95-0.0
    220.843.76
    330.832.66
    440.85-1.22
    550.86-2.12
    660.860.93
    770.86-0.18
    880.861.14
    990.85-2.47

    For further information on exploiting sparsity see (Jabr, 2012).

    This relaxation has the advantage that we can work directly with complex voltages to extend the formulation, strengthen the relaxation and gain additional approximate information about the voltage variables.

    +)
    9×3 DataFrame
    RowBusMagnitudeAngleDeg
    Int64Float64Float64
    110.95-0.0
    220.843.76
    330.832.66
    440.85-1.22
    550.86-2.12
    660.860.93
    770.86-0.18
    880.861.14
    990.85-2.47

    For further information on exploiting sparsity see (Jabr, 2012).

    This relaxation has the advantage that we can work directly with complex voltages to extend the formulation, strengthen the relaxation and gain additional approximate information about the voltage variables.

    diff --git a/previews/PR3913/tutorials/applications/power_systems/1effff4a.svg b/previews/PR3913/tutorials/applications/power_systems/75ade8a1.svg similarity index 86% rename from previews/PR3913/tutorials/applications/power_systems/1effff4a.svg rename to previews/PR3913/tutorials/applications/power_systems/75ade8a1.svg index f96f59fddcd..7f8ea189168 100644 --- a/previews/PR3913/tutorials/applications/power_systems/1effff4a.svg +++ b/previews/PR3913/tutorials/applications/power_systems/75ade8a1.svg @@ -1,78 +1,78 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/power_systems/7fb7d857.svg b/previews/PR3913/tutorials/applications/power_systems/89a6126d.svg similarity index 85% rename from previews/PR3913/tutorials/applications/power_systems/7fb7d857.svg rename to previews/PR3913/tutorials/applications/power_systems/89a6126d.svg index 222e038e859..2ba7b451b7f 100644 --- a/previews/PR3913/tutorials/applications/power_systems/7fb7d857.svg +++ b/previews/PR3913/tutorials/applications/power_systems/89a6126d.svg @@ -1,43 +1,43 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/power_systems/5f59aa73.svg b/previews/PR3913/tutorials/applications/power_systems/ce91252c.svg similarity index 86% rename from previews/PR3913/tutorials/applications/power_systems/5f59aa73.svg rename to previews/PR3913/tutorials/applications/power_systems/ce91252c.svg index dbfd630ae0f..596e71fc37a 100644 --- a/previews/PR3913/tutorials/applications/power_systems/5f59aa73.svg +++ b/previews/PR3913/tutorials/applications/power_systems/ce91252c.svg @@ -1,80 +1,80 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/power_systems/index.html b/previews/PR3913/tutorials/applications/power_systems/index.html index 383317d0c5c..30aaf885eb3 100644 --- a/previews/PR3913/tutorials/applications/power_systems/index.html +++ b/previews/PR3913/tutorials/applications/power_systems/index.html @@ -98,7 +98,7 @@ (c_g1_scale, sol.g[1], sol.g[2], sol.w, sol.wind_spill, sol.total_cost), ) end -print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.17028188705444336 seconds
    c_g_scale_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.0300.01000.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Modifying the JuMP model in-place

    Note that in the previous exercise we entirely rebuilt the optimization model at every iteration of the internal loop, which incurs an additional computational burden. This burden can be alleviated if instead of re-building the entire model, we modify the constraints or objective function, as it shown in the example below.

    Compare the computing time in case of the above and below models.

    function solve_economic_dispatch_inplace(
    +print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.16886281967163086 seconds
    c_g_scale_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.0300.01000.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Modifying the JuMP model in-place

    Note that in the previous exercise we entirely rebuilt the optimization model at every iteration of the internal loop, which incurs an additional computational burden. This burden can be alleviated if instead of re-building the entire model, we modify the constraints or objective function, as it shown in the example below.

    Compare the computing time in case of the above and below models.

    function solve_economic_dispatch_inplace(
         generators::Vector,
         wind,
         scenario,
    @@ -155,7 +155,7 @@
         scenario,
         0.5:0.1:3.0,
     )
    -print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.17975997924804688 seconds

    For small models, adjusting specific constraints or the objective function is sometimes faster and sometimes slower than re-building the entire model. However, as the problem size increases, updating the model in-place is usually faster.

    inplace_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.01000.0300.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Inefficient usage of wind generators

    The economic dispatch problem does not perform commitment decisions and, thus, assumes that all generators must be dispatched at least at their minimum power output limit. This approach is not cost efficient and may lead to absurd decisions. For example, if $d = \sum_{i \in I} g^{\min}_{i}$, the wind power injection must be zero, that is, all available wind generation is spilled, to meet the minimum power output constraints on generators.

    In the following example, we adjust the total demand and observed how it affects wind spillage.

    demand_scale_df = DataFrames.DataFrame(;
    +print(string("elapsed time: ", time() - start, " seconds"))
    elapsed time: 0.17584800720214844 seconds

    For small models, adjusting specific constraints or the objective function is sometimes faster and sometimes slower than re-building the entire model. However, as the problem size increases, updating the model in-place is usually faster.

    inplace_df
    26×6 DataFrame
    Rowscaledispatch_G1dispatch_G2dispatch_windspillage_windtotal_cost
    Float64Float64Float64Float64Float64Float64
    10.51000.0300.0200.00.065000.0
    20.61000.0300.0200.00.070000.0
    30.71000.0300.0200.00.075000.0
    40.81000.0300.0200.00.080000.0
    50.91000.0300.0200.00.085000.0
    61.01000.0300.0200.00.090000.0
    71.11000.0300.0200.00.095000.0
    81.21000.0300.0200.00.0100000.0
    91.31000.0300.0200.00.0105000.0
    101.41000.0300.0200.00.0110000.0
    111.51000.0300.0200.00.0115000.0
    121.61000.0300.0200.00.0120000.0
    131.71000.0300.0200.00.0125000.0
    141.81000.0300.0200.00.0130000.0
    151.91000.0300.0200.00.0135000.0
    162.01000.0300.0200.00.0140000.0
    172.1300.01000.0200.00.0141500.0
    182.2300.01000.0200.00.0143000.0
    192.3300.01000.0200.00.0144500.0
    202.4300.01000.0200.00.0146000.0
    212.5300.01000.0200.00.0147500.0
    222.6300.01000.0200.00.0149000.0
    232.7300.01000.0200.00.0150500.0
    242.8300.01000.0200.00.0152000.0
    252.9300.01000.0200.00.0153500.0
    263.0300.01000.0200.00.0155000.0

    Inefficient usage of wind generators

    The economic dispatch problem does not perform commitment decisions and, thus, assumes that all generators must be dispatched at least at their minimum power output limit. This approach is not cost efficient and may lead to absurd decisions. For example, if $d = \sum_{i \in I} g^{\min}_{i}$, the wind power injection must be zero, that is, all available wind generation is spilled, to meet the minimum power output constraints on generators.

    In the following example, we adjust the total demand and observed how it affects wind spillage.

    demand_scale_df = DataFrames.DataFrame(;
         demand = Float64[],
         dispatch_G1 = Float64[],
         dispatch_G2 = Float64[],
    @@ -212,7 +212,7 @@
         ),
     )
     
    -Plots.plot(dispatch_plot, wind_plot)
    Example block output

    This particular drawback can be overcome by introducing binary decisions on the "on/off" status of generators. This model is called unit commitment and considered later in these notes.

    For further reading on the interplay between wind generation and the minimum power output constraints of generators, we refer interested readers to R. Baldick, "Wind and energy markets: a case study of Texas," IEEE Systems Journal, vol. 6, pp. 27-34, 2012.

    Unit commitment

    The Unit Commitment (UC) model can be obtained from ED model by introducing binary variable associated with each generator. This binary variable can attain two values: if it is "1," the generator is synchronized and, thus, can be dispatched, otherwise, that is, if the binary variable is "0," that generator is not synchronized and its power output is set to 0.

    To obtain the mathematical formulation of the UC model, we will modify the constraints of the ED model as follows:

    \[g^{\min}_{i} \cdot u_{t,i} \leq g_{i} \leq g^{\max}_{i} \cdot u_{t,i},\]

    where $u_{i} \in \{0,1\}.$ In this constraint, if $u_{i} = 0$, then $g_{i} = 0$. On the other hand, if $u_{i} = 1$, then $g^{min}_{i} \leq g_{i} \leq g^{max}_{i}$.

    For further reading on the UC problem we refer interested readers to G. Morales-Espana, J. M. Latorre, and A. Ramos, "Tight and Compact MILP Formulation for the Thermal Unit Commitment Problem," IEEE Transactions on Power Systems, vol. 28, pp. 4897-4908, 2013.

    In the following example we convert the ED model explained above to the UC model.

    function solve_unit_commitment(generators::Vector, wind, scenario)
    +Plots.plot(dispatch_plot, wind_plot)
    Example block output

    This particular drawback can be overcome by introducing binary decisions on the "on/off" status of generators. This model is called unit commitment and considered later in these notes.

    For further reading on the interplay between wind generation and the minimum power output constraints of generators, we refer interested readers to R. Baldick, "Wind and energy markets: a case study of Texas," IEEE Systems Journal, vol. 6, pp. 27-34, 2012.

    Unit commitment

    The Unit Commitment (UC) model can be obtained from ED model by introducing binary variable associated with each generator. This binary variable can attain two values: if it is "1," the generator is synchronized and, thus, can be dispatched, otherwise, that is, if the binary variable is "0," that generator is not synchronized and its power output is set to 0.

    To obtain the mathematical formulation of the UC model, we will modify the constraints of the ED model as follows:

    \[g^{\min}_{i} \cdot u_{t,i} \leq g_{i} \leq g^{\max}_{i} \cdot u_{t,i},\]

    where $u_{i} \in \{0,1\}.$ In this constraint, if $u_{i} = 0$, then $g_{i} = 0$. On the other hand, if $u_{i} = 1$, then $g^{min}_{i} \leq g_{i} \leq g^{max}_{i}$.

    For further reading on the UC problem we refer interested readers to G. Morales-Espana, J. M. Latorre, and A. Ramos, "Tight and Compact MILP Formulation for the Thermal Unit Commitment Problem," IEEE Transactions on Power Systems, vol. 28, pp. 4897-4908, 2013.

    In the following example we convert the ED model explained above to the UC model.

    function solve_unit_commitment(generators::Vector, wind, scenario)
         model = Model(HiGHS.Optimizer)
         set_silent(model)
         N = length(generators)
    @@ -325,7 +325,7 @@
         ),
     )
     
    -Plots.plot(commitment_plot, dispatch_plot)
    Example block output

    Nonlinear economic dispatch

    As a final example, we modify our economic dispatch problem in two ways:

    • The thermal cost function is user-defined
    • The output of the wind is only the square-root of the dispatch
    import Ipopt
    +Plots.plot(commitment_plot, dispatch_plot)
    Example block output

    Nonlinear economic dispatch

    As a final example, we modify our economic dispatch problem in two ways:

    • The thermal cost function is user-defined
    • The output of the wind is only the square-root of the dispatch
    import Ipopt
     
     """
         thermal_cost_function(g)
    @@ -395,4 +395,4 @@
         xlabel = "Cost",
         ylabel = "Dispatch [MW]",
         label = false,
    -)
    Example block output +)Example block output diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/048f5528.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/048f5528.svg new file mode 100644 index 00000000000..25d3b6e140e --- /dev/null +++ b/previews/PR3913/tutorials/applications/two_stage_stochastic/048f5528.svg @@ -0,0 +1,130 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/0d0ebf54.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/0d0ebf54.svg new file mode 100644 index 00000000000..5532616f5c6 --- /dev/null +++ b/previews/PR3913/tutorials/applications/two_stage_stochastic/0d0ebf54.svg @@ -0,0 +1,93 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/215ff7c1.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/215ff7c1.svg deleted file mode 100644 index c6c5b555a87..00000000000 --- a/previews/PR3913/tutorials/applications/two_stage_stochastic/215ff7c1.svg +++ /dev/null @@ -1,73 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/299a251d.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/299a251d.svg deleted file mode 100644 index efd56776de4..00000000000 --- a/previews/PR3913/tutorials/applications/two_stage_stochastic/299a251d.svg +++ /dev/null @@ -1,102 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/3fdcc408.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/3fdcc408.svg new file mode 100644 index 00000000000..c24fba5a860 --- /dev/null +++ b/previews/PR3913/tutorials/applications/two_stage_stochastic/3fdcc408.svg @@ -0,0 +1,89 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/a0085235.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/a0085235.svg deleted file mode 100644 index f7607a07ba0..00000000000 --- a/previews/PR3913/tutorials/applications/two_stage_stochastic/a0085235.svg +++ /dev/null @@ -1,99 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/ac1a4494.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/ac1a4494.svg new file mode 100644 index 00000000000..438d38373b0 --- /dev/null +++ b/previews/PR3913/tutorials/applications/two_stage_stochastic/ac1a4494.svg @@ -0,0 +1,105 @@ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/d21f542e.svg b/previews/PR3913/tutorials/applications/two_stage_stochastic/d21f542e.svg deleted file mode 100644 index 4fd68dc92ab..00000000000 --- a/previews/PR3913/tutorials/applications/two_stage_stochastic/d21f542e.svg +++ /dev/null @@ -1,77 +0,0 @@ - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - diff --git a/previews/PR3913/tutorials/applications/two_stage_stochastic/index.html b/previews/PR3913/tutorials/applications/two_stage_stochastic/index.html index 9e673f87746..04d4be1e0b8 100644 --- a/previews/PR3913/tutorials/applications/two_stage_stochastic/index.html +++ b/previews/PR3913/tutorials/applications/two_stage_stochastic/index.html @@ -18,7 +18,7 @@ d = sort!(rand(D, N)); Ω = 1:N P = fill(1 / N, N); -StatsPlots.histogram(d; bins = 20, label = "", xlabel = "Demand")Example block output

    JuMP model

    The implementation of our two-stage stochastic program in JuMP is:

    model = Model(HiGHS.Optimizer)
    +StatsPlots.histogram(d; bins = 20, label = "", xlabel = "Demand")
    Example block output

    JuMP model

    The implementation of our two-stage stochastic program in JuMP is:

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, x >= 0)
     @variable(model, 0 <= y[ω in Ω] <= d[ω])
    @@ -38,37 +38,37 @@
     * Candidate solution (result #1)
       Primal status      : FEASIBLE_POINT
       Dual status        : FEASIBLE_POINT
    -  Objective value    : 5.50021e+02
    -  Objective bound    : 5.50021e+02
    -  Relative gap       : 2.06695e-16
    -  Dual objective value : 5.50021e+02
    +  Objective value    : 5.71196e+02
    +  Objective bound    : 5.71196e+02
    +  Relative gap       : 9.95164e-16
    +  Dual objective value : 5.71196e+02
     
     * Work counters
    -  Solve time (sec)   : 3.71456e-04
    +  Solve time (sec)   : 3.51667e-04
       Simplex iterations : 42
       Barrier iterations : 0
       Node count         : -1
    -

    The optimal number of pies to make is:

    value(x)
    201.89659831000657

    The distribution of total profit is:

    total_profit = [-2 * value(x) + value(z[ω]) for ω in Ω]
    100-element Vector{Float64}:
    - 405.4353685691771
    - 412.9715920029268
    - 421.7679787727125
    - 427.3138371618473
    - 427.41784539401925
    - 429.7319135759894
    - 434.571437004516
    - 438.3784152127069
    - 438.79067768888837
    - 443.64300201018153
    +

    The optimal number of pies to make is:

    value(x)
    208.73415338263257

    The distribution of total profit is:

    total_profit = [-2 * value(x) + value(z[ω]) for ω in Ω]
    100-element Vector{Float64}:
    + 332.9216855334716
    + 388.27103683631725
    + 422.6223799359039
    + 422.7281743431403
    + 423.6855089499142
    + 432.63120338888126
    + 445.49200224714804
    + 470.7573619320271
    + 470.92186689259194
    + 480.8341813992874
        ⋮
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196
    - 605.6897949300196

    Let's plot it:

    """
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977
    + 626.2024601478977

    Let's plot it:

    """
         bin_distribution(x::Vector{Float64}, N::Int)
     
     A helper function that discretizes `x` into bins of width `N`.
    @@ -89,7 +89,7 @@
         label = "Expected profit (\$$(round(Int, μ)))",
         linewidth = 3,
     )
    -plot
    Example block output

    Risk measures

    A risk measure is a function which maps a random variable to a real number. Common risk measures include the mean (expectation), median, mode, and maximum. We need a risk measure to convert the distribution of second stage costs into a single number that can be optimized.

    Our model currently uses the expectation risk measure, but others are possible too. One popular risk measure is the conditional value at risk (CVaR).

    CVaR has a parameter $\gamma$, and it computes the expectation of the worst $\gamma$ fraction of outcomes.

    If we are maximizing, so that small outcomes are bad, the definition of CVaR is:

    \[CVaR_{\gamma}[Z] = \max\limits_{\xi} \;\; \xi - \frac{1}{\gamma}\mathbb{E}_\omega\left[(\xi - Z)_+\right]\]

    which can be formulated as the linear program:

    \[\begin{aligned} +plotExample block output

    Risk measures

    A risk measure is a function which maps a random variable to a real number. Common risk measures include the mean (expectation), median, mode, and maximum. We need a risk measure to convert the distribution of second stage costs into a single number that can be optimized.

    Our model currently uses the expectation risk measure, but others are possible too. One popular risk measure is the conditional value at risk (CVaR).

    CVaR has a parameter $\gamma$, and it computes the expectation of the worst $\gamma$ fraction of outcomes.

    If we are maximizing, so that small outcomes are bad, the definition of CVaR is:

    \[CVaR_{\gamma}[Z] = \max\limits_{\xi} \;\; \xi - \frac{1}{\gamma}\mathbb{E}_\omega\left[(\xi - Z)_+\right]\]

    which can be formulated as the linear program:

    \[\begin{aligned} CVaR_{\gamma}[Z] = \max\limits_{\xi, z_\omega} \;\; & \xi - \frac{1}{\gamma}\sum P_\omega z_\omega\\ & z_\omega \ge \xi - Z_\omega & \quad \forall \omega \\ & z_\omega \ge 0 & \quad \forall \omega. @@ -105,7 +105,7 @@ optimize!(model) @assert is_solved_and_feasible(model) return objective_value(model) -end

    CVaR (generic function with 1 method)

    When γ is 1.0, we compute the mean of the profit:

    cvar_10 = CVaR(total_profit, P; γ = 1.0)
    550.0212663461099
    Statistics.mean(total_profit)
    550.0212663461101

    As γ approaches 0.0, we compute the worst-case (minimum) profit:

    cvar_00 = CVaR(total_profit, P; γ = 0.0001)
    405.4353685691771
    minimum(total_profit)
    405.4353685691771

    By varying γ between 0 and 1 we can compute some trade-off of these two extremes:

    cvar_05 = CVaR(total_profit, P; γ = 0.5)
    497.7888085187476

    Let's plot these outcomes on our distribution:

    plot = StatsPlots.histogram(
    +end
    CVaR (generic function with 1 method)

    When γ is 1.0, we compute the mean of the profit:

    cvar_10 = CVaR(total_profit, P; γ = 1.0)
    571.1963924209059
    Statistics.mean(total_profit)
    571.1963924209059

    As γ approaches 0.0, we compute the worst-case (minimum) profit:

    cvar_00 = CVaR(total_profit, P; γ = 0.0001)
    332.9216855334716
    minimum(total_profit)
    332.9216855334716

    By varying γ between 0 and 1 we can compute some trade-off of these two extremes:

    cvar_05 = CVaR(total_profit, P; γ = 0.5)
    520.2543866818612

    Let's plot these outcomes on our distribution:

    plot = StatsPlots.histogram(
         total_profit;
         bins = bin_distribution(total_profit, 25),
         label = "",
    @@ -118,7 +118,7 @@
         label = ["γ = 1.0" "γ = 0.5" "γ = 0.0"],
         linewidth = 3,
     )
    -plot
    Example block output

    Risk averse sample average approximation

    Because CVaR can be formulated as a linear program, we can form a risk averse sample average approximation model by combining the two formulations:

    γ = 0.4
    +plot
    Example block output

    Risk averse sample average approximation

    Because CVaR can be formulated as a linear program, we can form a risk averse sample average approximation model by combining the two formulations:

    γ = 0.4
     model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, x >= 0)
    @@ -130,7 +130,7 @@
     @constraint(model, [ω in Ω], z[ω] >= ξ - Z[ω])
     @objective(model, Max, -2x + ξ - 1 / γ * sum(P[ω] * z[ω] for ω in Ω))
     optimize!(model)
    -@assert is_solved_and_feasible(model)

    When $\gamma = 0.4$, the optimal number of pies to bake is:

    value(x)
    180.59344489218662

    The distribution of total profit is:

    risk_averse_total_profit = [value(-2x + Z[ω]) for ω in Ω]
    +@assert is_solved_and_feasible(model)

    When $\gamma = 0.4$, the optimal number of pies to bake is:

    value(x)
    190.7699246927299

    The distribution of total profit is:

    risk_averse_total_profit = [value(-2x + Z[ω]) for ω in Ω]
     bins = bin_distribution([total_profit; risk_averse_total_profit], 25)
     plot = StatsPlots.histogram(total_profit; label = "Expectation", bins = bins)
     StatsPlots.histogram!(
    @@ -140,4 +140,4 @@
         bins = bins,
         alpha = 0.5,
     )
    -plot
    Example block output

    Next steps

    • Try solving this problem for different numbers of samples and different distributions.
    • Refactor the example to avoid hard-coding the costs. What happens to the solution if the cost of disposing unsold pies increases?
    • Plot the optimal number of pies to make for different values of the risk aversion parameter $\gamma$. What is the relationship?
    +plotExample block output

    Next steps

    • Try solving this problem for different numbers of samples and different distributions.
    • Refactor the example to avoid hard-coding the costs. What happens to the solution if the cost of disposing unsold pies increases?
    • Plot the optimal number of pies to make for different values of the risk aversion parameter $\gamma$. What is the relationship?
    diff --git a/previews/PR3913/tutorials/applications/web_app/index.html b/previews/PR3913/tutorials/applications/web_app/index.html index a3a697c9a01..2b2790b5dee 100644 --- a/previews/PR3913/tutorials/applications/web_app/index.html +++ b/previews/PR3913/tutorials/applications/web_app/index.html @@ -59,7 +59,7 @@ end end return server -end
    setup_server (generic function with 1 method)
    Warning

    HTTP.jl does not serve requests on a separate thread. Therefore, a long-running job will block the main thread, preventing concurrent users from submitting requests. To work-around this, read HTTP.jl issue 798 or watch Building Microservices and Applications in Julia from JuliaCon 2020.

    server = setup_server(HTTP.ip"127.0.0.1", 8080)
    Sockets.TCPServer(RawFD(38) active)

    The client side

    Now that we have a server, we can send it requests via this function:

    function send_request(data::Dict; endpoint::String = "solve")
    +end
    setup_server (generic function with 1 method)
    Warning

    HTTP.jl does not serve requests on a separate thread. Therefore, a long-running job will block the main thread, preventing concurrent users from submitting requests. To work-around this, read HTTP.jl issue 798 or watch Building Microservices and Applications in Julia from JuliaCon 2020.

    server = setup_server(HTTP.ip"127.0.0.1", 8080)
    Sockets.TCPServer(RawFD(36) active)

    The client side

    Now that we have a server, we can send it requests via this function:

    function send_request(data::Dict; endpoint::String = "solve")
         ret = HTTP.request(
             "POST",
             # This should match the URL and endpoint we defined for our server.
    @@ -88,4 +88,4 @@
       "status" => "failure"
       "reason" => "missing lower_bound param"

    If we don't send a lower_bound that is a number, we get:

    send_request(Dict("lower_bound" => "1.2"))
    Dict{String, Any} with 2 entries:
       "status" => "failure"
    -  "reason" => "lower_bound is not a number"

    Finally, we can shutdown our HTTP server:

    close(server)
    [ Info: Server on 127.0.0.1:8080 closing

    Next steps

    For more complicated examples relating to HTTP servers, consult the HTTP.jl documentation.

    To see how you can integrate this with a larger JuMP model, read Design patterns for larger models.

    + "reason" => "lower_bound is not a number"

    Finally, we can shutdown our HTTP server:

    close(server)
    [ Info: Server on 127.0.0.1:8080 closing

    Next steps

    For more complicated examples relating to HTTP servers, consult the HTTP.jl documentation.

    To see how you can integrate this with a larger JuMP model, read Design patterns for larger models.

    diff --git a/previews/PR3913/tutorials/conic/arbitrary_precision/index.html b/previews/PR3913/tutorials/conic/arbitrary_precision/index.html index 0b5da4ff0b9..a4af7e08e3c 100644 --- a/previews/PR3913/tutorials/conic/arbitrary_precision/index.html +++ b/previews/PR3913/tutorials/conic/arbitrary_precision/index.html @@ -37,7 +37,7 @@ Dual objective value : -6.42857e-01 * Work counters - Solve time (sec) : 4.45786e-01 + Solve time (sec) : 4.39864e-01 Barrier iterations : 5

    The value of each decision variable is a BigFloat:

    value.(x)
    2-element Vector{BigFloat}:
      0.4285714246558161076147072906813123533593766450416896337912086518811186790735189
    @@ -82,4 +82,4 @@
     * Work counters
     

    The optimal values are given in exact rational arithmetic:

    value.(x)
    2-element Vector{Rational{BigInt}}:
      1//6
    - 2//3
    objective_value(model)
    5//6
    value(c2)
    13//6
    + 2//3
    objective_value(model)
    5//6
    value(c2)
    13//6
    diff --git a/previews/PR3913/tutorials/conic/dualization/index.html b/previews/PR3913/tutorials/conic/dualization/index.html index 8dcfae95007..dceae7f0db3 100644 --- a/previews/PR3913/tutorials/conic/dualization/index.html +++ b/previews/PR3913/tutorials/conic/dualization/index.html @@ -53,12 +53,12 @@ ------------------------------------------------------------------ iter | pri res | dua res | gap | obj | scale | time (s) ------------------------------------------------------------------ - 0| 1.65e+01 1.60e-01 5.09e+01 -2.91e+01 1.00e-01 1.05e-04 - 50| 1.74e-08 2.70e-10 4.88e-08 -4.00e+00 1.00e-01 1.84e-04 + 0| 1.65e+01 1.60e-01 5.09e+01 -2.91e+01 1.00e-01 1.18e-03 + 50| 1.74e-08 2.70e-10 4.88e-08 -4.00e+00 1.00e-01 7.18e-03 ------------------------------------------------------------------ status: solved -timings: total: 1.85e-04s = setup: 4.12e-05s + solve: 1.44e-04s - lin-sys: 1.14e-05s, cones: 6.03e-05s, accel: 2.72e-06s +timings: total: 7.18e-03s = setup: 4.12e-05s + solve: 7.14e-03s + lin-sys: 1.13e-05s, cones: 6.94e-05s, accel: 2.76e-06s ------------------------------------------------------------------ objective = -4.000000 ------------------------------------------------------------------

    (There are five rows in the constraint matrix because SCS expects problems in geometric conic form, and so JuMP has reformulated the X, PSD variable constraint into the affine constraint X .+ 0 in PSDCone().)

    The solution we obtain is:

    value.(X)
    2×2 Matrix{Float64}:
    @@ -83,12 +83,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  9.85e-05
    -    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  1.81e-04
    +     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  1.02e-04
    +    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  1.82e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 1.82e-04s = setup: 4.56e-05s + solve: 1.36e-04s
    -	 lin-sys: 9.20e-06s, cones: 6.02e-05s, accel: 2.69e-06s
    +timings: total: 1.83e-04s = setup: 4.24e-05s + solve: 1.41e-04s
    +	 lin-sys: 9.27e-06s, cones: 5.83e-05s, accel: 2.69e-06s
     ------------------------------------------------------------------
     objective = 4.000000
     ------------------------------------------------------------------

    and the solution we obtain is:

    dual.(dual_c)
    2×2 Matrix{Float64}:
    @@ -113,12 +113,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  8.96e-05
    -    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  1.71e-04
    +     0| 1.23e+01  1.00e+00  2.73e+01 -9.03e+00  1.00e-01  8.94e-05
    +    50| 1.13e-07  1.05e-09  3.23e-07  4.00e+00  1.00e-01  1.69e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 1.72e-04s = setup: 3.97e-05s + solve: 1.33e-04s
    -	 lin-sys: 9.33e-06s, cones: 5.97e-05s, accel: 2.62e-06s
    +timings: total: 1.70e-04s = setup: 3.86e-05s + solve: 1.31e-04s
    +	 lin-sys: 9.42e-06s, cones: 5.90e-05s, accel: 2.74e-06s
     ------------------------------------------------------------------
     objective = 4.000000
     ------------------------------------------------------------------

    The performance is the same as if we solved model_dual, and the correct solution is returned to X:

    value.(X)
    2×2 Matrix{Float64}:
    @@ -144,12 +144,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.65e+01  1.60e-01  5.09e+01 -2.91e+01  1.00e-01  9.76e-05
    -    50| 1.74e-08  2.70e-10  4.88e-08 -4.00e+00  1.00e-01  1.75e-04
    +     0| 1.65e+01  1.60e-01  5.09e+01 -2.91e+01  1.00e-01  1.73e-03
    +    50| 1.74e-08  2.70e-10  4.88e-08 -4.00e+00  1.00e-01  1.81e-03
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 1.76e-04s = setup: 4.18e-05s + solve: 1.35e-04s
    -	 lin-sys: 1.10e-05s, cones: 5.96e-05s, accel: 2.65e-06s
    +timings: total: 1.81e-03s = setup: 4.28e-05s + solve: 1.76e-03s
    +	 lin-sys: 1.14e-05s, cones: 5.91e-05s, accel: 2.73e-06s
     ------------------------------------------------------------------
     objective = -4.000000
     ------------------------------------------------------------------
    dual.(dual_c)
    2×2 Matrix{Float64}:
    @@ -185,12 +185,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 4.73e+00  1.00e+00  2.92e+00  1.23e+00  1.00e-01  1.28e-04
    -   150| 1.01e-04  3.07e-05  6.08e-05  1.33e+00  1.00e-01  7.23e-04
    +     0| 4.73e+00  1.00e+00  2.92e+00  1.23e+00  1.00e-01  1.23e-04
    +   150| 1.01e-04  3.07e-05  6.08e-05  1.33e+00  1.00e-01  6.86e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 7.24e-04s = setup: 6.46e-05s + solve: 6.59e-04s
    -	 lin-sys: 1.03e-04s, cones: 4.09e-04s, accel: 3.66e-05s
    +timings: total: 6.87e-04s = setup: 6.19e-05s + solve: 6.25e-04s
    +	 lin-sys: 1.00e-04s, cones: 3.82e-04s, accel: 3.56e-05s
     ------------------------------------------------------------------
     objective = 1.333363
     ------------------------------------------------------------------
    set_optimizer(model, Dualization.dual_optimizer(SCS.Optimizer))
    @@ -212,12 +212,12 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 3.71e+01  1.48e+00  2.23e+02 -1.13e+02  1.00e-01  1.49e-04
    -   150| 1.57e-04  2.28e-05  2.08e-04 -1.33e+00  1.00e-01  7.49e-04
    +     0| 3.71e+01  1.48e+00  2.23e+02 -1.13e+02  1.00e-01  1.32e-04
    +   150| 1.57e-04  2.28e-05  2.08e-04 -1.33e+00  1.00e-01  7.20e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 7.51e-04s = setup: 7.30e-05s + solve: 6.78e-04s
    -	 lin-sys: 1.10e-04s, cones: 4.14e-04s, accel: 2.70e-05s
    +timings: total: 7.21e-04s = setup: 6.96e-05s + solve: 6.52e-04s
    +	 lin-sys: 1.09e-04s, cones: 4.05e-04s, accel: 2.69e-05s
     ------------------------------------------------------------------
     objective = -1.333460
    -------------------------------------------------------------------

    For this problem, SCS reports that the primal has variables n: 11, constraints m: 24 and that the dual has variables n: 14, constraints m: 24. Therefore, we should probably use the primal formulation because it has fewer variables and the same number of constraints.

    When to use dual_optimizer

    Because it can make the problem larger or smaller, depending on the problem and the choice of solver, there is no definitive rule on when you should use dual_optimizer. However, you should try dual_optimizer if your conic optimization problem takes a long time to solve, or if you need to repeatedly solve similarly structured problems with different data. In some cases solving the dual instead of the primal can make a large difference.

    +------------------------------------------------------------------

    For this problem, SCS reports that the primal has variables n: 11, constraints m: 24 and that the dual has variables n: 14, constraints m: 24. Therefore, we should probably use the primal formulation because it has fewer variables and the same number of constraints.

    When to use dual_optimizer

    Because it can make the problem larger or smaller, depending on the problem and the choice of solver, there is no definitive rule on when you should use dual_optimizer. However, you should try dual_optimizer if your conic optimization problem takes a long time to solve, or if you need to repeatedly solve similarly structured problems with different data. In some cases solving the dual instead of the primal can make a large difference.

    diff --git a/previews/PR3913/tutorials/conic/ellipse_approx/66a5da6e.svg b/previews/PR3913/tutorials/conic/ellipse_approx/819d86ac.svg similarity index 57% rename from previews/PR3913/tutorials/conic/ellipse_approx/66a5da6e.svg rename to previews/PR3913/tutorials/conic/ellipse_approx/819d86ac.svg index ea860b9f4f7..cae21e25409 100644 --- a/previews/PR3913/tutorials/conic/ellipse_approx/66a5da6e.svg +++ b/previews/PR3913/tutorials/conic/ellipse_approx/819d86ac.svg @@ -1,2443 +1,2443 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/ellipse_approx/d9cb1324.svg b/previews/PR3913/tutorials/conic/ellipse_approx/b016d902.svg similarity index 57% rename from previews/PR3913/tutorials/conic/ellipse_approx/d9cb1324.svg rename to previews/PR3913/tutorials/conic/ellipse_approx/b016d902.svg index 51af62c6533..218bb462039 100644 --- a/previews/PR3913/tutorials/conic/ellipse_approx/d9cb1324.svg +++ b/previews/PR3913/tutorials/conic/ellipse_approx/b016d902.svg @@ -1,2442 +1,2442 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/ellipse_approx/index.html b/previews/PR3913/tutorials/conic/ellipse_approx/index.html index 79037dc9861..af1eb928fad 100644 --- a/previews/PR3913/tutorials/conic/ellipse_approx/index.html +++ b/previews/PR3913/tutorials/conic/ellipse_approx/index.html @@ -36,7 +36,7 @@ c = :green, shape = :x, size = (600, 600), -)Example block output

    JuMP formulation

    Now let's build and the JuMP model. We'll compute $D$ and $c$ after the solve.

    model = Model(SCS.Optimizer)
    +)
    Example block output

    JuMP formulation

    Now let's build and the JuMP model. We'll compute $D$ and $c$ after the solve.

    model = Model(SCS.Optimizer)
     # We need to use a tighter tolerance for this example, otherwise the bounding
     # ellipse won't actually be bounding...
     set_attribute(model, "eps_rel", 1e-7)
    @@ -71,7 +71,7 @@
       Dual objective value : 5.08382e-03
     
     * Work counters
    -  Solve time (sec)   : 2.98768e-01
    +  Solve time (sec)   : 2.98484e-01
     

    Results

    After solving the model to optimality we can recover the solution in terms of $D$ and $c$:

    D = value.(Z)
    2×2 Matrix{Float64}:
       0.00755264  -0.0114233
      -0.0114233    0.0206963
    c = D \ value.(z)
    2-element Vector{Float64}:
    @@ -79,7 +79,7 @@
      -2.255547187078282

    We can check that each point lies inside the ellipsoid, by checking if the largest normalized radius is less than 1:

    largest_radius = maximum(map(x -> (x - c)' * D * (x - c), eachrow(S)))
    0.999891803944291

    Finally, overlaying the solution in the plot we see the minimal volume approximating ellipsoid:

    P = sqrt(D)
     q = -P * c
     data = [tuple(P \ [cos(θ) - q[1], sin(θ) - q[2]]...) for θ in 0:0.05:(2pi+0.05)]
    -Plots.plot!(plot, data; c = :crimson, label = nothing)
    Example block output

    Alternative formulations

    The formulation of model uses MOI.RootDetConeSquare. However, because SCS does not natively support this cone, JuMP automatically reformulates the problem into an equivalent problem that SCS does support. You can see the reformulation that JuMP chose using print_active_bridges:

    print_active_bridges(model)
     * Unsupported objective: MOI.VariableIndex
    +Plots.plot!(plot, data; c = :crimson, label = nothing)
    Example block output

    Alternative formulations

    The formulation of model uses MOI.RootDetConeSquare. However, because SCS does not natively support this cone, JuMP automatically reformulates the problem into an equivalent problem that SCS does support. You can see the reformulation that JuMP chose using print_active_bridges:

    print_active_bridges(model)
     * Unsupported objective: MOI.VariableIndex
      |  bridged by:
      |   MOIB.Objective.FunctionConversionBridge{Float64, MOI.ScalarAffineFunction{Float64}, MOI.VariableIndex}
      |  may introduce:
    @@ -259,7 +259,7 @@
     @objective(model, Max, 1 * t + 0)
     optimize!(model)
     Test.@test is_solved_and_feasible(model)
    -solve_time_1 = solve_time(model)
    0.294549389

    This formulation gives the much smaller graph:

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
    +solve_time_1 = solve_time(model)
    0.297803416

    This formulation gives the much smaller graph:

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
      * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      * Unsupported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.PositiveSemidefiniteConeTriangle
      |  bridged by:
    @@ -298,7 +298,7 @@
      |   |   |   |   * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      |   * Supported variable: MOI.Reals

    The last bullet shows how JuMP reformulated the MOI.RootDetConeTriangle constraint by adding a mix of MOI.PositiveSemidefiniteConeTriangle and MOI.GeometricMeanCone constraints.

    Because SCS doesn't natively support the MOI.GeometricMeanCone, these constraints were further bridged using a MOI.Bridges.Constraint.GeoMeanToPowerBridge to a series of MOI.PowerCone constraints.

    However, there are many other ways that a MOI.GeometricMeanCone can be reformulated into something that SCS supports. Let's see what happens if we use remove_bridge to remove the MOI.Bridges.Constraint.GeoMeanToPowerBridge:

    remove_bridge(model, MOI.Bridges.Constraint.GeoMeanToPowerBridge)
     optimize!(model)
    -Test.@test is_solved_and_feasible(model)
    Test Passed

    This time, the solve took:

    solve_time_2 = solve_time(model)
    0.289482742

    where previously it took

    solve_time_1
    0.294549389

    Why was the solve time different?

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
    +Test.@test is_solved_and_feasible(model)
    Test Passed

    This time, the solve took:

    solve_time_2 = solve_time(model)
    0.350935436

    where previously it took

    solve_time_1
    0.297803416

    Why was the solve time different?

    print_active_bridges(model)
     * Supported objective: MOI.ScalarAffineFunction{Float64}
      * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      * Unsupported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.PositiveSemidefiniteConeTriangle
      |  bridged by:
    @@ -342,4 +342,4 @@
      |   |   |   * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.SecondOrderCone
      |   |   * Supported constraint: MOI.VectorAffineFunction{Float64}-in-MOI.Nonnegatives
      |   |   * Supported variable: MOI.Reals
    - |   * Supported variable: MOI.Reals

    This time, JuMP used a MOI.Bridges.Constraint.GeoMeanBridge to reformulate the constraint into a set of MOI.RotatedSecondOrderCone constraints, which were further reformulated into a set of supported MOI.SecondOrderCone constraints.

    Since the two models are equivalent, we can conclude that for this particular model, the MOI.SecondOrderCone formulation is more efficient.

    In general though, the performance of a particular reformulation is problem- and solver-specific. Therefore, JuMP chooses to minimize the number of bridges in the default reformulation, leaving you to explore alternative formulations using the tools and techniques shown in this tutorial.

    + | * Supported variable: MOI.Reals

    This time, JuMP used a MOI.Bridges.Constraint.GeoMeanBridge to reformulate the constraint into a set of MOI.RotatedSecondOrderCone constraints, which were further reformulated into a set of supported MOI.SecondOrderCone constraints.

    Since the two models are equivalent, we can conclude that for this particular model, the MOI.SecondOrderCone formulation is more efficient.

    In general though, the performance of a particular reformulation is problem- and solver-specific. Therefore, JuMP chooses to minimize the number of bridges in the default reformulation, leaving you to explore alternative formulations using the tools and techniques shown in this tutorial.

    diff --git a/previews/PR3913/tutorials/conic/ellipse_fitting/3ff39ff8.svg b/previews/PR3913/tutorials/conic/ellipse_fitting/2a7deebf.svg similarity index 80% rename from previews/PR3913/tutorials/conic/ellipse_fitting/3ff39ff8.svg rename to previews/PR3913/tutorials/conic/ellipse_fitting/2a7deebf.svg index f86dbb43f68..cab365097b7 100644 --- a/previews/PR3913/tutorials/conic/ellipse_fitting/3ff39ff8.svg +++ b/previews/PR3913/tutorials/conic/ellipse_fitting/2a7deebf.svg @@ -1,35 +1,35 @@ - + - + - + - + - + - - - - - - - - - - - - - + + + + + + + + + + + + + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/ellipse_fitting/053e2c86.svg b/previews/PR3913/tutorials/conic/ellipse_fitting/437667c7.svg similarity index 98% rename from previews/PR3913/tutorials/conic/ellipse_fitting/053e2c86.svg rename to previews/PR3913/tutorials/conic/ellipse_fitting/437667c7.svg index e335c3305b6..aa6de3c1f90 100644 --- a/previews/PR3913/tutorials/conic/ellipse_fitting/053e2c86.svg +++ b/previews/PR3913/tutorials/conic/ellipse_fitting/437667c7.svg @@ -1,49 +1,49 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - + - + - + - + - + - - - - - - - - - - - - - + + + + + + + + + + + + + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/ellipse_fitting/b171446c.svg b/previews/PR3913/tutorials/conic/ellipse_fitting/a5a41812.svg similarity index 80% rename from previews/PR3913/tutorials/conic/ellipse_fitting/b171446c.svg rename to previews/PR3913/tutorials/conic/ellipse_fitting/a5a41812.svg index ca546a81072..6da4876583f 100644 --- a/previews/PR3913/tutorials/conic/ellipse_fitting/b171446c.svg +++ b/previews/PR3913/tutorials/conic/ellipse_fitting/a5a41812.svg @@ -1,35 +1,35 @@ - + - + - + - + - + - - - - - - - - - - - - - + + + + + + + + + + + + + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/ellipse_fitting/index.html b/previews/PR3913/tutorials/conic/ellipse_fitting/index.html index 80b3c1672d2..37a33f97866 100644 --- a/previews/PR3913/tutorials/conic/ellipse_fitting/index.html +++ b/previews/PR3913/tutorials/conic/ellipse_fitting/index.html @@ -74,7 +74,7 @@ Images.mosaicview(x, Images.Gray.(x_final); nrow = 1)Example block output

    We then use a binarization algorithm to map each grayscale pixel $(x_i, y_i)$ to a binary value so $x_i, y_i \to \{0, 1\}$.

    x_bin = Images.binarize(x_final, Images.Otsu(); nbins = 128)
     x_bin = convert(Array{Bool}, x_bin)
     plt = plot_dwt(img_roi)
    -Plots.heatmap!(x_bin; color = :grays, alpha = 0.45)
    Example block output

    Edge detection and clustering

    Now that we have our binary image, we can use edge detection to find the edges of the galaxies. We will use the Sobel operator for this task.

    function edge_detector(
    +Plots.heatmap!(x_bin; color = :grays, alpha = 0.45)
    Example block output

    Edge detection and clustering

    Now that we have our binary image, we can use edge detection to find the edges of the galaxies. We will use the Sobel operator for this task.

    function edge_detector(
         f_smooth::Matrix{Float64},
         d1::Float64 = 0.1,
         d2::Float64 = 0.1,
    @@ -144,7 +144,7 @@
         legend = :topleft,
         legendcolumns = 1,
         legendfontsize = 12,
    -)
    Example block output

    Fitting ellipses

    Now that we have all the ingredients we can finally start fitting ellipses. We will use a conic optimization approach to do so since it is a very natural way to represent ellipses.

    First, we define the residual distance definition (6) of a point to an ellipse in JuMP:

    function create_ellipse_model(Ξ::Array{Tuple{Int,Int},1}, ϵ = 1e-5)
    +)
    Example block output

    Fitting ellipses

    Now that we have all the ingredients we can finally start fitting ellipses. We will use a conic optimization approach to do so since it is a very natural way to represent ellipses.

    First, we define the residual distance definition (6) of a point to an ellipse in JuMP:

    function create_ellipse_model(Ξ::Array{Tuple{Int,Int},1}, ϵ = 1e-5)
         N = length(Ξ)
         model = Model(Clarabel.Optimizer)
         set_silent(model)
    @@ -204,7 +204,7 @@
             cbar = false,
         )
     end
    -plt
    Example block output

    Objective 2: Minimize the maximum residual distance

    For our second objective we will minimize the maximum residual distance of all points to the ellipse:

    \[\min_{Q, d, e} \max_{\xi_i \in \mathcal{F}} d_\text{res}(\xi_i, \mathcal{E}) = +pltExample block output

    Objective 2: Minimize the maximum residual distance

    For our second objective we will minimize the maximum residual distance of all points to the ellipse:

    \[\min_{Q, d, e} \max_{\xi_i \in \mathcal{F}} d_\text{res}(\xi_i, \mathcal{E}) = \min_{Q, d, e} ||d_\text{res}||_\infty\]

    This objective can be implemented in JuMP using MOI.NormInfinityCone as follows:

    ellipses_C2 = Dict{Symbol,Any}[]
     for (i, cluster) in enumerate(clusters)
         p_cluster = points[:, cluster.core_indices]
    @@ -237,4 +237,4 @@
         )
     end
     Plots.scatter!([0], [0]; color = :red, label = "Squared (Obj. 1)")
    -Plots.scatter!([0], [0]; color = :green, label = "Min-Max (Obj. 2)")
    Example block output +Plots.scatter!([0], [0]; color = :green, label = "Min-Max (Obj. 2)")Example block output diff --git a/previews/PR3913/tutorials/conic/experiment_design/index.html b/previews/PR3913/tutorials/conic/experiment_design/index.html index dad337d8b70..f8cbd1c051e 100644 --- a/previews/PR3913/tutorials/conic/experiment_design/index.html +++ b/previews/PR3913/tutorials/conic/experiment_design/index.html @@ -99,4 +99,4 @@ 2.9157806299837166 2.67337566459234 2.735395012219622 - 0.3378388086258122 + 0.3378388086258122 diff --git a/previews/PR3913/tutorials/conic/introduction/index.html b/previews/PR3913/tutorials/conic/introduction/index.html index 885ce6371d8..ec919cc507d 100644 --- a/previews/PR3913/tutorials/conic/introduction/index.html +++ b/previews/PR3913/tutorials/conic/introduction/index.html @@ -6,4 +6,4 @@

    Introduction

    Conic programs are a class of convex nonlinear optimization problems which use cones to represent the nonlinearities. They have the form:

    \[\begin{align} & \min_{x \in \mathbb{R}^n} & f_0(x) \\ & \;\;\text{s.t.} & f_j(x) \in \mathcal{S}_j & \;\; j = 1 \ldots m -\end{align}\]

    Mixed-integer conic programs (MICPs) are extensions of conic programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of conic solvers, although support differs on what types of cones each solver supports. In the list of Supported solvers, "SOCP" denotes solvers supporting second-order cones and "SDP" denotes solvers supporting semidefinite cones. In addition, solvers such as SCS and Mosek have support for the exponential cone. Moreover, due to the bridging system in MathOptInterface, many of these solvers support a much wider range of exotic cones than they natively support. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    Tip

    Duality plays a large role in solving conic optimization models. Depending on the solver, it can be more efficient to solve the dual instead of the primal. If performance is an issue, see the Dualization tutorial for more details.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Modeling with cones tutorial contains a number of helpful reformulations and tricks you can use when modeling conic programs. Look here if you are stuck trying to formulate a problem as a conic program.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    +\end{align}\]

    Mixed-integer conic programs (MICPs) are extensions of conic programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of conic solvers, although support differs on what types of cones each solver supports. In the list of Supported solvers, "SOCP" denotes solvers supporting second-order cones and "SDP" denotes solvers supporting semidefinite cones. In addition, solvers such as SCS and Mosek have support for the exponential cone. Moreover, due to the bridging system in MathOptInterface, many of these solvers support a much wider range of exotic cones than they natively support. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    Tip

    Duality plays a large role in solving conic optimization models. Depending on the solver, it can be more efficient to solve the dual instead of the primal. If performance is an issue, see the Dualization tutorial for more details.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Modeling with cones tutorial contains a number of helpful reformulations and tricks you can use when modeling conic programs. Look here if you are stuck trying to formulate a problem as a conic program.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    diff --git a/previews/PR3913/tutorials/conic/logistic_regression/index.html b/previews/PR3913/tutorials/conic/logistic_regression/index.html index dd621edebc7..b71ec7b20d1 100644 --- a/previews/PR3913/tutorials/conic/logistic_regression/index.html +++ b/previews/PR3913/tutorials/conic/logistic_regression/index.html @@ -109,4 +109,4 @@ )
    Number of non-zero components: 8 (out of 10 features)

    Extensions

    A direct extension would be to consider the sparse logistic regression with hard thresholding, which, on contrary to the soft version using a $\ell_1$ regularization, adds an explicit cardinality constraint in its formulation:

    \[\begin{aligned} \min_{\theta} & \; \sum_{i=1}^n \log(1 + \exp(-y_i \theta^\top x_i)) + \lambda \| \theta \|_2^2 \\ \text{subject to } & \quad \| \theta \|_0 <= k -\end{aligned}\]

    where $k$ is the maximum number of non-zero components in the vector $\theta$, and $\|.\|_0$ is the $\ell_0$ pseudo-norm:

    \[\| x\|_0 = \#\{i : \; x_i \neq 0\}\]

    The cardinality constraint $\|\theta\|_0 \leq k$ could be reformulated with binary variables. Thus the hard sparse regression problem could be solved by any solver supporting mixed integer conic problems.

    +\end{aligned}\]

    where $k$ is the maximum number of non-zero components in the vector $\theta$, and $\|.\|_0$ is the $\ell_0$ pseudo-norm:

    \[\| x\|_0 = \#\{i : \; x_i \neq 0\}\]

    The cardinality constraint $\|\theta\|_0 \leq k$ could be reformulated with binary variables. Thus the hard sparse regression problem could be solved by any solver supporting mixed integer conic problems.

    diff --git a/previews/PR3913/tutorials/conic/min_ellipse/eb7e74c3.svg b/previews/PR3913/tutorials/conic/min_ellipse/06656430.svg similarity index 88% rename from previews/PR3913/tutorials/conic/min_ellipse/eb7e74c3.svg rename to previews/PR3913/tutorials/conic/min_ellipse/06656430.svg index 3373393d7f4..6e523065395 100644 --- a/previews/PR3913/tutorials/conic/min_ellipse/eb7e74c3.svg +++ b/previews/PR3913/tutorials/conic/min_ellipse/06656430.svg @@ -1,50 +1,50 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/min_ellipse/574a59c0.svg b/previews/PR3913/tutorials/conic/min_ellipse/586c4693.svg similarity index 88% rename from previews/PR3913/tutorials/conic/min_ellipse/574a59c0.svg rename to previews/PR3913/tutorials/conic/min_ellipse/586c4693.svg index 8d517686cea..402f833a029 100644 --- a/previews/PR3913/tutorials/conic/min_ellipse/574a59c0.svg +++ b/previews/PR3913/tutorials/conic/min_ellipse/586c4693.svg @@ -1,53 +1,53 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/min_ellipse/index.html b/previews/PR3913/tutorials/conic/min_ellipse/index.html index 85add2d894e..ec238963e44 100644 --- a/previews/PR3913/tutorials/conic/min_ellipse/index.html +++ b/previews/PR3913/tutorials/conic/min_ellipse/index.html @@ -46,7 +46,7 @@ for ellipse in ellipses plot_ellipse(plot, ellipse) end -plotExample block output

    Build the model

    Now let's build the model, using the change-of-variables = $P^2$ and P_q = $P q$. We'll recover the true value of P and q after the solve.

    model = Model(SCS.Optimizer)
    +plot
    Example block output

    Build the model

    Now let's build the model, using the change-of-variables = $P^2$ and P_q = $P q$. We'll recover the true value of P and q after the solve.

    model = Model(SCS.Optimizer)
     # We need to use a tighter tolerance for this example, otherwise the bounding
     # ellipse won't actually be bounding...
     set_attribute(model, "eps_rel", 1e-6)
    @@ -85,7 +85,7 @@
       Dual objective value : -4.04364e+00
     
     * Work counters
    -  Solve time (sec)   : 2.22113e-01
    +  Solve time (sec)   : 2.17053e-01
     

    Results

    After solving the model to optimality we can recover the solution in terms of $P$ and $q$:

    P = sqrt(value.(P²))
     q = P \ value.(P_q)
    2-element Vector{Float64}:
      -0.3964217693227084
    @@ -94,4 +94,4 @@
         [tuple(P \ [cos(θ) - q[1], sin(θ) - q[2]]...) for θ in 0:0.05:(2pi+0.05)];
         c = :crimson,
         label = nothing,
    -)
    Example block output +)Example block output diff --git a/previews/PR3913/tutorials/conic/quantum_discrimination/index.html b/previews/PR3913/tutorials/conic/quantum_discrimination/index.html index 7a0c4b5b475..c3d36c69b15 100644 --- a/previews/PR3913/tutorials/conic/quantum_discrimination/index.html +++ b/previews/PR3913/tutorials/conic/quantum_discrimination/index.html @@ -44,7 +44,7 @@ Dual objective value : 8.64062e-01 * Work counters - Solve time (sec) : 4.40547e-04 + Solve time (sec) : 4.21569e-04

    The probability of guessing correctly is:

    objective_value(model)
    0.8640614507314219

    When N = 2, there is a known analytical solution of:

    0.5 + 0.25 * sum(LinearAlgebra.svdvals(ρ[1] - ρ[2]))
    0.8640627582954737

    proving that we found the optimal solution.

    Finally, the optimal POVM is:

    solution = [value.(e) for e in E]
    2-element Vector{Matrix{ComplexF64}}:
      [0.9495721399750024 + 0.0im 0.03442451603977098 + 0.21609731371190505im; 0.03442451603977098 - 0.21609731371190505im 0.05042785512985496 + 0.0im]
      [0.05042785517602001 + 0.0im -0.03442451605312517 - 0.21609731370614843im; -0.03442451605312517 + 0.21609731370614843im 0.9495721400119357 + 0.0im]
    Tip

    Duality plays a large role in solving conic optimization models. Depending on the solver, it can be more efficient to solve the dual of this problem instead of the primal. If performance is an issue, see the Dualization tutorial for more details.

    Alternative formulation

    The formulation above includes N Hermitian matrices and a set of linear equality constraints. We can simplify the problem by replacing $E_N$ with $E_N = I - \sum\limits_{i=1}^{N-1} E_i$. This results in:

    model = Model(SCS.Optimizer)
    @@ -71,5 +71,5 @@
       Dual objective value : 8.64062e-01
     
     * Work counters
    -  Solve time (sec)   : 4.05180e-04
    -
    objective_value(model)
    0.8640596603179975
    + Solve time (sec) : 4.08485e-04 +
    objective_value(model)
    0.8640596603179975
    diff --git a/previews/PR3913/tutorials/conic/simple_examples/d6d86983.svg b/previews/PR3913/tutorials/conic/simple_examples/c7c00151.svg similarity index 79% rename from previews/PR3913/tutorials/conic/simple_examples/d6d86983.svg rename to previews/PR3913/tutorials/conic/simple_examples/c7c00151.svg index 5658ba5afa7..7725bc09609 100644 --- a/previews/PR3913/tutorials/conic/simple_examples/d6d86983.svg +++ b/previews/PR3913/tutorials/conic/simple_examples/c7c00151.svg @@ -1,49 +1,49 @@ - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/conic/simple_examples/index.html b/previews/PR3913/tutorials/conic/simple_examples/index.html index b9764f65ac1..32a3def118f 100644 --- a/previews/PR3913/tutorials/conic/simple_examples/index.html +++ b/previews/PR3913/tutorials/conic/simple_examples/index.html @@ -196,7 +196,7 @@ ) end -example_minimum_distortion()Example block output

    Lovász numbers

    The Lovász number of a graph, also known as Lovász's theta-function, is a number that lies between two important and related numbers that are computationally hard to determine, namely the chromatic and clique numbers of the graph. It is possible however to efficient compute the Lovász number as the optimal value of a semidefinite program.

    Consider the pentagon graph:

         [5]
    +example_minimum_distortion()
    Example block output

    Lovász numbers

    The Lovász number of a graph, also known as Lovász's theta-function, is a number that lies between two important and related numbers that are computationally hard to determine, namely the chromatic and clique numbers of the graph. It is possible however to efficient compute the Lovász number as the optimal value of a semidefinite program.

    Consider the pentagon graph:

         [5]
         /   \
        /     \
      [1]     [4]
    @@ -259,4 +259,4 @@
         return
     end
     
    -example_robust_uncertainty_sets()
    +example_robust_uncertainty_sets() diff --git a/previews/PR3913/tutorials/conic/start_values/index.html b/previews/PR3913/tutorials/conic/start_values/index.html index 00b3ce977ba..9af04abd407 100644 --- a/previews/PR3913/tutorials/conic/start_values/index.html +++ b/previews/PR3913/tutorials/conic/start_values/index.html @@ -52,12 +52,12 @@ ------------------------------------------------------------------ iter | pri res | dua res | gap | obj | scale | time (s) ------------------------------------------------------------------ - 0| 4.42e+01 1.00e+00 1.28e+02 -6.64e+01 1.00e-01 8.01e-05 - 75| 5.30e-07 2.63e-06 3.15e-07 -3.00e+00 1.00e-01 1.28e-04 + 0| 4.42e+01 1.00e+00 1.28e+02 -6.64e+01 1.00e-01 1.01e-04 + 75| 5.30e-07 2.63e-06 3.15e-07 -3.00e+00 1.00e-01 1.48e-04 ------------------------------------------------------------------ status: solved -timings: total: 1.29e-04s = setup: 3.87e-05s + solve: 8.99e-05s - lin-sys: 1.40e-05s, cones: 6.73e-06s, accel: 3.62e-06s +timings: total: 1.49e-04s = setup: 3.63e-05s + solve: 1.13e-04s + lin-sys: 1.39e-05s, cones: 6.37e-06s, accel: 3.70e-06s ------------------------------------------------------------------ objective = -2.999998 ------------------------------------------------------------------

    By looking at the log, we can see that SCS took 75 iterations to find the optimal solution. Now we set the optimal solution as our starting point:

    set_optimal_start_values(model)

    and we re-optimize:

    optimize!(model)
    ------------------------------------------------------------------
    @@ -76,11 +76,11 @@
     ------------------------------------------------------------------
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
    -     0| 1.90e-05  1.56e-06  9.14e-05 -3.00e+00  1.00e-01  7.97e-05
    +     0| 1.90e-05  1.56e-06  9.14e-05 -3.00e+00  1.00e-01  1.24e-04
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 8.06e-05s = setup: 3.70e-05s + solve: 4.37e-05s
    -	 lin-sys: 7.71e-07s, cones: 1.25e-06s, accel: 3.00e-08s
    +timings: total: 1.25e-04s = setup: 3.57e-05s + solve: 8.96e-05s
    +	 lin-sys: 8.22e-07s, cones: 1.21e-06s, accel: 3.00e-08s
     ------------------------------------------------------------------
     objective = -3.000044
    -------------------------------------------------------------------

    Now the optimization terminates after 0 iterations because our starting point is already optimal.

    Caveats

    Some solvers do not support setting some parts of the starting solution, for example, they may support only set_start_value for variables.

    If you encounter an UnsupportedSupported attribute error for MOI.VariablePrimalStart, MOI.ConstraintPrimalStart, or MOI.ConstraintDualStart, comment out the corresponding part of the set_optimal_start_values function.

    +------------------------------------------------------------------

    Now the optimization terminates after 0 iterations because our starting point is already optimal.

    Caveats

    Some solvers do not support setting some parts of the starting solution, for example, they may support only set_start_value for variables.

    If you encounter an UnsupportedSupported attribute error for MOI.VariablePrimalStart, MOI.ConstraintPrimalStart, or MOI.ConstraintDualStart, comment out the corresponding part of the set_optimal_start_values function.

    diff --git a/previews/PR3913/tutorials/conic/tips_and_tricks/index.html b/previews/PR3913/tutorials/conic/tips_and_tricks/index.html index a15b0128355..973d8276e86 100644 --- a/previews/PR3913/tutorials/conic/tips_and_tricks/index.html +++ b/previews/PR3913/tutorials/conic/tips_and_tricks/index.html @@ -190,4 +190,4 @@ @constraint(model, X .== [1 2 3; 4 5 6]) optimize!(model) @assert is_solved_and_feasible(model) -value(t), maximum(LinearAlgebra.svdvals(value.(X)))
    (9.506936927003698, 9.508031076396836)

    Other Cones and Functions

    For other cones supported by JuMP, check out the MathOptInterface Manual.

    +value(t), maximum(LinearAlgebra.svdvals(value.(X)))
    (9.506936927003698, 9.508031076396836)

    Other Cones and Functions

    For other cones supported by JuMP, check out the MathOptInterface Manual.

    diff --git a/previews/PR3913/tutorials/getting_started/debugging/index.html b/previews/PR3913/tutorials/getting_started/debugging/index.html index 516b7c8b31e..6bc98776b21 100644 --- a/previews/PR3913/tutorials/getting_started/debugging/index.html +++ b/previews/PR3913/tutorials/getting_started/debugging/index.html @@ -24,4 +24,4 @@ julia> @profview foo(); # run once to trigger compilation. Ignore the output. -julia> @profview foo()

    This will open a flamegraph. The x-axis of the graph is time, so that wider bars take more time. The bars are stacked so that the foo() call is on the bottom, and subsequent calls within foo are stacked on top.

    Reading a flamegraph can take some experience, but if you click on a bar it will print the line number to the REPL. Hunt around until you find the widest bar that points to a line of code that you have written, then ask yourself if it makes sense for this line to be the bottleneck.

    If a wide bar points to code inside JuMP or a related Julia package, please open an issue on GitHub or post on the community forum.

    If @time foo() takes longer than a few minutes to run, then either make the problem smaller by using a smaller dataset, or do the following.

    1. Comment out everything in the function, then, line by line (or block by block):
    2. Un-comment some code and re-run @time foo()
    3. If the time increases by a lot (from seconds or minutes to hours), look for $O(N^2)$ or worse scaling behavior. Is there a better way to write the code that you are trying to execute?
    4. If the time increases by more than expected, but it still takes seconds or minutes to execute, use ProfileView to look for obvious bottlenecks.
    +julia> @profview foo()

    This will open a flamegraph. The x-axis of the graph is time, so that wider bars take more time. The bars are stacked so that the foo() call is on the bottom, and subsequent calls within foo are stacked on top.

    Reading a flamegraph can take some experience, but if you click on a bar it will print the line number to the REPL. Hunt around until you find the widest bar that points to a line of code that you have written, then ask yourself if it makes sense for this line to be the bottleneck.

    If a wide bar points to code inside JuMP or a related Julia package, please open an issue on GitHub or post on the community forum.

    If @time foo() takes longer than a few minutes to run, then either make the problem smaller by using a smaller dataset, or do the following.

    1. Comment out everything in the function, then, line by line (or block by block):
    2. Un-comment some code and re-run @time foo()
    3. If the time increases by a lot (from seconds or minutes to hours), look for $O(N^2)$ or worse scaling behavior. Is there a better way to write the code that you are trying to execute?
    4. If the time increases by more than expected, but it still takes seconds or minutes to execute, use ProfileView to look for obvious bottlenecks.
    diff --git a/previews/PR3913/tutorials/getting_started/design_patterns_for_larger_models/index.html b/previews/PR3913/tutorials/getting_started/design_patterns_for_larger_models/index.html index 13feb08a3bc..c9411fcad78 100644 --- a/previews/PR3913/tutorials/getting_started/design_patterns_for_larger_models/index.html +++ b/previews/PR3913/tutorials/getting_started/design_patterns_for_larger_models/index.html @@ -520,4 +520,4 @@ ) @test x === nothing end -end
    Test.DefaultTestSet("KnapsackModel", Any[Test.DefaultTestSet("feasible_binary_knapsack", Any[], 5, false, false, true, 1.736972097019207e9, 1.736972097021123e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("feasible_integer_knapsack", Any[], 5, false, false, true, 1.736972097021157e9, 1.736972097143477e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("infeasible_binary_knapsack", Any[], 1, false, false, true, 1.736972097143518e9, 1.736972097145097e9, false, "design_patterns_for_larger_models.md")], 0, false, false, true, 1.736972097019173e9, 1.736972097145104e9, false, "design_patterns_for_larger_models.md")
    Tip

    Place these tests in a separate file test_knapsack_model.jl so that you can run the tests by adding include("test_knapsack_model.jl") to any file where needed.

    Next steps

    We've only briefly scratched the surface of ways to create and structure large JuMP models, so consider this tutorial a starting point, rather than a comprehensive list of all the possible ways to structure JuMP models. If you are embarking on a large project that uses JuMP, a good next step is to look at ways people have written large JuMP projects "in the wild."

    Here are some good examples (all co-incidentally related to energy):

    +end
    Test.DefaultTestSet("KnapsackModel", Any[Test.DefaultTestSet("feasible_binary_knapsack", Any[], 5, false, false, true, 1.736976783122211e9, 1.736976783124072e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("feasible_integer_knapsack", Any[], 5, false, false, true, 1.736976783124098e9, 1.736976783243166e9, false, "design_patterns_for_larger_models.md"), Test.DefaultTestSet("infeasible_binary_knapsack", Any[], 1, false, false, true, 1.736976783243207e9, 1.736976783244595e9, false, "design_patterns_for_larger_models.md")], 0, false, false, true, 1.736976783122177e9, 1.736976783244603e9, false, "design_patterns_for_larger_models.md")
    Tip

    Place these tests in a separate file test_knapsack_model.jl so that you can run the tests by adding include("test_knapsack_model.jl") to any file where needed.

    Next steps

    We've only briefly scratched the surface of ways to create and structure large JuMP models, so consider this tutorial a starting point, rather than a comprehensive list of all the possible ways to structure JuMP models. If you are embarking on a large project that uses JuMP, a good next step is to look at ways people have written large JuMP projects "in the wild."

    Here are some good examples (all co-incidentally related to energy):

    diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_JuMP/index.html b/previews/PR3913/tutorials/getting_started/getting_started_with_JuMP/index.html index 9cd4b05a832..f52e2fd73e9 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_JuMP/index.html +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_JuMP/index.html @@ -242,4 +242,4 @@ Model status : Optimal Simplex iterations: 4 Objective value : 4.9230769231e+00 -HiGHS run time : 0.00
    julia> @assert is_solved_and_feasible(vector_model)
    julia> objective_value(vector_model)4.923076923076922 +HiGHS run time : 0.00
    julia> @assert is_solved_and_feasible(vector_model)
    julia> objective_value(vector_model)4.923076923076922 diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/15d638fa.svg b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/25f00548.svg similarity index 82% rename from previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/15d638fa.svg rename to previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/25f00548.svg index 68af68a1d6d..6fb6819159d 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/15d638fa.svg +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/25f00548.svg @@ -1,73 +1,73 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/981f72b9.svg b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/27fdea48.svg similarity index 85% rename from previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/981f72b9.svg rename to previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/27fdea48.svg index c974f75062c..47cdf8e56d1 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/981f72b9.svg +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/27fdea48.svg @@ -1,59 +1,59 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/8301dab4.svg b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/6111ee70.svg similarity index 84% rename from previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/8301dab4.svg rename to previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/6111ee70.svg index c82056eb93c..267054db733 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/8301dab4.svg +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/6111ee70.svg @@ -1,62 +1,62 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/index.html b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/index.html index 190892ae2d3..c84a2263210 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/index.html +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_data_and_plotting/index.html @@ -14,7 +14,7 @@ csv_df.Height; xlabel = "Weight", ylabel = "Height", -)Example block output

    That doesn't look right. What happened? If you look at the dataframe above, it read Weight in as a String column because there are "NA" fields. Let's correct that, by telling CSV to consider "NA" as missing.

    csv_df = CSV.read(
    +)
    Example block output

    That doesn't look right. What happened? If you look at the dataframe above, it read Weight in as a String column because there are "NA" fields. Let's correct that, by telling CSV to consider "NA" as missing.

    csv_df = CSV.read(
         joinpath(DATA_DIR, "StarWars.csv"),
         DataFrames.DataFrame;
         missingstring = "NA",
    @@ -26,7 +26,7 @@
         ylabel = "Height",
         label = false,
         ylims = (0, 3),
    -)
    Example block output

    That looks better.

    Tip

    Read the CSV documentation for other parsing options.

    DataFrames.jl supports manipulation using functions similar to pandas. For example, split the dataframe into groups based on eye-color:

    by_eyecolor = DataFrames.groupby(csv_df, :Eyecolor)

    GroupedDataFrame with 7 groups based on key: Eyecolor

    First Group (5 rows): Eyecolor = "blue"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Anakin Skywalkermale1.8884.0blueblondfairTatooine41.9BBY4ABYjedihumanlightsaber
    2Luke Skywalkermale1.7277.0blueblondfairTatooine19BBYunk_diedjedihumanlightsaber
    3Qui-Gon Jinnmale1.9388.5bluebrownlightunk_planet92BBY32BBYjedihumanlightsaber
    4Sheev Palpatinemale1.7375.0blueredpaleNaboo82BBY10ABYno_jedihumanforce-lightning
    5Chewbaccamale2.28112.0bluebrownmissingKashyyyk200BBY25ABYno_jediwookieebowcaster

    Last Group (1 row): Eyecolor = "black"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Chief Chirpamale1.050.0blackgraybrownEndorunk_born4ABYno_jediewokspear

    Then recombine into a single dataframe based on a function operating over the split dataframes:

    eyecolor_count = DataFrames.combine(by_eyecolor) do df
    +)
    Example block output

    That looks better.

    Tip

    Read the CSV documentation for other parsing options.

    DataFrames.jl supports manipulation using functions similar to pandas. For example, split the dataframe into groups based on eye-color:

    by_eyecolor = DataFrames.groupby(csv_df, :Eyecolor)

    GroupedDataFrame with 7 groups based on key: Eyecolor

    First Group (5 rows): Eyecolor = "blue"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Anakin Skywalkermale1.8884.0blueblondfairTatooine41.9BBY4ABYjedihumanlightsaber
    2Luke Skywalkermale1.7277.0blueblondfairTatooine19BBYunk_diedjedihumanlightsaber
    3Qui-Gon Jinnmale1.9388.5bluebrownlightunk_planet92BBY32BBYjedihumanlightsaber
    4Sheev Palpatinemale1.7375.0blueredpaleNaboo82BBY10ABYno_jedihumanforce-lightning
    5Chewbaccamale2.28112.0bluebrownmissingKashyyyk200BBY25ABYno_jediwookieebowcaster

    Last Group (1 row): Eyecolor = "black"
    RowNameGenderHeightWeightEyecolorHaircolorSkincolorHomelandBornDiedJediSpeciesWeapon
    String31String7Float64Float64?String15?String7?String15?String15String15String15String7String15String15
    1Chief Chirpamale1.050.0blackgraybrownEndorunk_born4ABYno_jediewokspear

    Then recombine into a single dataframe based on a function operating over the split dataframes:

    eyecolor_count = DataFrames.combine(by_eyecolor) do df
         return DataFrames.nrow(df)
     end
    7×2 DataFrame
    RowEyecolorx1
    String15?Int64
    1blue5
    2brown8
    3bluegray1
    4missing2
    5yellow2
    6gold1
    7black1

    We can rename columns:

    DataFrames.rename!(eyecolor_count, :x1 => :count)
    7×2 DataFrame
    RowEyecolorcount
    String15?Int64
    1blue5
    2brown8
    3bluegray1
    4missing2
    5yellow2
    6gold1
    7black1

    Drop some missing rows:

    DataFrames.dropmissing!(eyecolor_count, :Eyecolor)
    6×2 DataFrame
    RowEyecolorcount
    String15Int64
    1blue5
    2brown8
    3bluegray1
    4yellow2
    5gold1
    6black1

    Then we can visualize the data:

    sort!(eyecolor_count, :count; rev = true)
     Plots.bar(
    @@ -35,7 +35,7 @@
         xlabel = "Eye color",
         ylabel = "Number of characters",
         label = false,
    -)
    Example block output

    Other Delimited Files

    We can also use the CSV.jl package to read any other delimited text file format.

    By default, CSV.File will try to detect a file's delimiter from the first 10 lines of the file.

    Candidate delimiters include ',', '\t', ' ', '|', ';', and ':'. If it can't auto-detect the delimiter, it will assume ','.

    Let's take the example of space separated data.

    ss_df = CSV.read(joinpath(DATA_DIR, "Cereal.txt"), DataFrames.DataFrame)
    23×10 DataFrame
    RowNameCupsCaloriesCarbsFatFiberPotassiumProteinSodiumSugars
    String31Float64Int64Float64Int64Float64Int64Int64Int64Int64
    1CapnCrunch0.7512012.020.035122012
    2CocoaPuffs1.011012.010.055118013
    3Trix1.011013.010.025114012
    4AppleJacks1.011011.001.030212514
    5CornChex1.011022.000.02522803
    6CornFlakes1.010021.001.03522902
    7Nut&Honey0.6712015.010.04021909
    8Smacks0.751109.011.04027015
    9MultiGrain1.010015.012.09022206
    10CracklinOat0.511010.034.016031407
    11GrapeNuts0.2511017.003.09031793
    12HoneyNutCheerios0.7511011.511.590325010
    13NutriGrain0.6714021.023.013032207
    14Product191.010020.001.04533203
    15TotalRaisinBran1.014015.014.0230319014
    16WheatChex0.6710017.013.011532303
    17Oatmeal0.513013.521.5120317010
    18Life0.6710012.022.09541506
    19Maypo1.010016.010.095403
    20QuakerOats0.510014.012.011041356
    21Muesli1.015016.033.0170415011
    22Cheerios1.2511017.022.010562901
    23SpecialK1.011016.001.05562303

    We can also specify the delimiter as follows:

    delim_df = CSV.read(
    +)
    Example block output

    Other Delimited Files

    We can also use the CSV.jl package to read any other delimited text file format.

    By default, CSV.File will try to detect a file's delimiter from the first 10 lines of the file.

    Candidate delimiters include ',', '\t', ' ', '|', ';', and ':'. If it can't auto-detect the delimiter, it will assume ','.

    Let's take the example of space separated data.

    ss_df = CSV.read(joinpath(DATA_DIR, "Cereal.txt"), DataFrames.DataFrame)
    23×10 DataFrame
    RowNameCupsCaloriesCarbsFatFiberPotassiumProteinSodiumSugars
    String31Float64Int64Float64Int64Float64Int64Int64Int64Int64
    1CapnCrunch0.7512012.020.035122012
    2CocoaPuffs1.011012.010.055118013
    3Trix1.011013.010.025114012
    4AppleJacks1.011011.001.030212514
    5CornChex1.011022.000.02522803
    6CornFlakes1.010021.001.03522902
    7Nut&Honey0.6712015.010.04021909
    8Smacks0.751109.011.04027015
    9MultiGrain1.010015.012.09022206
    10CracklinOat0.511010.034.016031407
    11GrapeNuts0.2511017.003.09031793
    12HoneyNutCheerios0.7511011.511.590325010
    13NutriGrain0.6714021.023.013032207
    14Product191.010020.001.04533203
    15TotalRaisinBran1.014015.014.0230319014
    16WheatChex0.6710017.013.011532303
    17Oatmeal0.513013.521.5120317010
    18Life0.6710012.022.09541506
    19Maypo1.010016.010.095403
    20QuakerOats0.510014.012.011041356
    21Muesli1.015016.033.0170415011
    22Cheerios1.2511017.022.010562901
    23SpecialK1.011016.001.05562303

    We can also specify the delimiter as follows:

    delim_df = CSV.read(
         joinpath(DATA_DIR, "Soccer.txt"),
         DataFrames.DataFrame;
         delim = "::",
    @@ -204,7 +204,7 @@
       Dual objective value : NaN
     
     * Work counters
    -  Solve time (sec)   : 6.74891e-03
    +  Solve time (sec)   : 6.43325e-03
       Simplex iterations : 26
       Barrier iterations : -1
       Node count         : 1
    @@ -236,4 +236,4 @@
      * Uganda
      * United Arab Emirates
      * United States
    - * Zimbabwe

    We need some passports, like New Zealand and the United States, which have widespread access to a large number of countries. However, we also need passports like North Korea which only have visa-free access to a very limited number of countries.

    Note

    We use value(x[c]) > 0.5 rather than value(x[c]) == 1 to avoid excluding solutions like x[c] = 0.99999 that are "1" to some tolerance.

    + * Zimbabwe

    We need some passports, like New Zealand and the United States, which have widespread access to a large number of countries. However, we also need passports like North Korea which only have visa-free access to a very limited number of countries.

    Note

    We use value(x[c]) > 0.5 rather than value(x[c]) == 1 to avoid excluding solutions like x[c] = 0.99999 that are "1" to some tolerance.

    diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_julia/index.html b/previews/PR3913/tutorials/getting_started/getting_started_with_julia/index.html index 3c582cbc6cc..9b3083937e8 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_julia/index.html +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_julia/index.html @@ -43,9 +43,9 @@ *(::Any, ::Any, ::Any, ::Any...) @ Base operators.jl:596 *(::Type{<:LinearOperatorCollection.ProdOp}, ::Any, ::Any) - @ LinearOperatorCollection ~/.julia/packages/LinearOperatorCollection/GRBTA/src/ProdOp.jl:73 - *(::ChainRulesCore.NotImplemented, ::Any) - @ ChainRulesCore ~/.julia/packages/ChainRulesCore/U6wNx/src/tangent_arithmetic.jl:37 + @ LinearOperatorCollection ~/.julia/packages/LinearOperatorCollection/GRBTA/src/ProdOp.jl:73 + *(::Graphs.LinAlg.Noop, ::Any) + @ Graphs ~/.julia/packages/Graphs/1ALGD/src/linalg/graphmatrices.jl:216 ...

    But multiplying transposes works:

    julia> b' * b61
    julia> b * b'2×2 Matrix{Int64}: 25 30 30 36

    Other common types

    Comments

    Although not technically a type, code comments begin with the # character:

    julia> 1 + 1  # This is a comment2

    Multiline comments begin with #= and end with =#:

    #=
    @@ -182,4 +182,4 @@
      0.5103924401614957
      0.9296414851080324

    The Package Manager is used to install packages that are not part of Julia's standard library.

    For example the following can be used to install JuMP,

    using Pkg
     Pkg.add("JuMP")

    For a complete list of registered Julia packages see the package listing at JuliaHub.

    From time to you may wish to use a Julia package that is not registered. In this case a git repository URL can be used to install the package.

    using Pkg
    -Pkg.add("https://github.com/user-name/MyPackage.jl.git")

    Package environments

    By default, Pkg.add will add packages to Julia's global environment. However, Julia also has built-in support for virtual environments.

    Activate a virtual environment with:

    import Pkg; Pkg.activate("/path/to/environment")

    You can see what packages are installed in the current environment with Pkg.status().

    Tip

    We strongly recommend you create a Pkg environment for each project that you create in Julia, and add only the packages that you need, instead of adding lots of packages to the global environment. The Pkg manager documentation has more information on this topic.

    +Pkg.add("https://github.com/user-name/MyPackage.jl.git")

    Package environments

    By default, Pkg.add will add packages to Julia's global environment. However, Julia also has built-in support for virtual environments.

    Activate a virtual environment with:

    import Pkg; Pkg.activate("/path/to/environment")

    You can see what packages are installed in the current environment with Pkg.status().

    Tip

    We strongly recommend you create a Pkg environment for each project that you create in Julia, and add only the packages that you need, instead of adding lots of packages to the global environment. The Pkg manager documentation has more information on this topic.

    diff --git a/previews/PR3913/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html b/previews/PR3913/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html index 908f424409e..6d6fdf4b8d8 100644 --- a/previews/PR3913/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html +++ b/previews/PR3913/tutorials/getting_started/getting_started_with_sets_and_indexing/index.html @@ -219,4 +219,4 @@ ("Dunedin", "Auckland") => 1426 ("Auckland", "Christchurch") => 1071

    Then, we can create our model like so:

    model = Model()
     @variable(model, x[keys(routes)])
    -@objective(model, Min, sum(v * x[k] for (k, v) in routes))

    \[ 643 x_{("Auckland", "Wellington")} + 436 x_{("Wellington", "Christchurch")} + 790 x_{("Wellington", "Dunedin")} + 360 x_{("Christchurch", "Dunedin")} + 1426 x_{("Auckland", "Dunedin")} + 1426 x_{("Dunedin", "Auckland")} + 1071 x_{("Auckland", "Christchurch")} \]

    This has a number of benefits over the other approaches, including a compacter algebraic model and variables that are named in a more meaningful way.

    Tip

    If you're struggling to formulate a problem using the available syntax in JuMP, it's probably a sign that you should convert your data into a different form.

    Next steps

    The purpose of this tutorial was to show how JuMP does not have specialized syntax for set creation and manipulation. Instead, you should use the tools provided by Julia itself.

    This is both an opportunity and a challenge, because you are free to pick the syntax and data structures that best suit your problem, but for new users it can be daunting to decide which structure to use.

    Read through some of the other JuMP tutorials to get inspiration and ideas for how you can use Julia's syntax and data structures to your advantage.

    +@objective(model, Min, sum(v * x[k] for (k, v) in routes))

    \[ 643 x_{("Auckland", "Wellington")} + 436 x_{("Wellington", "Christchurch")} + 790 x_{("Wellington", "Dunedin")} + 360 x_{("Christchurch", "Dunedin")} + 1426 x_{("Auckland", "Dunedin")} + 1426 x_{("Dunedin", "Auckland")} + 1071 x_{("Auckland", "Christchurch")} \]

    This has a number of benefits over the other approaches, including a compacter algebraic model and variables that are named in a more meaningful way.

    Tip

    If you're struggling to formulate a problem using the available syntax in JuMP, it's probably a sign that you should convert your data into a different form.

    Next steps

    The purpose of this tutorial was to show how JuMP does not have specialized syntax for set creation and manipulation. Instead, you should use the tools provided by Julia itself.

    This is both an opportunity and a challenge, because you are free to pick the syntax and data structures that best suit your problem, but for new users it can be daunting to decide which structure to use.

    Read through some of the other JuMP tutorials to get inspiration and ideas for how you can use Julia's syntax and data structures to your advantage.

    diff --git a/previews/PR3913/tutorials/getting_started/introduction/index.html b/previews/PR3913/tutorials/getting_started/introduction/index.html index 7326e051b70..a7da02fb195 100644 --- a/previews/PR3913/tutorials/getting_started/introduction/index.html +++ b/previews/PR3913/tutorials/getting_started/introduction/index.html @@ -3,4 +3,4 @@ function gtag(){dataLayer.push(arguments);} gtag('js', new Date()); gtag('config', 'G-0RZ8X3D3D0', {'page_path': location.pathname + location.search + location.hash}); -

    Introduction

    The purpose of these "Getting started" tutorials is to teach new users the basics of Julia and JuMP.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The "Getting started with" tutorials are basic introductions to different aspects of JuMP and Julia. If you are new to JuMP and Julia, start by reading them in the following order:
    • Julia has a reputation for being "fast." Unfortunately, it is also easy to write slow Julia code. Performance tips contains a number of important tips on how to improve the performance of models you write in JuMP.
    • Design patterns for larger models is a more advanced tutorial that is aimed at users writing large JuMP models. It's in the "Getting started" section to give you an early preview of how JuMP makes it easy to structure larger models. If you are new to JuMP you may want to skip or briefly skim this tutorial, and come back to it once you have written a few JuMP models.
    +

    Introduction

    The purpose of these "Getting started" tutorials is to teach new users the basics of Julia and JuMP.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The "Getting started with" tutorials are basic introductions to different aspects of JuMP and Julia. If you are new to JuMP and Julia, start by reading them in the following order:
    • Julia has a reputation for being "fast." Unfortunately, it is also easy to write slow Julia code. Performance tips contains a number of important tips on how to improve the performance of models you write in JuMP.
    • Design patterns for larger models is a more advanced tutorial that is aimed at users writing large JuMP models. It's in the "Getting started" section to give you an early preview of how JuMP makes it easy to structure larger models. If you are new to JuMP you may want to skip or briefly skim this tutorial, and come back to it once you have written a few JuMP models.
    diff --git a/previews/PR3913/tutorials/getting_started/performance_tips/index.html b/previews/PR3913/tutorials/getting_started/performance_tips/index.html index 5bd24db25bb..86832013847 100644 --- a/previews/PR3913/tutorials/getting_started/performance_tips/index.html +++ b/previews/PR3913/tutorials/getting_started/performance_tips/index.html @@ -37,4 +37,4 @@ └ Names registered in the model: none
    julia> @variable(model, x[1:3])3-element Vector{VariableRef}: x[1] x[2] - x[3]

    Here's what happens if we construct the expression outside the macro:

    julia> @allocated x[1] + x[2] + x[3]1296
    Info

    The @allocated measures how many bytes were allocated during the evaluation of an expression. Fewer is better.

    If we use the @expression macro, we get many fewer allocations:

    julia> @allocated @expression(model, x[1] + x[2] + x[3])640

    Disable string names

    By default, JuMP creates String names for variables and constraints and passes these to the solver. The benefit of passing names is that it improves the readability of log messages from the solver (for example, "variable x has invalid bounds" instead of "variable v1203 has invalid bounds"), but for larger models the overhead of passing names can be non-trivial.

    Disable the creation of String names by setting set_string_name = false in the @variable and @constraint macros, or by calling set_string_names_on_creation to disable all names for a particular model:

    julia> model = Model();
    julia> set_string_names_on_creation(model, false)
    julia> @variable(model, x)_[1]
    julia> @constraint(model, c, 2x <= 1)2 _[1] ≤ 1

    Note that this doesn't change how symbolic names and bindings are stored:

    julia> x_[1]
    julia> model[:x]_[1]
    julia> x === model[:x]true

    But you can no longer look up the variable by the string name:

    julia> variable_by_name(model, "x") === nothingtrue
    Info

    For more information on the difference between string names, symbolic names, and bindings, see String names, symbolic names, and bindings.

    + x[3]

    Here's what happens if we construct the expression outside the macro:

    julia> @allocated x[1] + x[2] + x[3]1296
    Info

    The @allocated measures how many bytes were allocated during the evaluation of an expression. Fewer is better.

    If we use the @expression macro, we get many fewer allocations:

    julia> @allocated @expression(model, x[1] + x[2] + x[3])640

    Disable string names

    By default, JuMP creates String names for variables and constraints and passes these to the solver. The benefit of passing names is that it improves the readability of log messages from the solver (for example, "variable x has invalid bounds" instead of "variable v1203 has invalid bounds"), but for larger models the overhead of passing names can be non-trivial.

    Disable the creation of String names by setting set_string_name = false in the @variable and @constraint macros, or by calling set_string_names_on_creation to disable all names for a particular model:

    julia> model = Model();
    julia> set_string_names_on_creation(model, false)
    julia> @variable(model, x)_[1]
    julia> @constraint(model, c, 2x <= 1)2 _[1] ≤ 1

    Note that this doesn't change how symbolic names and bindings are stored:

    julia> x_[1]
    julia> model[:x]_[1]
    julia> x === model[:x]true

    But you can no longer look up the variable by the string name:

    julia> variable_by_name(model, "x") === nothingtrue
    Info

    For more information on the difference between string names, symbolic names, and bindings, see String names, symbolic names, and bindings.

    diff --git a/previews/PR3913/tutorials/getting_started/sum_if/8c11c9f5.svg b/previews/PR3913/tutorials/getting_started/sum_if/242b0d1c.svg similarity index 60% rename from previews/PR3913/tutorials/getting_started/sum_if/8c11c9f5.svg rename to previews/PR3913/tutorials/getting_started/sum_if/242b0d1c.svg index 3e61e2ada88..b669f03900f 100644 --- a/previews/PR3913/tutorials/getting_started/sum_if/8c11c9f5.svg +++ b/previews/PR3913/tutorials/getting_started/sum_if/242b0d1c.svg @@ -1,68 +1,68 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/getting_started/sum_if/624e5e6f.svg b/previews/PR3913/tutorials/getting_started/sum_if/93bd60b7.svg similarity index 55% rename from previews/PR3913/tutorials/getting_started/sum_if/624e5e6f.svg rename to previews/PR3913/tutorials/getting_started/sum_if/93bd60b7.svg index 47f5d7e1d0b..3560ba7b629 100644 --- a/previews/PR3913/tutorials/getting_started/sum_if/624e5e6f.svg +++ b/previews/PR3913/tutorials/getting_started/sum_if/93bd60b7.svg @@ -1,55 +1,55 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/getting_started/sum_if/index.html b/previews/PR3913/tutorials/getting_started/sum_if/index.html index eba3af7c11a..14c63c83521 100644 --- a/previews/PR3913/tutorials/getting_started/sum_if/index.html +++ b/previews/PR3913/tutorials/getting_started/sum_if/index.html @@ -64,7 +64,7 @@ end nodes, edges, demand = build_random_graph(1_000, 2_000) -@elapsed build_naive_model(nodes, edges, demand)
    0.116239978

    A good way to benchmark is to measure the runtime across a wide range of input sizes. From our big-O analysis, we should expect that doubling the number of nodes and edges results in a 4x increase in the runtime.

    run_times = Float64[]
    +@elapsed build_naive_model(nodes, edges, demand)
    0.200020119

    A good way to benchmark is to measure the runtime across a wide range of input sizes. From our big-O analysis, we should expect that doubling the number of nodes and edges results in a 4x increase in the runtime.

    run_times = Float64[]
     factors = 1:10
     for factor in factors
         graph = build_random_graph(1_000 * factor, 5_000 * factor)
    @@ -73,7 +73,7 @@
     Plots.plot(; xlabel = "Factor", ylabel = "Runtime [s]")
     Plots.scatter!(factors, run_times; label = "Actual")
     a, b = hcat(ones(10), factors .^ 2) \ run_times
    -Plots.plot!(factors, a .+ b * factors .^ 2; label = "Quadratic fit")
    Example block output

    As expected, the runtimes demonstrate quadratic scaling: if we double the number of nodes and edges, the runtime increases by a factor of four.

    Caching

    We can improve our formulation by caching the list of incoming and outgoing nodes for each node n:

    out_nodes = Dict(n => Int[] for n in nodes)
    +Plots.plot!(factors, a .+ b * factors .^ 2; label = "Quadratic fit")
    Example block output

    As expected, the runtimes demonstrate quadratic scaling: if we double the number of nodes and edges, the runtime increases by a factor of four.

    Caching

    We can improve our formulation by caching the list of incoming and outgoing nodes for each node n:

    out_nodes = Dict(n => Int[] for n in nodes)
     in_nodes = Dict(n => Int[] for n in nodes)
     for (i, j) in edges
         push!(out_nodes[i], j)
    @@ -104,7 +104,7 @@
     end
     
     nodes, edges, demand = build_random_graph(1_000, 2_000)
    -@elapsed build_cached_model(nodes, edges, demand)
    0.160647914

    Analysis

    Now we can analyse the difference in runtime of the two formulations:

    run_times_naive = Float64[]
    +@elapsed build_cached_model(nodes, edges, demand)
    0.158455476

    Analysis

    Now we can analyse the difference in runtime of the two formulations:

    run_times_naive = Float64[]
     run_times_cached = Float64[]
     factors = 1:10
     for factor in factors
    @@ -118,4 +118,4 @@
     Plots.plot!(factors, a .+ b * factors .^ 2; label = "Quadratic fit")
     Plots.scatter!(factors, run_times_cached; label = "Cached")
     a, b = hcat(ones(10), factors) \ run_times_cached
    -Plots.plot!(factors, a .+ b * factors; label = "Linear fit")
    Example block output

    Even though the cached model needs to build in_nodes and out_nodes, it is asymptotically faster than the naïve model, scaling linearly with factor rather than quadratically.

    Lesson

    If you write code with sum-if type conditions, for example, @constraint(model, [a in set], sum(x[b] for b in list if condition(a, b)), you can improve the performance by caching the elements for which condition(a, b) is true.

    Finally, you should understand that this behavior is not specific to JuMP, and that it applies more generally to all computer programs you might write. (Python programs that use Pyomo or gurobipy would similarly benefit from this caching approach.)

    Understanding big-O notation and algorithmic complexity is a useful debugging skill to have, regardless of the type of program that you are writing.

    +Plots.plot!(factors, a .+ b * factors; label = "Linear fit")Example block output

    Even though the cached model needs to build in_nodes and out_nodes, it is asymptotically faster than the naïve model, scaling linearly with factor rather than quadratically.

    Lesson

    If you write code with sum-if type conditions, for example, @constraint(model, [a in set], sum(x[b] for b in list if condition(a, b)), you can improve the performance by caching the elements for which condition(a, b) is true.

    Finally, you should understand that this behavior is not specific to JuMP, and that it applies more generally to all computer programs you might write. (Python programs that use Pyomo or gurobipy would similarly benefit from this caching approach.)

    Understanding big-O notation and algorithmic complexity is a useful debugging skill to have, regardless of the type of program that you are writing.

    diff --git a/previews/PR3913/tutorials/getting_started/tolerances/index.html b/previews/PR3913/tutorials/getting_started/tolerances/index.html index 64ac10d5293..7cea95d732c 100644 --- a/previews/PR3913/tutorials/getting_started/tolerances/index.html +++ b/previews/PR3913/tutorials/getting_started/tolerances/index.html @@ -37,34 +37,34 @@ ------------------------------------------------------------------ iter | pri res | dua res | gap | obj | scale | time (s) ------------------------------------------------------------------ - 0| 2.00e+01 1.00e+00 2.00e+01 -9.98e+00 1.00e-01 3.41e-02 - 100| 6.92e-05 7.92e-05 7.33e-06 2.41e-05 1.00e-01 9.26e-02 + 0| 2.00e+01 1.00e+00 2.00e+01 -9.98e+00 1.00e-01 3.46e-02 + 100| 6.92e-05 7.92e-05 7.33e-06 2.41e-05 1.00e-01 9.27e-02 ------------------------------------------------------------------ status: solved -timings: total: 9.26e-02s = setup: 3.30e-02s + solve: 5.96e-02s - lin-sys: 5.05e-02s, cones: 2.12e-03s, accel: 7.24e-04s +timings: total: 9.27e-02s = setup: 3.35e-02s + solve: 5.92e-02s + lin-sys: 5.03e-02s, cones: 2.15e-03s, accel: 6.91e-04s ------------------------------------------------------------------ objective = 0.000024 ------------------------------------------------------------------

    SCS reports that it solved the problem to optimality:

    is_solved_and_feasible(model)
    true

    and that the solution for x[1] is nearly zero:

    value(x[1])
    2.04406873858532e-5

    However, the analytic solution for x[1] is:

    1 - n * ε / 2
    0.8479

    The answer is very wrong, and there is no indication from the solver that anything untoward happened. What's going on?

    One useful debugging tool is primal_feasibility_report:

    report = primal_feasibility_report(model)
    Dict{Any, Float64} with 8192 entries:
    -  x[5374] ≥ 0 => 2.17278e-5
    -  x[991] ≥ 0  => 2.01984e-5
    -  x[2399] ≥ 0 => 1.8669e-5
    -  x[2829] ≥ 0 => 1.56101e-5
    -  x[5488] ≥ 0 => 2.17278e-5
    -  x[3677] ≥ 0 => 1.8669e-5
    -  x[945] ≥ 0  => 1.56101e-5
    -  x[6806] ≥ 0 => 1.8669e-5
    -  x[7322] ≥ 0 => 1.8669e-5
    -  x[4716] ≥ 0 => 1.8669e-5
    -  x[3181] ≥ 0 => 1.71395e-5
    -  x[149] ≥ 0  => 1.25513e-5
    -  x[570] ≥ 0  => 1.56101e-5
    -  x[3160] ≥ 0 => 1.8669e-5
    -  x[6903] ≥ 0 => 2.17278e-5
    -  x[6481] ≥ 0 => 1.56101e-5
    -  x[5462] ≥ 0 => 1.8669e-5
    -  x[6053] ≥ 0 => 1.8669e-5
    -  x[943] ≥ 0  => 1.8669e-5
    +  x[1247] ≥ 0 => 1.8669e-5
    +  x[7072] ≥ 0 => 2.32572e-5
    +  x[7216] ≥ 0 => 2.01984e-5
    +  x[3118] ≥ 0 => 1.71395e-5
    +  x[7925] ≥ 0 => 2.17278e-5
    +  x[3545] ≥ 0 => 1.8669e-5
    +  x[1582] ≥ 0 => 1.71395e-5
    +  x[7839] ≥ 0 => 2.17278e-5
    +  x[3581] ≥ 0 => 2.17278e-5
    +  x[234] ≥ 0  => 1.56101e-5
    +  x[2983] ≥ 0 => 1.8669e-5
    +  x[4448] ≥ 0 => 2.01984e-5
    +  x[4729] ≥ 0 => 1.71395e-5
    +  x[5324] ≥ 0 => 1.8669e-5
    +  x[5539] ≥ 0 => 1.71395e-5
    +  x[6189] ≥ 0 => 1.56101e-5
    +  x[5859] ≥ 0 => 1.8669e-5
    +  x[5960] ≥ 0 => 2.01984e-5
    +  x[2514] ≥ 0 => 1.71395e-5
       ⋮           => ⋮

    report is a dictionary which maps constraints to the violation. The largest violation is approximately 1e-5:

    maximum(values(report))
    6.92133754155444e-5

    This makes sense, because the default primal feasibility tolerance for SCS is 1e-4.

    Most of the entries are lower bound constraints on the variables. Here are all the variables which violate their lower bound:

    violated_variables = filter(xi -> value(xi) < 0, x)
    8178-element Vector{VariableRef}:
      x[4]
      x[6]
    @@ -105,13 +105,13 @@
      iter | pri res | dua res |   gap   |   obj   |  scale  | time (s)
     ------------------------------------------------------------------
          0| 2.00e+01  1.00e+00  2.00e+01 -9.98e+00  1.00e-01  3.44e-02
    -   250| 2.01e-02  2.85e-04  2.00e-02  3.01e-02  3.86e-01  1.84e-01
    -   500| 3.69e-04  5.93e-04  8.84e-05  8.48e-01  6.13e-01  3.36e-01
    -   550| 2.66e-06  6.58e-10  1.27e-05  8.48e-01  6.13e-01  3.66e-01
    +   250| 2.01e-02  2.85e-04  2.00e-02  3.01e-02  3.86e-01  1.85e-01
    +   500| 3.69e-04  5.93e-04  8.84e-05  8.48e-01  6.13e-01  3.37e-01
    +   550| 2.66e-06  6.58e-10  1.27e-05  8.48e-01  6.13e-01  3.67e-01
     ------------------------------------------------------------------
     status:  solved
    -timings: total: 3.66e-01s = setup: 3.34e-02s + solve: 3.33e-01s
    -	 lin-sys: 2.74e-01s, cones: 1.16e-02s, accel: 5.71e-03s
    +timings: total: 3.67e-01s = setup: 3.33e-02s + solve: 3.34e-01s
    +	 lin-sys: 2.74e-01s, cones: 1.15e-02s, accel: 5.70e-03s
     ------------------------------------------------------------------
     objective = 0.847906
     ------------------------------------------------------------------
    @assert is_solved_and_feasible(model)
    @@ -159,11 +159,11 @@
     @variable(model, x >= 0)
     @variable(model, y, Bin)
     @constraint(model, 1e-6x <= 1e6 * y)

    \[ 1.0 \times 10^{-6} x - 1000000 y \leq 0 \]

    This problem has a feasible (to tolerance) solution of:

    primal_feasibility_report(model, Dict(x => 1_000_000.01, y => 1e-6))
    Dict{Any, Float64} with 2 entries:
    -  1.0e-6 x - 1000000 y ≤ 0 => 1.0e-8
    -  y binary                 => 1.0e-6

    If you intended the constraint to read that if x is non-zero then y = 1, this solution might be unexpected.

    There are no hard rules that you must follow, and the interaction between tolerances, problem scaling, and the solution is problem dependent. You should always check the solution returned by the solver to check it makes sense for your application.

    With that caveat in mind, a general rule of thumb to follow is:

    Try to keep the ratio of the smallest to largest coefficient less than $10^6$ in any row and column, and try to keep most values between $10^{-3}$ and $10^6$.

    Choosing the correct units

    The best way to fix problem scaling is by changing the units of your variables and constraints. Here's an example. Suppose we are choosing the level of capacity investment in a new power plant. We can install up to 1 GW of capacity at a cost of $1.78/W, and we have a budget of $200 million.

    model = Model()
    +  y binary                 => 1.0e-6
    +  1.0e-6 x - 1000000 y ≤ 0 => 1.0e-8

    If you intended the constraint to read that if x is non-zero then y = 1, this solution might be unexpected.

    There are no hard rules that you must follow, and the interaction between tolerances, problem scaling, and the solution is problem dependent. You should always check the solution returned by the solver to check it makes sense for your application.

    With that caveat in mind, a general rule of thumb to follow is:

    Try to keep the ratio of the smallest to largest coefficient less than $10^6$ in any row and column, and try to keep most values between $10^{-3}$ and $10^6$.

    Choosing the correct units

    The best way to fix problem scaling is by changing the units of your variables and constraints. Here's an example. Suppose we are choosing the level of capacity investment in a new power plant. We can install up to 1 GW of capacity at a cost of $1.78/W, and we have a budget of $200 million.

    model = Model()
     @variable(model, 0 <= x_capacity_W <= 10^9)
     @constraint(model, 1.78 * x_capacity_W <= 200e6)

    \[ 1.78 x\_capacity\_W \leq 200000000 \]

    This constraint violates the recommendations because there are values greater than $10^6$, and the ratio of the coefficients in the constraint is $10^8$.

    One fix is the convert our capacity variable from Watts to Megawatts. This yields:

    model = Model()
     @variable(model, 0 <= x_capacity_MW <= 10^3)
     @constraint(model, 1.78e6 * x_capacity_MW <= 200e6)

    \[ 1780000 x\_capacity\_MW \leq 200000000 \]

    We can improve our model further by dividing the constraint by $10^6$ to change the units from dollars to million dollars.

    model = Model()
     @variable(model, 0 <= x_capacity_MW <= 10^3)
    -@constraint(model, 1.78 * x_capacity_MW <= 200)

    \[ 1.78 x\_capacity\_MW \leq 200 \]

    This problem is equivalent to the original problem, but it has much better problem scaling.

    As a general rule, to fix problem scaling you must simultaneously scale both variables and constraints. It is usually not sufficient to scale variables or constraints in isolation.

    +@constraint(model, 1.78 * x_capacity_MW <= 200)

    \[ 1.78 x\_capacity\_MW \leq 200 \]

    This problem is equivalent to the original problem, but it has much better problem scaling.

    As a general rule, to fix problem scaling you must simultaneously scale both variables and constraints. It is usually not sufficient to scale variables or constraints in isolation.

    diff --git a/previews/PR3913/tutorials/linear/basis/index.html b/previews/PR3913/tutorials/linear/basis/index.html index 07d1708e5ba..e0f253b7f50 100644 --- a/previews/PR3913/tutorials/linear/basis/index.html +++ b/previews/PR3913/tutorials/linear/basis/index.html @@ -60,9 +60,9 @@ ci => get_attribute(ci, MOI.ConstraintBasisStatus()) for ci in all_constraints(model; include_variable_in_set_constraints = false) )
    Dict{ConstraintRef{Model, C, ScalarShape} where C, MathOptInterface.BasisStatusCode} with 3 entries:
    -  c2 : 7 x + 12 y ≥ 120 => NONBASIC
    +  c3 : x + y ≤ 20       => BASIC
       c1 : 6 x + 8 y ≥ 100  => NONBASIC
    -  c3 : x + y ≤ 20       => BASIC

    Thus, the basis is formed by x, y, and the slack associated with c3.

    A simple way to get the A matrix of an unstructured linear program is with lp_matrix_data:

    matrix = lp_matrix_data(model)
    +  c2 : 7 x + 12 y ≥ 120 => NONBASIC

    Thus, the basis is formed by x, y, and the slack associated with c3.

    A simple way to get the A matrix of an unstructured linear program is with lp_matrix_data:

    matrix = lp_matrix_data(model)
     matrix.A
    3×3 SparseArrays.SparseMatrixCSC{Float64, Int64} with 6 stored entries:
      6.0   8.0   ⋅ 
      7.0  12.0   ⋅ 
    @@ -96,4 +96,4 @@
     @constraint(model, A * x == b)
     optimize!(model)
     degenerate_variables = filter(is_degenerate, all_variables(model))
    1-element Vector{VariableRef}:
    - x[1]

    The solution is degenerate because:

    value(x[1])
    -0.0

    and

    get_attribute(x[1], MOI.VariableBasisStatus())
    BASIC::BasisStatusCode = 0
    + x[1]

    The solution is degenerate because:

    value(x[1])
    -0.0

    and

    get_attribute(x[1], MOI.VariableBasisStatus())
    BASIC::BasisStatusCode = 0
    diff --git a/previews/PR3913/tutorials/linear/callbacks/index.html b/previews/PR3913/tutorials/linear/callbacks/index.html index 250652b8ff4..1c0882560d2 100644 --- a/previews/PR3913/tutorials/linear/callbacks/index.html +++ b/previews/PR3913/tutorials/linear/callbacks/index.html @@ -246,4 +246,4 @@ Solve interrupted Best objective -, best bound -, gap - -User-callback calls 31, time in user-callback 0.03 sec +User-callback calls 31, time in user-callback 0.03 sec diff --git a/previews/PR3913/tutorials/linear/cannery/index.html b/previews/PR3913/tutorials/linear/cannery/index.html index fca3f5ddf93..aaf0a4695bc 100644 --- a/previews/PR3913/tutorials/linear/cannery/index.html +++ b/previews/PR3913/tutorials/linear/cannery/index.html @@ -76,7 +76,7 @@ Dual objective value : 1.68000e+03 * Work counters - Solve time (sec) : 2.33412e-04 + Solve time (sec) : 1.88112e-04 Simplex iterations : 3 Barrier iterations : 0 Node count : -1 @@ -88,4 +88,4 @@ Seattle => New-York: 0.0 San-Diego => Chicago: 0.0 San-Diego => Topeka: 300.0 -San-Diego => New-York: 300.0 +San-Diego => New-York: 300.0 diff --git a/previews/PR3913/tutorials/linear/constraint_programming/index.html b/previews/PR3913/tutorials/linear/constraint_programming/index.html index b6aff249d61..a53bf3ddaa9 100644 --- a/previews/PR3913/tutorials/linear/constraint_programming/index.html +++ b/previews/PR3913/tutorials/linear/constraint_programming/index.html @@ -97,4 +97,4 @@ value.(x)
    3-element Vector{Float64}:
      1.0
      1.0
    - 0.0
    + 0.0 diff --git a/previews/PR3913/tutorials/linear/diet/index.html b/previews/PR3913/tutorials/linear/diet/index.html index 3b365e3c610..783192aaa2b 100644 --- a/previews/PR3913/tutorials/linear/diet/index.html +++ b/previews/PR3913/tutorials/linear/diet/index.html @@ -11,7 +11,7 @@ \min & \sum\limits_{f \in F} c_f x_f \\ \text{s.t.}\ \ & l_m \le \sum\limits_{f \in F} a_{m,f} x_f \le u_m, && \forall m \in M \\ & x_f \ge 0, && \forall f \in F. -\end{aligned}\]

    In the rest of this tutorial, we will create and solve this problem in JuMP, and learn what we should cook for dinner.

    Data

    First, we need some data for the problem. For this tutorial, we'll write CSV files to a temporary directory from Julia. If you have existing files, you could change the filenames to point to them instead.

    dir = mktempdir()
    "/tmp/jl_0qTiI3"

    The first file is a list of foods with their macro-nutrient profile:

    food_csv_filename = joinpath(dir, "diet_foods.csv")
    +\end{aligned}\]

    In the rest of this tutorial, we will create and solve this problem in JuMP, and learn what we should cook for dinner.

    Data

    First, we need some data for the problem. For this tutorial, we'll write CSV files to a temporary directory from Julia. If you have existing files, you could change the filenames to point to them instead.

    dir = mktempdir()
    "/tmp/jl_QO9QC3"

    The first file is a list of foods with their macro-nutrient profile:

    food_csv_filename = joinpath(dir, "diet_foods.csv")
     open(food_csv_filename, "w") do io
         write(
             io,
    @@ -103,7 +103,7 @@
       Dual objective value : 1.18289e+01
     
     * Work counters
    -  Solve time (sec)   : 1.99795e-04
    +  Solve time (sec)   : 2.08855e-04
       Simplex iterations : 6
       Barrier iterations : 0
       Node count         : -1
    @@ -142,8 +142,8 @@
       Dual objective value : 3.56146e+00
     
     * Work counters
    -  Solve time (sec)   : 1.39713e-04
    +  Solve time (sec)   : 1.31845e-04
       Simplex iterations : 0
       Barrier iterations : 0
       Node count         : -1
    -

    There exists no feasible solution to our problem. Looks like we're stuck eating ice cream for dinner.

    Next steps

    • You can delete a constraint using delete(model, dairy_constraint). Can you add a different constraint to provide a diet with less dairy?
    • Some food items (like hamburgers) are discrete. You can use set_integer to force a variable to take integer values. What happens to the solution if you do?
    +

    There exists no feasible solution to our problem. Looks like we're stuck eating ice cream for dinner.

    Next steps

    • You can delete a constraint using delete(model, dairy_constraint). Can you add a different constraint to provide a diet with less dairy?
    • Some food items (like hamburgers) are discrete. You can use set_integer to force a variable to take integer values. What happens to the solution if you do?
    diff --git a/previews/PR3913/tutorials/linear/facility_location/18832766.svg b/previews/PR3913/tutorials/linear/facility_location/cb358076.svg similarity index 81% rename from previews/PR3913/tutorials/linear/facility_location/18832766.svg rename to previews/PR3913/tutorials/linear/facility_location/cb358076.svg index e2be6bdd137..8d3927bc9fc 100644 --- a/previews/PR3913/tutorials/linear/facility_location/18832766.svg +++ b/previews/PR3913/tutorials/linear/facility_location/cb358076.svg @@ -1,61 +1,61 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/facility_location/42b7f33e.svg b/previews/PR3913/tutorials/linear/facility_location/d4f1b99a.svg similarity index 79% rename from previews/PR3913/tutorials/linear/facility_location/42b7f33e.svg rename to previews/PR3913/tutorials/linear/facility_location/d4f1b99a.svg index 3914afeb727..6ea25a97a3a 100644 --- a/previews/PR3913/tutorials/linear/facility_location/42b7f33e.svg +++ b/previews/PR3913/tutorials/linear/facility_location/d4f1b99a.svg @@ -1,69 +1,69 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/facility_location/86d4cc0f.svg b/previews/PR3913/tutorials/linear/facility_location/eabed534.svg similarity index 80% rename from previews/PR3913/tutorials/linear/facility_location/86d4cc0f.svg rename to previews/PR3913/tutorials/linear/facility_location/eabed534.svg index ec5df9b5260..ac99d57f46f 100644 --- a/previews/PR3913/tutorials/linear/facility_location/86d4cc0f.svg +++ b/previews/PR3913/tutorials/linear/facility_location/eabed534.svg @@ -1,57 +1,57 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/facility_location/96d80ca9.svg b/previews/PR3913/tutorials/linear/facility_location/f2db4430.svg similarity index 79% rename from previews/PR3913/tutorials/linear/facility_location/96d80ca9.svg rename to previews/PR3913/tutorials/linear/facility_location/f2db4430.svg index 0ac8d5ee822..5e8fcc999da 100644 --- a/previews/PR3913/tutorials/linear/facility_location/96d80ca9.svg +++ b/previews/PR3913/tutorials/linear/facility_location/f2db4430.svg @@ -1,69 +1,69 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/facility_location/index.html b/previews/PR3913/tutorials/linear/facility_location/index.html index a2b29d3c2d8..ebb52416f88 100644 --- a/previews/PR3913/tutorials/linear/facility_location/index.html +++ b/previews/PR3913/tutorials/linear/facility_location/index.html @@ -51,7 +51,7 @@ markersize = 6, markerstrokecolor = :red, markerstrokewidth = 2, -)Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
    +)
    Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, y[1:n], Bin);
     @variable(model, x[1:m, 1:n], Bin);
    @@ -94,7 +94,7 @@
         end
     end
     
    -p
    Example block output

    Capacitated facility location

    Problem formulation

    The capacitated variant introduces a capacity constraint on each facility, that is, clients have a certain level of demand to be served, while each facility only has finite capacity which cannot be exceeded.

    Specifically,

    • The demand of client $i$ is denoted by $a_{i} \geq 0$
    • The capacity of facility $j$ is denoted by $q_{j} \geq 0$

    The capacity constraints then write

    \[\begin{aligned} +pExample block output

    Capacitated facility location

    Problem formulation

    The capacitated variant introduces a capacity constraint on each facility, that is, clients have a certain level of demand to be served, while each facility only has finite capacity which cannot be exceeded.

    Specifically,

    • The demand of client $i$ is denoted by $a_{i} \geq 0$
    • The capacity of facility $j$ is denoted by $q_{j} \geq 0$

    The capacity constraints then write

    \[\begin{aligned} \sum_{i} a_{i} x_{i, j} &\leq q_{j} y_{j} && \forall j \in N \end{aligned}\]

    Note that, if $y_{j}$ is set to $0$, the capacity constraint above automatically forces $x_{i, j}$ to $0$.

    Thus, the capacitated facility location can be formulated as follows

    \[\begin{aligned} \min_{x, y} \ \ \ & @@ -126,7 +126,7 @@ markersize = q, markerstrokecolor = :red, markerstrokewidth = 2, -)Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
    +)
    Example block output

    JuMP implementation

    Create a JuMP model

    model = Model(HiGHS.Optimizer)
     set_silent(model)
     @variable(model, y[1:n], Bin);
     @variable(model, x[1:m, 1:n], Bin);
    @@ -169,4 +169,4 @@
         end
     end
     
    -p
    Example block output +pExample block output diff --git a/previews/PR3913/tutorials/linear/factory_schedule/bc43d3ce.svg b/previews/PR3913/tutorials/linear/factory_schedule/3434ebab.svg similarity index 78% rename from previews/PR3913/tutorials/linear/factory_schedule/bc43d3ce.svg rename to previews/PR3913/tutorials/linear/factory_schedule/3434ebab.svg index df83bf65dfb..3274804e0e4 100644 --- a/previews/PR3913/tutorials/linear/factory_schedule/bc43d3ce.svg +++ b/previews/PR3913/tutorials/linear/factory_schedule/3434ebab.svg @@ -1,162 +1,162 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/factory_schedule/a152d491.svg b/previews/PR3913/tutorials/linear/factory_schedule/b4a6db29.svg similarity index 85% rename from previews/PR3913/tutorials/linear/factory_schedule/a152d491.svg rename to previews/PR3913/tutorials/linear/factory_schedule/b4a6db29.svg index 2ab46646a7e..46f6631e1e8 100644 --- a/previews/PR3913/tutorials/linear/factory_schedule/a152d491.svg +++ b/previews/PR3913/tutorials/linear/factory_schedule/b4a6db29.svg @@ -1,81 +1,81 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/factory_schedule/244add1b.svg b/previews/PR3913/tutorials/linear/factory_schedule/f4e04e03.svg similarity index 78% rename from previews/PR3913/tutorials/linear/factory_schedule/244add1b.svg rename to previews/PR3913/tutorials/linear/factory_schedule/f4e04e03.svg index 719a9fb2170..ef80abb3ec0 100644 --- a/previews/PR3913/tutorials/linear/factory_schedule/244add1b.svg +++ b/previews/PR3913/tutorials/linear/factory_schedule/f4e04e03.svg @@ -1,160 +1,160 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/factory_schedule/index.html b/previews/PR3913/tutorials/linear/factory_schedule/index.html index 13362336d2c..fea4a6df4f0 100644 --- a/previews/PR3913/tutorials/linear/factory_schedule/index.html +++ b/previews/PR3913/tutorials/linear/factory_schedule/index.html @@ -126,7 +126,7 @@ ylabel = "Production", legend = :topleft, color = ["#20326c" "#4063d8" "#a0b1ec"], -)Example block output

    Note that we don't have any unmet demand.

    What happens if demand increases?

    Let's run an experiment by increasing the demand by 50% in all time periods:

    demand_df.demand .*= 1.5
    12-element Vector{Float64}:
    +)
    Example block output

    Note that we don't have any unmet demand.

    What happens if demand increases?

    Let's run an experiment by increasing the demand by 50% in all time periods:

    demand_df.demand .*= 1.5
    12-element Vector{Float64}:
      180000.0
      150000.0
      195000.0
    @@ -146,7 +146,7 @@
         ylabel = "Production",
         legend = :topleft,
         color = ["#20326c" "#4063d8" "#a0b1ec"],
    -)
    Example block output

    Uh oh, we can't satisfy all of the demand.

    How sensitive is the solution to changes in variable cost?

    Let's run another experiment, this time seeing how the optimal objective value changes as we vary the variable costs of each factory.

    First though, let's reset the demand to it's original level:

    demand_df.demand ./= 1.5;

    For our experiment, we're going to scale the variable costs of both factories by a set of values from 0.0 to 1.5:

    scale_factors = 0:0.1:1.5
    0.0:0.1:1.5

    At a high level, we're going to loop over the scale factors for A, then the scale factors for B, rescale the input data, call our solve_factory_scheduling example, and then store the optimal objective value in the following cost matrix:

    cost = zeros(length(scale_factors), length(scale_factors));

    Because we're modifying factory_df in-place, we need to store the original variable costs in a new column:

    factory_df[!, :old_variable_cost] = copy(factory_df.variable_cost);

    Then, we need a function to scale the :variable_cost column for a particular factory by a value scale:

    function scale_variable_cost(df, factory, scale)
    +)
    Example block output

    Uh oh, we can't satisfy all of the demand.

    How sensitive is the solution to changes in variable cost?

    Let's run another experiment, this time seeing how the optimal objective value changes as we vary the variable costs of each factory.

    First though, let's reset the demand to it's original level:

    demand_df.demand ./= 1.5;

    For our experiment, we're going to scale the variable costs of both factories by a set of values from 0.0 to 1.5:

    scale_factors = 0:0.1:1.5
    0.0:0.1:1.5

    At a high level, we're going to loop over the scale factors for A, then the scale factors for B, rescale the input data, call our solve_factory_scheduling example, and then store the optimal objective value in the following cost matrix:

    cost = zeros(length(scale_factors), length(scale_factors));

    Because we're modifying factory_df in-place, we need to store the original variable costs in a new column:

    factory_df[!, :old_variable_cost] = copy(factory_df.variable_cost);

    Then, we need a function to scale the :variable_cost column for a particular factory by a value scale:

    function scale_variable_cost(df, factory, scale)
         rows = df.factory .== factory
         df[rows, :variable_cost] .=
             round.(Int, df[rows, :old_variable_cost] .* scale)
    @@ -163,4 +163,4 @@
         cost;
         xlabel = "Scale of factory A",
         ylabel = "Scale of factory B",
    -)
    Example block output

    What can you infer from the solution?

    Info

    The Power Systems tutorial explains a number of other ways you can structure a problem to perform a parametric analysis of the solution. In particular, you can use in-place modification to reduce the time it takes to build and solve the resulting models.

    +)Example block output

    What can you infer from the solution?

    Info

    The Power Systems tutorial explains a number of other ways you can structure a problem to perform a parametric analysis of the solution. In particular, you can use in-place modification to reduce the time it takes to build and solve the resulting models.

    diff --git a/previews/PR3913/tutorials/linear/finance/index.html b/previews/PR3913/tutorials/linear/finance/index.html index 2e3735dbd74..1f27381cb3c 100644 --- a/previews/PR3913/tutorials/linear/finance/index.html +++ b/previews/PR3913/tutorials/linear/finance/index.html @@ -50,4 +50,4 @@ 1.0 -0.0 -0.0 - 0.0 + 0.0 diff --git a/previews/PR3913/tutorials/linear/geographic_clustering/index.html b/previews/PR3913/tutorials/linear/geographic_clustering/index.html index c6c1d209f06..32b7566b29f 100644 --- a/previews/PR3913/tutorials/linear/geographic_clustering/index.html +++ b/previews/PR3913/tutorials/linear/geographic_clustering/index.html @@ -135,4 +135,4 @@ 5 │ San Francisco, CA 0.837 37.7749 -122.419 3.0 6 │ El Paso, TX 0.674 31.7775 -106.442 3.0 -sum(group.population) = 9.261000000000001 +sum(group.population) = 9.261000000000001 diff --git a/previews/PR3913/tutorials/linear/introduction/index.html b/previews/PR3913/tutorials/linear/introduction/index.html index 6c363e651aa..e36ceb83b28 100644 --- a/previews/PR3913/tutorials/linear/introduction/index.html +++ b/previews/PR3913/tutorials/linear/introduction/index.html @@ -7,4 +7,4 @@ \min_{x \in \mathbb{R}^n} & \sum\limits_{i=1}^n c_i x_i \\ \;\;\text{s.t.} & l_j \le \sum\limits_{i=1}^n a_{ij} x_i \le u_j & j = 1 \ldots m \\ & l_i \le x_i \le u_i & i = 1 \ldots n. -\end{align}\]

    The most important thing to note is that all terms are of the form coefficient * variable, and that there are no nonlinear terms or multiplications between variables.

    Mixed-integer linear programs (MILPs) are extensions of linear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    Almost all solvers support linear programs; look for "LP" in the list of Supported solvers. However, fewer solvers support mixed-integer linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Tips and tricks tutorial contains a number of helpful reformulations and tricks you can use when modeling linear programs. Look here if you are stuck trying to formulate a problem as a linear program.
    • The Sensitivity analysis of a linear program tutorial explains how to create sensitivity reports like those produced by the Excel Solver.
    • The Callbacks tutorial explains how to write a variety of solver-independent callbacks. Look here if you want to write a callback.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    +\end{align}\]

    The most important thing to note is that all terms are of the form coefficient * variable, and that there are no nonlinear terms or multiplications between variables.

    Mixed-integer linear programs (MILPs) are extensions of linear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    Almost all solvers support linear programs; look for "LP" in the list of Supported solvers. However, fewer solvers support mixed-integer linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    • The following tutorials are worked examples that present a problem in words, then formulate it in mathematics, and then solve it in JuMP. This usually involves some sort of visualization of the solution. Start here if you are new to JuMP.
    • The Tips and tricks tutorial contains a number of helpful reformulations and tricks you can use when modeling linear programs. Look here if you are stuck trying to formulate a problem as a linear program.
    • The Sensitivity analysis of a linear program tutorial explains how to create sensitivity reports like those produced by the Excel Solver.
    • The Callbacks tutorial explains how to write a variety of solver-independent callbacks. Look here if you want to write a callback.
    • The remaining tutorials are less verbose and styled in the form of short code examples. These tutorials have less explanation, but may contain useful code snippets, particularly if they are similar to a problem you are trying to solve.
    diff --git a/previews/PR3913/tutorials/linear/knapsack/index.html b/previews/PR3913/tutorials/linear/knapsack/index.html index d2cd76f03ce..4b6af3afb82 100644 --- a/previews/PR3913/tutorials/linear/knapsack/index.html +++ b/previews/PR3913/tutorials/linear/knapsack/index.html @@ -49,7 +49,7 @@ Dual objective value : NaN * Work counters - Solve time (sec) : 4.98533e-04 + Solve time (sec) : 5.15938e-04 Simplex iterations : 1 Barrier iterations : -1 Node count : 1 @@ -84,4 +84,4 @@ solve_knapsack_problem(; profit = profit, weight = weight, capacity = capacity)
    3-element Vector{Int64}:
      1
      4
    - 5

    We observe that the chosen items (1, 4, and 5) have the best profit to weight ratio in this particular example.

    Next steps

    Here are some things to try next:

    • Call the function with different data. What happens as the capacity increases?
    • What happens if the profit and weight vectors are different lengths?
    • Instead of creating a binary variable with Bin, we could have written @variable(model, 0 <= x[1:n] <= 1, Int). Verify that this formulation finds the same solution. What happens if we are allowed to take more than one of each item?
    + 5

    We observe that the chosen items (1, 4, and 5) have the best profit to weight ratio in this particular example.

    Next steps

    Here are some things to try next:

    • Call the function with different data. What happens as the capacity increases?
    • What happens if the profit and weight vectors are different lengths?
    • Instead of creating a binary variable with Bin, we could have written @variable(model, 0 <= x[1:n] <= 1, Int). Verify that this formulation finds the same solution. What happens if we are allowed to take more than one of each item?
    diff --git a/previews/PR3913/tutorials/linear/lp_sensitivity/index.html b/previews/PR3913/tutorials/linear/lp_sensitivity/index.html index b945282af82..045f59284b3 100644 --- a/previews/PR3913/tutorials/linear/lp_sensitivity/index.html +++ b/previews/PR3913/tutorials/linear/lp_sensitivity/index.html @@ -40,11 +40,11 @@ c3 : 0.00000e+00 * Work counters - Solve time (sec) : 2.40564e-04 + Solve time (sec) : 2.25544e-04 Simplex iterations : 2 Barrier iterations : 0 Node count : -1 -

    Can you identify:

    • The objective coefficient of each variable?
    • The right-hand side of each constraint?
    • The optimal primal and dual solutions?

    Sensitivity reports

    Now let's call lp_sensitivity_report:

    report = lp_sensitivity_report(model)
    SensitivityReport{Float64}(Dict{ConstraintRef, Tuple{Float64, Float64}}(c2 : 7 x + 12 y ≥ 120 => (-3.3333333333333335, 4.666666666666667), c1 : 6 x + 8 y ≥ 100 => (-4.0, 2.857142857142857), y ≤ 3 => (-1.75, Inf), z ≤ 1 => (-Inf, Inf), x ≥ 0 => (-Inf, 15.0), c3 : x + y ≤ 20 => (-3.75, Inf), y ≥ 0 => (-Inf, 1.25)), Dict{VariableRef, Tuple{Float64, Float64}}(z => (-Inf, 1.0), y => (-4.0, 0.5714285714285714), x => (-0.3333333333333333, 3.0)))

    It returns a SensitivityReport object, which maps:

    • Every variable reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
    • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

    Both tuples are relative, rather than absolute. So, given an objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

    For example:

    report[x]
    (-0.3333333333333333, 3.0)

    indicates that the objective coefficient on x, that is, 12, can decrease by -0.333 or increase by 3.0 and the primal solution (15, 1.25) will remain optimal. In addition:

    report[c1]
    (-4.0, 2.857142857142857)

    means that the right-hand side of the c1 constraint (100), can decrease by 4 units, or increase by 2.85 units, and the primal solution (15, 1.25) will remain optimal.

    Variable sensitivity

    By themselves, the tuples aren't informative. Let's put them in context by collating a range of other information about a variable:

    function variable_report(xi)
    +

    Can you identify:

    • The objective coefficient of each variable?
    • The right-hand side of each constraint?
    • The optimal primal and dual solutions?

    Sensitivity reports

    Now let's call lp_sensitivity_report:

    report = lp_sensitivity_report(model)
    SensitivityReport{Float64}(Dict{ConstraintRef, Tuple{Float64, Float64}}(c1 : 6 x + 8 y ≥ 100 => (-4.0, 2.857142857142857), c2 : 7 x + 12 y ≥ 120 => (-3.3333333333333335, 4.666666666666667), c3 : x + y ≤ 20 => (-3.75, Inf), x ≥ 0 => (-Inf, 15.0), y ≥ 0 => (-Inf, 1.25), y ≤ 3 => (-1.75, Inf), z ≤ 1 => (-Inf, Inf)), Dict{VariableRef, Tuple{Float64, Float64}}(y => (-4.0, 0.5714285714285714), x => (-0.3333333333333333, 3.0), z => (-Inf, 1.0)))

    It returns a SensitivityReport object, which maps:

    • Every variable reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the objective coefficient of the corresponding variable can change by, such that the original basis remains optimal.
    • Every constraint reference to a tuple (d_lo, d_hi)::Tuple{Float64,Float64}, explaining how much the right-hand side of the corresponding constraint can change by, such that the basis remains optimal.

    Both tuples are relative, rather than absolute. So, given an objective coefficient of 1.0 and a tuple (-0.5, 0.5), the objective coefficient can range between 1.0 - 0.5 an 1.0 + 0.5.

    For example:

    report[x]
    (-0.3333333333333333, 3.0)

    indicates that the objective coefficient on x, that is, 12, can decrease by -0.333 or increase by 3.0 and the primal solution (15, 1.25) will remain optimal. In addition:

    report[c1]
    (-4.0, 2.857142857142857)

    means that the right-hand side of the c1 constraint (100), can decrease by 4 units, or increase by 2.85 units, and the primal solution (15, 1.25) will remain optimal.

    Variable sensitivity

    By themselves, the tuples aren't informative. Let's put them in context by collating a range of other information about a variable:

    function variable_report(xi)
         return (
             name = name(xi),
             lower_bound = has_lower_bound(xi) ? lower_bound(xi) : -Inf,
    @@ -71,4 +71,4 @@
     c1_report = constraint_report(c1)
    (name = "c1", value = 100.0, rhs = 100.0, slack = 0.0, shadow_price = -0.25, allowed_decrease = -4.0, allowed_increase = 2.857142857142857)

    That's a bit hard to read, so let's call this on every variable in the model and put things into a DataFrame:

    constraint_df = DataFrames.DataFrame(
         constraint_report(ci) for (F, S) in list_of_constraint_types(model) for
         ci in all_constraints(model, F, S) if F == AffExpr
    -)
    3×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    3c316.2520.03.750.0-3.75Inf

    Analysis questions

    Now we can use these dataframes to ask questions of the solution.

    For example, we can find basic variables by looking for variables with a reduced cost of 0:

    basic = filter(row -> iszero(row.reduced_cost), variable_df)
    2×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1x0.015.0Inf0.012.0-0.3333333.0
    2y0.01.253.00.020.0-4.00.571429

    and non-basic variables by looking for non-zero reduced costs:

    non_basic = filter(row -> !iszero(row.reduced_cost), variable_df)
    1×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1z-Inf1.01.0-1.0-1.0-Inf1.0

    we can also find constraints that are binding by looking for zero slacks:

    binding = filter(row -> iszero(row.slack), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667

    or non-zero shadow prices:

    binding2 = filter(row -> !iszero(row.shadow_price), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    +)
    3×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    3c316.2520.03.750.0-3.75Inf

    Analysis questions

    Now we can use these dataframes to ask questions of the solution.

    For example, we can find basic variables by looking for variables with a reduced cost of 0:

    basic = filter(row -> iszero(row.reduced_cost), variable_df)
    2×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1x0.015.0Inf0.012.0-0.3333333.0
    2y0.01.253.00.020.0-4.00.571429

    and non-basic variables by looking for non-zero reduced costs:

    non_basic = filter(row -> !iszero(row.reduced_cost), variable_df)
    1×8 DataFrame
    Rownamelower_boundvalueupper_boundreduced_costobj_coefficientallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64Float64
    1z-Inf1.01.0-1.0-1.0-Inf1.0

    we can also find constraints that are binding by looking for zero slacks:

    binding = filter(row -> iszero(row.slack), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667

    or non-zero shadow prices:

    binding2 = filter(row -> !iszero(row.shadow_price), constraint_df)
    2×7 DataFrame
    Rownamevaluerhsslackshadow_priceallowed_decreaseallowed_increase
    StringFloat64Float64Float64Float64Float64Float64
    1c1100.0100.00.0-0.25-4.02.85714
    2c2120.0120.00.0-1.5-3.333334.66667
    diff --git a/previews/PR3913/tutorials/linear/mip_duality/index.html b/previews/PR3913/tutorials/linear/mip_duality/index.html index 18a875223bb..75e20e61fb6 100644 --- a/previews/PR3913/tutorials/linear/mip_duality/index.html +++ b/previews/PR3913/tutorials/linear/mip_duality/index.html @@ -113,4 +113,4 @@ g[2] ≤ 1000 w ≤ 200 dispatch[1] binary - dispatch[2] binary + dispatch[2] binary diff --git a/previews/PR3913/tutorials/linear/multi/index.html b/previews/PR3913/tutorials/linear/multi/index.html index 7e4ecd367cc..58eedfb0393 100644 --- a/previews/PR3913/tutorials/linear/multi/index.html +++ b/previews/PR3913/tutorials/linear/multi/index.html @@ -118,7 +118,7 @@ INNER JOIN locations b ON a.type = 'origin' AND b.type = 'destination' """, -)
    SQLite.Query{false}(SQLite.Stmt(SQLite.DB("/home/runner/work/JuMP.jl/JuMP.jl/docs/build/tutorials/linear/multi.sqlite"), Base.RefValue{Ptr{SQLite.C.sqlite3_stmt}}(Ptr{SQLite.C.sqlite3_stmt} @0x00000000449ef898), Dict{Int64, Any}()), Base.RefValue{Int32}(100), [:origin, :destination], Type[Union{Missing, String}, Union{Missing, String}], Dict(:origin => 1, :destination => 2), Base.RefValue{Int64}(0))

    With a constraint that we cannot send more than 625 units between each pair:

    for r in Tables.rows(od_pairs)
    +)
    SQLite.Query{false}(SQLite.Stmt(SQLite.DB("/home/runner/work/JuMP.jl/JuMP.jl/docs/build/tutorials/linear/multi.sqlite"), Base.RefValue{Ptr{SQLite.C.sqlite3_stmt}}(Ptr{SQLite.C.sqlite3_stmt} @0x0000000050392698), Dict{Int64, Any}()), Base.RefValue{Int32}(100), [:origin, :destination], Type[Union{Missing, String}, Union{Missing, String}], Dict(:origin => 1, :destination => 2), Base.RefValue{Int64}(0))

    With a constraint that we cannot send more than 625 units between each pair:

    for r in Tables.rows(od_pairs)
         @constraint(model, sum(x[r.origin, r.destination, :]) <= 625)
     end

    Solution

    Finally, we can optimize the model:

    optimize!(model)
     Test.@test is_solved_and_feasible(model)
    @@ -139,7 +139,7 @@
       Dual objective value : 2.25700e+05
     
     * Work counters
    -  Solve time (sec)   : 6.32763e-04
    +  Solve time (sec)   : 6.79493e-04
       Simplex iterations : 54
       Barrier iterations : 0
       Node count         : -1
    @@ -170,4 +170,4 @@
     PITT WIN    75   250    .
     PITT STL   400    25   200
     PITT FRE    .    450   100
    -PITT LAF   250   125    .
    +PITT LAF 250 125 . diff --git a/previews/PR3913/tutorials/linear/multi_commodity_network/index.html b/previews/PR3913/tutorials/linear/multi_commodity_network/index.html index a3ba8ff3bb1..45d7f12da7f 100644 --- a/previews/PR3913/tutorials/linear/multi_commodity_network/index.html +++ b/previews/PR3913/tutorials/linear/multi_commodity_network/index.html @@ -87,7 +87,7 @@ Dual objective value : 1.43228e+02 * Work counters - Solve time (sec) : 3.41177e-04 + Solve time (sec) : 3.30210e-04 Simplex iterations : 8 Barrier iterations : 0 Node count : -1 @@ -95,4 +95,4 @@ df_supply.x_supply = value.(df_supply.x_supply);

    and display the optimal solution for flows:

    DataFrames.select(
         filter!(row -> row.x_flow > 0.0, df_shipping),
         [:origin, :destination, :product, :x_flow],
    -)
    9×4 DataFrame
    Roworigindestinationproductx_flow
    StringStringStringFloat64
    1waikatoaucklandmilk10.0
    2waikatowellingtonmilk2.0
    3taurangaaucklandmilk2.0
    4taurangawaikatomilk2.0
    5christchurchaucklandmilk4.0
    6aucklandchristchurchkiwifruit4.0
    7waikatoaucklandkiwifruit20.0
    8waikatowellingtonkiwifruit2.0
    9taurangawaikatokiwifruit22.0
    +)
    9×4 DataFrame
    Roworigindestinationproductx_flow
    StringStringStringFloat64
    1waikatoaucklandmilk10.0
    2waikatowellingtonmilk2.0
    3taurangaaucklandmilk2.0
    4taurangawaikatomilk2.0
    5christchurchaucklandmilk4.0
    6aucklandchristchurchkiwifruit4.0
    7waikatoaucklandkiwifruit20.0
    8waikatowellingtonkiwifruit2.0
    9taurangawaikatokiwifruit22.0
    diff --git a/previews/PR3913/tutorials/linear/multi_objective_examples/index.html b/previews/PR3913/tutorials/linear/multi_objective_examples/index.html index bab55ece98a..9810a718134 100644 --- a/previews/PR3913/tutorials/linear/multi_objective_examples/index.html +++ b/previews/PR3913/tutorials/linear/multi_objective_examples/index.html @@ -29,7 +29,7 @@ Objective bound : [0.00000e+00,-9.00000e+00] * Work counters - Solve time (sec) : 1.15418e-03 + Solve time (sec) : 1.17087e-03
    for i in 1:result_count(model)
         @assert is_solved_and_feasible(model; result = i)
         print(i, ": z = ", round.(Int, objective_value(model; result = i)), " | ")
    @@ -62,7 +62,7 @@
       Objective bound    : [6.00000e+00,7.00000e+00]
     
     * Work counters
    -  Solve time (sec)   : 7.46894e-03
    +  Solve time (sec)   : 9.66597e-03
     
    for i in 1:result_count(model)
         @assert is_solved_and_feasible(model; result = i)
         print(i, ": z = ", round.(Int, objective_value(model; result = i)), " | ")
    @@ -115,7 +115,7 @@
       Objective bound    : [8.00000e+00,4.00000e+00]
     
     * Work counters
    -  Solve time (sec)   : 5.30386e-03
    +  Solve time (sec)   : 5.35893e-03
     
    for i in 1:result_count(model)
         @assert is_solved_and_feasible(model; result = i)
         print(i, ": z = ", round.(Int, objective_value(model; result = i)), " | ")
    @@ -129,4 +129,4 @@
     end
    1: z = [8, 9] | Path: 1->2 2->4 4->6
     2: z = [10, 7] | Path: 1->2 2->5 5->6
     3: z = [11, 5] | Path: 1->2 2->6
    -4: z = [13, 4] | Path: 1->3 3->4 4->6
    +4: z = [13, 4] | Path: 1->3 3->4 4->6 diff --git a/previews/PR3913/tutorials/linear/multi_objective_knapsack/368eaf8b.svg b/previews/PR3913/tutorials/linear/multi_objective_knapsack/0a5f4828.svg similarity index 87% rename from previews/PR3913/tutorials/linear/multi_objective_knapsack/368eaf8b.svg rename to previews/PR3913/tutorials/linear/multi_objective_knapsack/0a5f4828.svg index 9f0956c83ae..d9ce5674d73 100644 --- a/previews/PR3913/tutorials/linear/multi_objective_knapsack/368eaf8b.svg +++ b/previews/PR3913/tutorials/linear/multi_objective_knapsack/0a5f4828.svg @@ -1,53 +1,53 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/multi_objective_knapsack/968541ac.svg b/previews/PR3913/tutorials/linear/multi_objective_knapsack/6b5572c3.svg similarity index 83% rename from previews/PR3913/tutorials/linear/multi_objective_knapsack/968541ac.svg rename to previews/PR3913/tutorials/linear/multi_objective_knapsack/6b5572c3.svg index 624638af8ff..c2496184b67 100644 --- a/previews/PR3913/tutorials/linear/multi_objective_knapsack/968541ac.svg +++ b/previews/PR3913/tutorials/linear/multi_objective_knapsack/6b5572c3.svg @@ -1,55 +1,55 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/multi_objective_knapsack/index.html b/previews/PR3913/tutorials/linear/multi_objective_knapsack/index.html index 964a176b992..ea20f9c8382 100644 --- a/previews/PR3913/tutorials/linear/multi_objective_knapsack/index.html +++ b/previews/PR3913/tutorials/linear/multi_objective_knapsack/index.html @@ -25,7 +25,7 @@ xlabel = "Profit", ylabel = "Desire", legend = false, -)Example block output

    The goal of the bi-objective knapsack problem is to choose a subset which maximizes both objectives.

    JuMP formulation

    Our JuMP formulation is a direct translation of the mathematical formulation:

    model = Model()
    +)
    Example block output

    The goal of the bi-objective knapsack problem is to choose a subset which maximizes both objectives.

    JuMP formulation

    Our JuMP formulation is a direct translation of the mathematical formulation:

    model = Model()
     @variable(model, x[1:N], Bin)
     @constraint(model, sum(weight[i] * x[i] for i in 1:N) <= capacity)
     @expression(model, profit_expr, sum(profit[i] * x[i] for i in 1:N))
    @@ -50,7 +50,7 @@
       Objective bound    : [9.55000e+02,9.83000e+02]
     
     * Work counters
    -  Solve time (sec)   : 9.68990e-02
    +  Solve time (sec)   : 9.57360e-02
     

    There are 9 solutions available. We can also use result_count to see how many solutions are available:

    result_count(model)
    9

    Accessing multiple solutions

    Access the nine different solutions in the model using the result keyword to solution_summary, value, and objective_value:

    solution_summary(model; result = 5)
    * Solver : MOA[algorithm=MultiObjectiveAlgorithms.EpsilonConstraint, optimizer=HiGHS]
     
     * Status
    @@ -77,7 +77,7 @@
         Plots.annotate!(y[1] - 1, y[2], (i, 10))
     end
     ideal_point = objective_bound(model)
    -Plots.scatter!([ideal_point[1]], [ideal_point[2]]; label = "Ideal point")
    Example block output

    Visualizing the objective space lets the decision maker choose a solution that suits their personal preferences. For example, result #7 is close to the maximum value of profit, but offers significantly higher desirability compared with solutions #8 and #9.

    The set of items that are chosen in solution #7 are:

    items_chosen = [i for i in 1:N if value(x[i]; result = 7) > 0.9]
    11-element Vector{Int64}:
    +Plots.scatter!([ideal_point[1]], [ideal_point[2]]; label = "Ideal point")
    Example block output

    Visualizing the objective space lets the decision maker choose a solution that suits their personal preferences. For example, result #7 is close to the maximum value of profit, but offers significantly higher desirability compared with solutions #8 and #9.

    The set of items that are chosen in solution #7 are:

    items_chosen = [i for i in 1:N if value(x[i]; result = 7) > 0.9]
    11-element Vector{Int64}:
       1
       2
       3
    @@ -88,4 +88,4 @@
      11
      15
      16
    - 17

    Next steps

    MultiObjectiveAlgorithms.jl implements a number of different algorithms. Try solving the same problem using MOA.Dichotomy(). Does it find the same solution?

    + 17

    Next steps

    MultiObjectiveAlgorithms.jl implements a number of different algorithms. Try solving the same problem using MOA.Dichotomy(). Does it find the same solution?

    diff --git a/previews/PR3913/tutorials/linear/multiple_solutions/index.html b/previews/PR3913/tutorials/linear/multiple_solutions/index.html index a4f250917e2..5015d06d514 100644 --- a/previews/PR3913/tutorials/linear/multiple_solutions/index.html +++ b/previews/PR3913/tutorials/linear/multiple_solutions/index.html @@ -42,7 +42,7 @@ Dual objective value : 0.00000e+00 * Work counters - Solve time (sec) : 4.50652e-02 + Solve time (sec) : 4.48790e-02 Simplex iterations : 1587 Barrier iterations : 0 Node count : 255 @@ -69,7 +69,7 @@ Dual objective value : 0.00000e+00 * Work counters - Solve time (sec) : 3.75886e-01 + Solve time (sec) : 3.73572e-01 Simplex iterations : 19526 Barrier iterations : 0 Node count : 4661 @@ -203,4 +203,4 @@ 3 2 1 6 2 0 4 7 + 1 4 9 5 -= 6 7 5 8

    The result is the full list of feasible solutions. So the answer to "how many such squares are there?" turns out to be 20.

    += 6 7 5 8

    The result is the full list of feasible solutions. So the answer to "how many such squares are there?" turns out to be 20.

    diff --git a/previews/PR3913/tutorials/linear/n-queens/index.html b/previews/PR3913/tutorials/linear/n-queens/index.html index f0cab48b9e7..2a30816d052 100644 --- a/previews/PR3913/tutorials/linear/n-queens/index.html +++ b/previews/PR3913/tutorials/linear/n-queens/index.html @@ -23,4 +23,4 @@ 0 0 0 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 0 0 - 0 1 0 0 0 0 0 0 + 0 1 0 0 0 0 0 0 diff --git a/previews/PR3913/tutorials/linear/network_flows/index.html b/previews/PR3913/tutorials/linear/network_flows/index.html index 8903cd92162..37dbd05d961 100644 --- a/previews/PR3913/tutorials/linear/network_flows/index.html +++ b/previews/PR3913/tutorials/linear/network_flows/index.html @@ -91,4 +91,4 @@ 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 - 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 + 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/8d34fc47.svg b/previews/PR3913/tutorials/linear/piecewise_linear/08cb723e.svg similarity index 82% rename from previews/PR3913/tutorials/linear/piecewise_linear/8d34fc47.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/08cb723e.svg index d29ea988f0f..41aefacde2d 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/8d34fc47.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/08cb723e.svg @@ -1,61 +1,61 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/a3410f05.svg b/previews/PR3913/tutorials/linear/piecewise_linear/145efc97.svg similarity index 81% rename from previews/PR3913/tutorials/linear/piecewise_linear/a3410f05.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/145efc97.svg index 0712b09551c..a555b5c7533 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/a3410f05.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/145efc97.svg @@ -1,45 +1,45 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/1fbfad87.svg b/previews/PR3913/tutorials/linear/piecewise_linear/229e7e85.svg similarity index 84% rename from previews/PR3913/tutorials/linear/piecewise_linear/1fbfad87.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/229e7e85.svg index 1bfdcd5fb0e..a72c37d8cb3 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/1fbfad87.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/229e7e85.svg @@ -1,65 +1,65 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/e1f6800a.svg b/previews/PR3913/tutorials/linear/piecewise_linear/2a133e6b.svg similarity index 78% rename from previews/PR3913/tutorials/linear/piecewise_linear/e1f6800a.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/2a133e6b.svg index ad48e227be9..21273cb6d59 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/e1f6800a.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/2a133e6b.svg @@ -1,60 +1,60 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/3c371474.svg b/previews/PR3913/tutorials/linear/piecewise_linear/3f4cab50.svg similarity index 85% rename from previews/PR3913/tutorials/linear/piecewise_linear/3c371474.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/3f4cab50.svg index a290a36ef84..a23d671ebc1 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/3c371474.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/3f4cab50.svg @@ -1,46 +1,46 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/43f926ad.svg b/previews/PR3913/tutorials/linear/piecewise_linear/44d93585.svg similarity index 85% rename from previews/PR3913/tutorials/linear/piecewise_linear/43f926ad.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/44d93585.svg index 85cbefa274f..4da59fdcd16 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/43f926ad.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/44d93585.svg @@ -1,44 +1,44 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/d214f116.svg b/previews/PR3913/tutorials/linear/piecewise_linear/5e266235.svg similarity index 82% rename from previews/PR3913/tutorials/linear/piecewise_linear/d214f116.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/5e266235.svg index 5181d93e6ca..5c767698dd8 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/d214f116.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/5e266235.svg @@ -1,48 +1,48 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/44499cb8.svg b/previews/PR3913/tutorials/linear/piecewise_linear/78fddfac.svg similarity index 94% rename from previews/PR3913/tutorials/linear/piecewise_linear/44499cb8.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/78fddfac.svg index 145bfbe16c4..53add4f2a7c 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/44499cb8.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/78fddfac.svg @@ -1,48 +1,48 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/59d6ab76.svg b/previews/PR3913/tutorials/linear/piecewise_linear/ad9e1c1c.svg similarity index 92% rename from previews/PR3913/tutorials/linear/piecewise_linear/59d6ab76.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/ad9e1c1c.svg index 4b913e89dba..c02aa9c67ed 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/59d6ab76.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/ad9e1c1c.svg @@ -1,63 +1,63 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/5eb21fdb.svg b/previews/PR3913/tutorials/linear/piecewise_linear/b273285d.svg similarity index 86% rename from previews/PR3913/tutorials/linear/piecewise_linear/5eb21fdb.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/b273285d.svg index 9c2ff26d30b..dde7bb2507b 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/5eb21fdb.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/b273285d.svg @@ -1,50 +1,50 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/fb2f660c.svg b/previews/PR3913/tutorials/linear/piecewise_linear/e83becbc.svg similarity index 80% rename from previews/PR3913/tutorials/linear/piecewise_linear/fb2f660c.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/e83becbc.svg index 84a3dd6ed28..7c0aff2a5c8 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/fb2f660c.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/e83becbc.svg @@ -1,63 +1,63 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/83f88874.svg b/previews/PR3913/tutorials/linear/piecewise_linear/fe59417d.svg similarity index 86% rename from previews/PR3913/tutorials/linear/piecewise_linear/83f88874.svg rename to previews/PR3913/tutorials/linear/piecewise_linear/fe59417d.svg index 4bce39be3b0..04970b4f306 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/83f88874.svg +++ b/previews/PR3913/tutorials/linear/piecewise_linear/fe59417d.svg @@ -1,43 +1,43 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/linear/piecewise_linear/index.html b/previews/PR3913/tutorials/linear/piecewise_linear/index.html index 65ded599cec..eb011db3fa5 100644 --- a/previews/PR3913/tutorials/linear/piecewise_linear/index.html +++ b/previews/PR3913/tutorials/linear/piecewise_linear/index.html @@ -7,11 +7,11 @@ import HiGHS import Plots

    Minimizing a convex function (outer approximation)

    If the function you are approximating is convex, and you want to minimize "down" onto it, then you can use an outer approximation.

    For example, $f(x) = x^2$ is a convex function:

    f(x) = x^2
     ∇f(x) = 2 * x
    -plot = Plots.plot(f, -2:0.01:2; ylims = (-0.5, 4), label = false, width = 3)
    Example block output

    Because $f$ is convex, we know that for any $x_k$, we have: $f(x) \ge f(x_k) + \nabla f(x_k) \cdot (x - x_k)$

    for x_k in -2:1:2  ## Tip: try changing the number of points x_k
    +plot = Plots.plot(f, -2:0.01:2; ylims = (-0.5, 4), label = false, width = 3)
    Example block output

    Because $f$ is convex, we know that for any $x_k$, we have: $f(x) \ge f(x_k) + \nabla f(x_k) \cdot (x - x_k)$

    for x_k in -2:1:2  ## Tip: try changing the number of points x_k
         g = x -> f(x_k) + ∇f(x_k) * (x - x_k)
         Plots.plot!(plot, g, -2:0.01:2; color = :red, label = false, width = 3)
     end
    -plot
    Example block output

    We can use these tangent planes as constraints in our model to create an outer approximation of the function. As we add more planes, the error between the true function and the piecewise linear outer approximation decreases.

    Here is the model in JuMP:

    function outer_approximate_x_squared(x̄)
    +plot
    Example block output

    We can use these tangent planes as constraints in our model to create an outer approximation of the function. As we add more planes, the error between the true function and the piecewise linear outer approximation decreases.

    Here is the model in JuMP:

    function outer_approximate_x_squared(x̄)
         f(x) = x^2
         ∇f(x) = 2x
         model = Model(HiGHS.Optimizer)
    @@ -29,7 +29,7 @@
         ȳ = outer_approximate_x_squared(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output
    Note

    This formulation does not work if we want to maximize y.

    Maximizing a concave function (outer approximation)

    The outer approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
    +plot
    Example block output
    Note

    This formulation does not work if we want to maximize y.

    Maximizing a concave function (outer approximation)

    The outer approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
     ∇f(x) = 1 / x
     X = 0.1:0.1:1.6
     plot = Plots.plot(
    @@ -44,7 +44,7 @@
         g = x -> f(x_k) + ∇f(x_k) * (x - x_k)
         Plots.plot!(plot, g, X; color = :red, label = false, width = 3)
     end
    -plot
    Example block output

    Here is the model in JuMP:

    function outer_approximate_log(x̄)
    +plot
    Example block output

    Here is the model in JuMP:

    function outer_approximate_log(x̄)
         f(x) = log(x)
         ∇f(x) = 1 / x
         model = Model(HiGHS.Optimizer)
    @@ -62,18 +62,18 @@
         ȳ = outer_approximate_log(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output
    Note

    This formulation does not work if we want to minimize y.

    Minimizing a convex function (inner approximation)

    Instead of creating an outer approximation, we can also create an inner approximation. For example, given $f(x) = x^2$, we may want to approximate the true function by the red piecewise linear function:

    f(x) = x^2
    +plot
    Example block output
    Note

    This formulation does not work if we want to minimize y.

    Minimizing a convex function (inner approximation)

    Instead of creating an outer approximation, we can also create an inner approximation. For example, given $f(x) = x^2$, we may want to approximate the true function by the red piecewise linear function:

    f(x) = x^2
     x̂ = -2:0.8:2  ## Tip: try changing the number of points in x̂
     plot = Plots.plot(f, -2:0.01:2; ylims = (-0.5, 4), label = false, linewidth = 3)
     Plots.plot!(plot, f, x̂; label = false, color = :red, linewidth = 3)
    -plot
    Example block output

    To do so, we represent the decision variables $(x, y)$ by the convex combination of a set of discrete points $\{x_k, y_k\}_{k=1}^K$:

    \[\begin{aligned} +plotExample block output

    To do so, we represent the decision variables $(x, y)$ by the convex combination of a set of discrete points $\{x_k, y_k\}_{k=1}^K$:

    \[\begin{aligned} x = \sum\limits_{k=1}^K \lambda_k x_k \\ y = \sum\limits_{k=1}^K \lambda_k y_k \\ \sum\limits_{k=1}^K \lambda_k = 1 \\ \lambda_k \ge 0, k=1,\ldots,k \\ \end{aligned}\]

    The feasible region of the convex combination actually allows any $(x, y)$ point inside this shaded region:

    I = [1, 2, 3, 4, 5, 6, 1]
     Plots.plot!(x̂[I], f.(x̂[I]); fill = (0, 0, "#f004"), width = 0, label = false)
    -plot
    Example block output

    Thus, this formulation does not work if we want to maximize $y$.

    Here is the model in JuMP:

    function inner_approximate_x_squared(x̄)
    +plot
    Example block output

    Thus, this formulation does not work if we want to maximize $y$.

    Here is the model in JuMP:

    function inner_approximate_x_squared(x̄)
         f(x) = x^2
         ∇f(x) = 2x
         x̂ = -2:0.8:2  ## Tip: try changing the number of points in x̂
    @@ -96,13 +96,13 @@
         ȳ = inner_approximate_x_squared(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output

    Maximizing a convex function (inner approximation)

    The inner approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
    +plot
    Example block output

    Maximizing a convex function (inner approximation)

    The inner approximation also works if we want to maximize "up" into a concave function.

    f(x) = log(x)
     x̂ = 0.1:0.5:1.6  ## Tip: try changing the number of points in x̂
     plot = Plots.plot(f, 0.1:0.01:1.6; label = false, linewidth = 3)
     Plots.plot!(x̂, f.(x̂); linewidth = 3, color = :red, label = false)
     I = [1, 2, 3, 4, 1]
     Plots.plot!(x̂[I], f.(x̂[I]); fill = (0, 0, "#f004"), width = 0, label = false)
    -plot
    Example block output

    Here is the model in JuMP:

    function inner_approximate_log(x̄)
    +plot
    Example block output

    Here is the model in JuMP:

    function inner_approximate_log(x̄)
         f(x) = log(x)
         x̂ = 0.1:0.5:1.6  ## Tip: try changing the number of points in x̂
         ŷ = f.(x̂)
    @@ -124,13 +124,13 @@
         ȳ = inner_approximate_log(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output

    Piecewise linear approximation

    If the model is non-convex (or non-concave), then we cannot use an outer approximation, and the inner approximation allows a solution far from the true function. For example, for $f(x) = sin(x)$, we have:

    f(x) = sin(x)
    +plot
    Example block output

    Piecewise linear approximation

    If the model is non-convex (or non-concave), then we cannot use an outer approximation, and the inner approximation allows a solution far from the true function. For example, for $f(x) = sin(x)$, we have:

    f(x) = sin(x)
     plot = Plots.plot(f, 0:0.01:2π; label = false)
     x̂ = range(; start = 0, stop = 2π, length = 7)
     Plots.plot!(x̂, f.(x̂); linewidth = 3, color = :red, label = false)
     I = [1, 5, 6, 7, 3, 2, 1]
     Plots.plot!(x̂[I], f.(x̂[I]); fill = (0, 0, "#f004"), width = 0, label = false)
    -plot
    Example block output

    We can force the inner approximation to stay on the red line by adding the constraint λ in SOS2(). The SOS2 set is a Special Ordered Set of Type 2, and it ensures that at most two elements of λ can be non-zero, and if they are, that they must be adjacent. This prevents the model from taking a convex combination of points 1 and 5 to end up on the lower boundary of the shaded red area.

    Here is the model in JuMP:

    function piecewise_linear_sin(x̄)
    +plot
    Example block output

    We can force the inner approximation to stay on the red line by adding the constraint λ in SOS2(). The SOS2 set is a Special Ordered Set of Type 2, and it ensures that at most two elements of λ can be non-zero, and if they are, that they must be adjacent. This prevents the model from taking a convex combination of points 1 and 5 to end up on the lower boundary of the shaded red area.

    Here is the model in JuMP:

    function piecewise_linear_sin(x̄)
         f(x) = sin(x)
         # Tip: try changing the number of points in x̂
         x̂ = range(; start = 0, stop = 2π, length = 7)
    @@ -155,4 +155,4 @@
         ȳ = piecewise_linear_sin(x̄)
         Plots.scatter!(plot, [x̄], [ȳ]; label = false, color = :black)
     end
    -plot
    Example block output +plotExample block output diff --git a/previews/PR3913/tutorials/linear/sudoku/index.html b/previews/PR3913/tutorials/linear/sudoku/index.html index 4a8c2c9cd71..102be4f5dbe 100644 --- a/previews/PR3913/tutorials/linear/sudoku/index.html +++ b/previews/PR3913/tutorials/linear/sudoku/index.html @@ -93,4 +93,4 @@ 7 1 3 9 2 4 8 5 6 9 6 1 5 3 7 2 8 4 2 8 7 4 1 9 6 3 5 - 3 4 5 2 8 6 1 7 9

    Which is the same as we found before:

    sol == csp_sol
    true
    + 3 4 5 2 8 6 1 7 9

    Which is the same as we found before:

    sol == csp_sol
    true
    diff --git a/previews/PR3913/tutorials/linear/tips_and_tricks/index.html b/previews/PR3913/tutorials/linear/tips_and_tricks/index.html index 36ecb4f27dc..2671682caf2 100644 --- a/previews/PR3913/tutorials/linear/tips_and_tricks/index.html +++ b/previews/PR3913/tutorials/linear/tips_and_tricks/index.html @@ -70,4 +70,4 @@ y == sum(ŷ[i] * λ[i] for i in 1:N) sum(λ) == 1 λ in SOS2() - end)(x + λ[1] + 0.5 λ[2] - 0.5 λ[4] - λ[5] - 1.5 λ[6] - 2 λ[7] = 0, y - λ[1] - 0.25 λ[2] - 0.25 λ[4] - λ[5] - 2.25 λ[6] - 4 λ[7] = 0, λ[1] + λ[2] + λ[3] + λ[4] + λ[5] + λ[6] + λ[7] = 1, [λ[1], λ[2], λ[3], λ[4], λ[5], λ[6], λ[7]] ∈ MathOptInterface.SOS2{Float64}([1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0])) + end)(x + λ[1] + 0.5 λ[2] - 0.5 λ[4] - λ[5] - 1.5 λ[6] - 2 λ[7] = 0, y - λ[1] - 0.25 λ[2] - 0.25 λ[4] - λ[5] - 2.25 λ[6] - 4 λ[7] = 0, λ[1] + λ[2] + λ[3] + λ[4] + λ[5] + λ[6] + λ[7] = 1, [λ[1], λ[2], λ[3], λ[4], λ[5], λ[6], λ[7]] ∈ MathOptInterface.SOS2{Float64}([1.0, 2.0, 3.0, 4.0, 5.0, 6.0, 7.0])) diff --git a/previews/PR3913/tutorials/linear/transp/index.html b/previews/PR3913/tutorials/linear/transp/index.html index 48b7bad4882..a9aeb4d4bb5 100644 --- a/previews/PR3913/tutorials/linear/transp/index.html +++ b/previews/PR3913/tutorials/linear/transp/index.html @@ -74,4 +74,4 @@ end
    solve_transportation_problem (generic function with 1 method)

    Solution

    Let's solve and view the solution:

    solve_transportation_problem(data)
            FRA    DET    LAN    WIN    STL    FRE    LAF
     GARY      .      .      .      .  300.0 1100.0      .
     CLEV      .      .  600.0      . 1000.0      . 1000.0
    -PITT  900.0 1200.0      .  400.0  400.0      .      .
    +PITT 900.0 1200.0 . 400.0 400.0 . . diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/5248406a.svg b/previews/PR3913/tutorials/nonlinear/classifiers/1713b0a7.svg similarity index 62% rename from previews/PR3913/tutorials/nonlinear/classifiers/5248406a.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/1713b0a7.svg index 38530d897e9..fcd7dc47ab9 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/5248406a.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/1713b0a7.svg @@ -1,543 +1,543 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/94ba83d3.svg b/previews/PR3913/tutorials/nonlinear/classifiers/545de146.svg similarity index 72% rename from previews/PR3913/tutorials/nonlinear/classifiers/94ba83d3.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/545de146.svg index da5c5bd358a..d8a37afe479 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/94ba83d3.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/545de146.svg @@ -1,142 +1,142 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/0909b61c.svg b/previews/PR3913/tutorials/nonlinear/classifiers/64f2376e.svg similarity index 63% rename from previews/PR3913/tutorials/nonlinear/classifiers/0909b61c.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/64f2376e.svg index 7432ccdbf94..6ac45df8807 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/0909b61c.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/64f2376e.svg @@ -1,551 +1,551 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/4192623d.svg b/previews/PR3913/tutorials/nonlinear/classifiers/73490faa.svg similarity index 73% rename from previews/PR3913/tutorials/nonlinear/classifiers/4192623d.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/73490faa.svg index e4ae8c1acd2..f3aab74d2b6 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/4192623d.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/73490faa.svg @@ -1,143 +1,143 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/a4133707.svg b/previews/PR3913/tutorials/nonlinear/classifiers/9da9adbb.svg similarity index 62% rename from previews/PR3913/tutorials/nonlinear/classifiers/a4133707.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/9da9adbb.svg index 9bef6967549..39350ca8473 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/a4133707.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/9da9adbb.svg @@ -1,544 +1,544 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/3a0abafd.svg b/previews/PR3913/tutorials/nonlinear/classifiers/bdfd0cfd.svg similarity index 69% rename from previews/PR3913/tutorials/nonlinear/classifiers/3a0abafd.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/bdfd0cfd.svg index 419de666932..3b4e324bbae 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/3a0abafd.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/bdfd0cfd.svg @@ -1,20913 +1,20913 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/c2104be5.svg b/previews/PR3913/tutorials/nonlinear/classifiers/d7ca7dbf.svg similarity index 62% rename from previews/PR3913/tutorials/nonlinear/classifiers/c2104be5.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/d7ca7dbf.svg index d6ae611fea3..c52c96b4adb 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/c2104be5.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/d7ca7dbf.svg @@ -1,550 +1,550 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/d02cbec6.svg b/previews/PR3913/tutorials/nonlinear/classifiers/f0d80e24.svg similarity index 61% rename from previews/PR3913/tutorials/nonlinear/classifiers/d02cbec6.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/f0d80e24.svg index 68bccb56c20..e57d5a9ee2c 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/d02cbec6.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/f0d80e24.svg @@ -1,1042 +1,1042 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/b2535aea.svg b/previews/PR3913/tutorials/nonlinear/classifiers/f9aff325.svg similarity index 62% rename from previews/PR3913/tutorials/nonlinear/classifiers/b2535aea.svg rename to previews/PR3913/tutorials/nonlinear/classifiers/f9aff325.svg index cd50aa4542e..0b0984da4ed 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/b2535aea.svg +++ b/previews/PR3913/tutorials/nonlinear/classifiers/f9aff325.svg @@ -1,543 +1,543 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/classifiers/index.html b/previews/PR3913/tutorials/nonlinear/classifiers/index.html index c285c3c1f2b..5e15a75a383 100644 --- a/previews/PR3913/tutorials/nonlinear/classifiers/index.html +++ b/previews/PR3913/tutorials/nonlinear/classifiers/index.html @@ -20,9 +20,9 @@ color = :white, size = (600, 600), legend = false, -)Example block output

    We want to split the points into two distinct sets on either side of a dividing line. We'll then label each point depending on which side of the line it happens to fall. Based on the labels of the point, we'll show how to create a classifier using a JuMP model. We can then test how well our classifier reproduces the original labels and the boundary between them.

    Let's make a line to divide the points into two sets by defining a gradient and a constant:

    w_0, g_0 = [5, 3], 8
    +)
    Example block output

    We want to split the points into two distinct sets on either side of a dividing line. We'll then label each point depending on which side of the line it happens to fall. Based on the labels of the point, we'll show how to create a classifier using a JuMP model. We can then test how well our classifier reproduces the original labels and the boundary between them.

    Let's make a line to divide the points into two sets by defining a gradient and a constant:

    w_0, g_0 = [5, 3], 8
     line(v::AbstractArray; w = w_0, g = g_0) = w' * v - g
    -line(x::Real; w = w_0, g = g_0) = -(w[1] * x - g) / w[2];

    Julia's multiple dispatch feature allows us to define the vector and single-variable form of the line function under the same name.

    Let's add this to the plot:

    Plots.plot!(plot, line; linewidth = 5)
    Example block output

    Now we label the points relative to which side of the line they are. It is numerically useful to have the labels +1 and -1 for the upcoming JuMP formulation.

    labels = ifelse.(line.(eachrow(P)) .>= 0, 1, -1)
    +line(x::Real; w = w_0, g = g_0) = -(w[1] * x - g) / w[2];

    Julia's multiple dispatch feature allows us to define the vector and single-variable form of the line function under the same name.

    Let's add this to the plot:

    Plots.plot!(plot, line; linewidth = 5)
    Example block output

    Now we label the points relative to which side of the line they are. It is numerically useful to have the labels +1 and -1 for the upcoming JuMP formulation.

    labels = ifelse.(line.(eachrow(P)) .>= 0, 1, -1)
     Plots.scatter!(
         plot,
         P[:, 1],
    @@ -30,7 +30,7 @@
         shape = ifelse.(labels .== 1, :cross, :xcross),
         markercolor = ifelse.(labels .== 1, :blue, :crimson),
         markersize = 8,
    -)
    Example block output

    Our goal is to show we can reconstruct the line from just the points and the labels.

    Formulation: linear support vector machine

    A classifier known as the linear support vector machine (SVM) looks for the affine function $L(p) = w^\top p - g$ that satisfies $L(p) < 0$ for all points $p$ with a label -1 and $L(p) \ge 0$ for all points $p$ with a label +1.

    The linearly constrained quadratic program that implements this is:

    \[\begin{aligned} +)Example block output

    Our goal is to show we can reconstruct the line from just the points and the labels.

    Formulation: linear support vector machine

    A classifier known as the linear support vector machine (SVM) looks for the affine function $L(p) = w^\top p - g$ that satisfies $L(p) < 0$ for all points $p$ with a label -1 and $L(p) \ge 0$ for all points $p$ with a label +1.

    The linearly constrained quadratic program that implements this is:

    \[\begin{aligned} \min_{w \in \mathbb{R}^n, \; g \in \mathbb{R}, \; y \in \mathbb{R}^m} \quad & \frac{1}{2} w^\top w + C \; \sum_{i=1}^m y_i \\ \text{subject to } \quad & D \cdot (P w - g) + y \geq \mathbf{1} \\ & y \ge 0. @@ -59,7 +59,7 @@ │ ├ AffExpr in MOI.GreaterThan{Float64}: 100 │ └ VariableRef in MOI.GreaterThan{Float64}: 100 └ Names registered in the model - └ :g, :w, :y, Main.classifier)

    With the solution, we can ask: was the value of the penalty constant "sufficiently large" for this data set? This can be judged in part by the range of the slack variables. If the slack is too large, then we need to increase the penalty constant.

    Let's plot the solution and check how we did:

    Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    We find that we have recovered the dividing line from just the information of the points and their labels.

    Nonseparable classes of points

    Now, what if the point sets are not cleanly separable by a line (or a hyperplane in higher dimensions)? Does this still work? Let's repeat the process, but this time we will simulate nonseparable classes of points by intermingling a few nearby points across the previously used line.

    nearby_indices = abs.(line.(eachrow(P))) .< 1.1
    +  └ :g, :w, :y, Main.classifier)

    With the solution, we can ask: was the value of the penalty constant "sufficiently large" for this data set? This can be judged in part by the range of the slack variables. If the slack is too large, then we need to increase the penalty constant.

    Let's plot the solution and check how we did:

    Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    We find that we have recovered the dividing line from just the information of the points and their labels.

    Nonseparable classes of points

    Now, what if the point sets are not cleanly separable by a line (or a hyperplane in higher dimensions)? Does this still work? Let's repeat the process, but this time we will simulate nonseparable classes of points by intermingling a few nearby points across the previously used line.

    nearby_indices = abs.(line.(eachrow(P))) .< 1.1
     labels_new = ifelse.(nearby_indices, -labels, labels)
     model, classifier = solve_SVM_classifier(P, labels_new)
     plot = Plots.scatter(
    @@ -79,7 +79,7 @@
         markercolor = ifelse.(labels_new .== 1, :blue, :crimson),
         markersize = 8,
     )
    -Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    So our JuMP formulation still produces a classifier, but it mis-classifies some of the nonseparable points.

    We can find out which points are contributing to the shape of the line by looking at the dual values of the affine constraints and comparing them to the penalty constant $C$:

    affine_cons = all_constraints(model, AffExpr, MOI.GreaterThan{Float64})
    +Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dashdotdot)
    Example block output

    So our JuMP formulation still produces a classifier, but it mis-classifies some of the nonseparable points.

    We can find out which points are contributing to the shape of the line by looking at the dual values of the affine constraints and comparing them to the penalty constant $C$:

    affine_cons = all_constraints(model, AffExpr, MOI.GreaterThan{Float64})
     active_cons = findall(isapprox.(dual.(affine_cons), C_0; atol = 0.001))
     findall(nearby_indices) ⊆ active_cons
    true

    The last statement tells us that our nonseparable points are actively contributing to how the classifier is defined. The remaining points are of interest and are highlighted:

    P_active = P[setdiff(active_cons, findall(nearby_indices)), :]
     Plots.scatter!(
    @@ -89,7 +89,7 @@
         shape = :hexagon,
         markersize = 8,
         markeropacity = 0.5,
    -)
    Example block output

    Advanced: duality and the kernel method

    We now consider an alternative formulation for a linear SVM by solving the dual problem.

    The dual program

    The dual of the linear SVM program is also a linearly constrained quadratic program:

    \[\begin{aligned} +)Example block output

    Advanced: duality and the kernel method

    We now consider an alternative formulation for a linear SVM by solving the dual problem.

    The dual program

    The dual of the linear SVM program is also a linearly constrained quadratic program:

    \[\begin{aligned} \min_{u \in \mathbb{R}^m} \quad & \frac{1}{2} u^\top D P P^\top D u - \; \mathbf{1}^\top u \\ \text{subject to } \quad & \mathbf{1}^\top D u = 0 \\ & 0 \leq u \leq C\mathbf{1}. @@ -108,7 +108,7 @@ classifier(x) = line(x; w = w, g = g) return classifier end

    solve_dual_SVM_classifier (generic function with 1 method)

    We recover the line gradient vector $w$ through setting $w = P^\top D u$, and the line constant $g$ as the dual value of the single affine constraint.

    The dual problem has fewer variables and fewer constraints, so in many cases it may be simpler to solve the dual form.

    We can check that the dual form has recovered a classifier:

    classifier = solve_dual_SVM_classifier(P, labels)
    -Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dash)
    Example block output

    The kernel method

    Linear SVM techniques are not limited to finding separating hyperplanes in the original space of the dataset. One could first transform the training data under a nonlinear mapping, apply our method, then map the hyperplane back into original space.

    The actual data describing the point set is held in a matrix $P$, but looking at the dual program we see that what actually matters is the Gram matrix $P P^\top$, expressing a pairwise comparison (an inner-product) between each point vector. It follows that any mapping of the point set only needs to be defined at the level of pairwise maps between points. Such maps are known as kernel functions:

    \[k \; : \; \mathbb{R}^n \times \mathbb{R}^n \; \rightarrow \mathbb{R}, \qquad +Plots.plot!(plot, classifier; linewidth = 5, linestyle = :dash)Example block output

    The kernel method

    Linear SVM techniques are not limited to finding separating hyperplanes in the original space of the dataset. One could first transform the training data under a nonlinear mapping, apply our method, then map the hyperplane back into original space.

    The actual data describing the point set is held in a matrix $P$, but looking at the dual program we see that what actually matters is the Gram matrix $P P^\top$, expressing a pairwise comparison (an inner-product) between each point vector. It follows that any mapping of the point set only needs to be defined at the level of pairwise maps between points. Such maps are known as kernel functions:

    \[k \; : \; \mathbb{R}^n \times \mathbb{R}^n \; \rightarrow \mathbb{R}, \qquad (s, t) \mapsto \left< \Phi(s), \Phi(t) \right>\]

    where the right-hand side applies some transformation $\Phi : \mathbb{R}^n \rightarrow \mathbb{R}^{n'}$ followed by an inner-product in that image space.

    In practice, we can avoid having $\Phi$ explicitly given but instead define a kernel function directly between pairs of vectors. This change to using a kernel function without knowing the map is called the kernel method (or sometimes, the kernel trick).

    Classifier using a Gaussian kernel

    We will demonstrate the application of a Gaussian or radial basis function kernel:

    \[k(s, t) = \exp\left( -\mu \lVert s - t \rVert^2_2 \right)\]

    for some positive parameter $\mu$.

    k_gauss(s::Vector, t::Vector; μ = 0.5) = exp(-μ * LinearAlgebra.norm(s - t)^2)
    k_gauss (generic function with 1 method)

    Given a matrix of points expressed row-wise and a kernel, the next function returns the transformed matrix $K$ that replaces $P P^\top$:

    function pairwise_transform(kernel::Function, P::Matrix{T}) where {T}
         m, n = size(P)
         K = zeros(T, m, m)
    @@ -151,7 +151,7 @@
         markersize = ifelse.(labels .== 1, 4, 2),
         size = (600, 600),
         legend = false,
    -)
    Example block output

    Is the technique capable of generating a distinctly nonlinear surface? Let's solve the Gaussian kernel based quadratic problem with these parameters:

    classifier = solve_kernel_SVM_classifier(k_gauss, B, labels; C = 1e5, μ = 10.0)
    +)
    Example block output

    Is the technique capable of generating a distinctly nonlinear surface? Let's solve the Gaussian kernel based quadratic problem with these parameters:

    classifier = solve_kernel_SVM_classifier(k_gauss, B, labels; C = 1e5, μ = 10.0)
     grid = [[x, y] for x in 0:0.01:2, y in 0:0.01:2]
     grid_pos = [Tuple(g) for g in grid if classifier(g) >= 0]
    -Plots.scatter!(plot, grid_pos; markersize = 0.2)
    Example block output

    We find that the kernel method can perform well as a nonlinear classifier.

    The result has a fairly strong dependence on the choice of parameters, with larger values of $\mu$ allowing for a more complex boundary while smaller values lead to a smoother boundary for the classifier. Determining a better performing kernel function and choice of parameters is covered by the process of cross-validation with respect to the dataset, where different testing, training and tuning sets are used to validate the best choice of parameters against a statistical measure of error.

    +Plots.scatter!(plot, grid_pos; markersize = 0.2)Example block output

    We find that the kernel method can perform well as a nonlinear classifier.

    The result has a fairly strong dependence on the choice of parameters, with larger values of $\mu$ allowing for a more complex boundary while smaller values lead to a smoother boundary for the classifier. Determining a better performing kernel function and choice of parameters is covered by the process of cross-validation with respect to the dataset, where different testing, training and tuning sets are used to validate the best choice of parameters against a statistical measure of error.

    diff --git a/previews/PR3913/tutorials/nonlinear/complementarity/index.html b/previews/PR3913/tutorials/nonlinear/complementarity/index.html index de2494eff18..ea55322633d 100644 --- a/previews/PR3913/tutorials/nonlinear/complementarity/index.html +++ b/previews/PR3913/tutorials/nonlinear/complementarity/index.html @@ -131,7 +131,7 @@ Objective value : 0.00000e+00 * Work counters - Solve time (sec) : 1.42000e-04 + Solve time (sec) : 1.38000e-04

    An equilibrium solution is to build 389 MW:

    value(x)
    389.31506849315065

    The production in each scenario is:

    value.(Q)
    5-element Vector{Float64}:
      240.0000000000001
      289.9999999999999
    @@ -142,4 +142,4 @@
       60.0
       59.99999999999994
       60.68493150684928
    - 110.68493150684935
    + 110.68493150684935 diff --git a/previews/PR3913/tutorials/nonlinear/introduction/index.html b/previews/PR3913/tutorials/nonlinear/introduction/index.html index 9986bd6325d..f54cdc32d2f 100644 --- a/previews/PR3913/tutorials/nonlinear/introduction/index.html +++ b/previews/PR3913/tutorials/nonlinear/introduction/index.html @@ -7,4 +7,4 @@ \min_{x \in \mathbb{R}^n} & f_0(x) \\ \;\;\text{s.t.} & l_j \le f_j(x) \le u_j & j = 1 \ldots m \\ & l_i \le x_i \le u_i & i = 1 \ldots n. -\end{align}\]

    Mixed-integer nonlinear linear programs (MINLPs) are extensions of nonlinear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of nonlinear solvers; look for "NLP" in the list of Supported solvers. However, very few solvers support mixed-integer nonlinear linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    If the only nonlinearities in your model are quadratic terms (that is, multiplication between two decision variables), you can also use second-order cone solvers, which are indicated by "SOCP." In most cases, these solvers are restricted to convex quadratic problems and will error if you pass a nonconvex quadratic function; however, Gurobi has the ability to solve nonconvex quadratic terms.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    +\end{align}\]

    Mixed-integer nonlinear linear programs (MINLPs) are extensions of nonlinear programs in which some (or all) of the decision variables take discrete values.

    How to choose a solver

    JuMP supports a range of nonlinear solvers; look for "NLP" in the list of Supported solvers. However, very few solvers support mixed-integer nonlinear linear programs. Solvers supporting discrete variables start with "(MI)" in the list of Supported solvers.

    If the only nonlinearities in your model are quadratic terms (that is, multiplication between two decision variables), you can also use second-order cone solvers, which are indicated by "SOCP." In most cases, these solvers are restricted to convex quadratic problems and will error if you pass a nonconvex quadratic function; however, Gurobi has the ability to solve nonconvex quadratic terms.

    How these tutorials are structured

    Having a high-level overview of how this part of the documentation is structured will help you know where to look for certain things.

    diff --git a/previews/PR3913/tutorials/nonlinear/nested_problems/index.html b/previews/PR3913/tutorials/nonlinear/nested_problems/index.html index 2bec6f6ca53..cd88f0d73a0 100644 --- a/previews/PR3913/tutorials/nonlinear/nested_problems/index.html +++ b/previews/PR3913/tutorials/nonlinear/nested_problems/index.html @@ -64,7 +64,7 @@ Dual objective value : 0.00000e+00 * Work counters - Solve time (sec) : 4.87575e-01 + Solve time (sec) : 4.78782e-01 Barrier iterations : 32

    The optimal objective value is:

    objective_value(model)
    -418983.48680640775

    and the optimal upper-level decision variables $x$ are:

    value.(x)
    2-element Vector{Float64}:
      154.97862337234338
    @@ -127,8 +127,8 @@
       Dual objective value : 0.00000e+00
     
     * Work counters
    -  Solve time (sec)   : 1.90832e-01
    +  Solve time (sec)   : 1.85007e-01
       Barrier iterations : 32
     

    an we can check we get the same objective value:

    objective_value(model)
    -418983.48680640775

    and upper-level decision variable $x$:

    value.(x)
    2-element Vector{Float64}:
      154.97862337234338
    - 180.0096143098799
    + 180.0096143098799 diff --git a/previews/PR3913/tutorials/nonlinear/operator_ad/index.html b/previews/PR3913/tutorials/nonlinear/operator_ad/index.html index bec561e3ae8..8b98116ac69 100644 --- a/previews/PR3913/tutorials/nonlinear/operator_ad/index.html +++ b/previews/PR3913/tutorials/nonlinear/operator_ad/index.html @@ -205,4 +205,4 @@ di_rosenbrock(; backend = DifferentiationInterface.AutoForwardDiff())
    2-element Vector{Float64}:
      0.9999999999999899
    - 0.9999999999999792
    + 0.9999999999999792 diff --git a/previews/PR3913/tutorials/nonlinear/portfolio/fae64cdb.svg b/previews/PR3913/tutorials/nonlinear/portfolio/4709c5c7.svg similarity index 79% rename from previews/PR3913/tutorials/nonlinear/portfolio/fae64cdb.svg rename to previews/PR3913/tutorials/nonlinear/portfolio/4709c5c7.svg index 89fa27d9539..7a26df13511 100644 --- a/previews/PR3913/tutorials/nonlinear/portfolio/fae64cdb.svg +++ b/previews/PR3913/tutorials/nonlinear/portfolio/4709c5c7.svg @@ -1,581 +1,581 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/portfolio/index.html b/previews/PR3913/tutorials/nonlinear/portfolio/index.html index b48165b78b3..49be25ae1ff 100644 --- a/previews/PR3913/tutorials/nonlinear/portfolio/index.html +++ b/previews/PR3913/tutorials/nonlinear/portfolio/index.html @@ -72,7 +72,7 @@ Dual objective value : 4.52688e+04 * Work counters - Solve time (sec) : 3.05986e-03 + Solve time (sec) : 2.97499e-03 Barrier iterations : 11

    The optimal allocation of our assets is:

    value.(x)
    3-element Vector{Float64}:
      497.045529849864
    @@ -103,7 +103,7 @@
       Objective bound    : [5.78303e-09,-7.37159e+01]
     
     * Work counters
    -  Solve time (sec)   : 2.26454e-01
    +  Solve time (sec)   : 2.22103e-01
     

    The algorithm found 50 different solutions. Let's plot them to see how they differ:

    objective_space = Plots.hline(
         [scalar_return];
         label = "Single-objective solution",
    @@ -135,4 +135,4 @@
         ylabel = "Investment (\$)",
         title = "Decision space",
     )
    -Plots.plot(objective_space, decision_space; layout = (2, 1), size = (600, 600))
    Example block output

    Perhaps our trade-off wasn't so bad after all. Our original solution corresponded to picking a solution #17. If we buy more SEHI, we can increase the return, but the variance also increases. If we buy less SEHI, such as a solution like #5 or #6, then we can achieve the corresponding return without deploying all of our capital. We should also note that at no point should we buy WMT.

    +Plots.plot(objective_space, decision_space; layout = (2, 1), size = (600, 600))Example block output

    Perhaps our trade-off wasn't so bad after all. Our original solution corresponded to picking a solution #17. If we buy more SEHI, we can increase the return, but the variance also increases. If we buy less SEHI, such as a solution like #5 or #6, then we can achieve the corresponding return without deploying all of our capital. We should also note that at no point should we buy WMT.

    diff --git a/previews/PR3913/tutorials/nonlinear/querying_hessians/index.html b/previews/PR3913/tutorials/nonlinear/querying_hessians/index.html index 2843d5be48d..033efe21d10 100644 --- a/previews/PR3913/tutorials/nonlinear/querying_hessians/index.html +++ b/previews/PR3913/tutorials/nonlinear/querying_hessians/index.html @@ -168,4 +168,4 @@ 2.82843 2.82843

    Compare that to the analytic solution:

    y = value.(x)
     [2y[1] 0; 2y[1]+2y[2] 2y[1]+2y[2]]
    2×2 Matrix{Float64}:
      1.58072  0.0
    - 2.82843  2.82843
    + 2.82843 2.82843 diff --git a/previews/PR3913/tutorials/nonlinear/rocket_control/cd2597b6.svg b/previews/PR3913/tutorials/nonlinear/rocket_control/e9a339cb.svg similarity index 89% rename from previews/PR3913/tutorials/nonlinear/rocket_control/cd2597b6.svg rename to previews/PR3913/tutorials/nonlinear/rocket_control/e9a339cb.svg index b2692748428..609c7d6e9b7 100644 --- a/previews/PR3913/tutorials/nonlinear/rocket_control/cd2597b6.svg +++ b/previews/PR3913/tutorials/nonlinear/rocket_control/e9a339cb.svg @@ -1,130 +1,130 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/rocket_control/index.html b/previews/PR3913/tutorials/nonlinear/rocket_control/index.html index 3a5e7553376..a62314e4b2f 100644 --- a/previews/PR3913/tutorials/nonlinear/rocket_control/index.html +++ b/previews/PR3913/tutorials/nonlinear/rocket_control/index.html @@ -48,7 +48,7 @@ Dual objective value : 4.66547e+00 * Work counters - Solve time (sec) : 1.53621e-01 + Solve time (sec) : 1.53069e-01 Barrier iterations : 24

    Finally, we plot the solution:

    function plot_trajectory(y; kwargs...)
         return Plots.plot(
    @@ -66,4 +66,4 @@
         plot_trajectory(x_v; ylabel = "Velocity"),
         plot_trajectory(u_t; ylabel = "Thrust");
         layout = (2, 2),
    -)
    Example block output

    Next steps

    • Experiment with different values for the constants. How does the solution change? In particular, what happens if you change T_max?
    • The dynamical equations use rectangular integration for the right-hand side terms. Modify the equations to use the Trapezoidal rule instead. (As an example, x_v[t-1] would become 0.5 * (x_v[t-1] + x_v[t]).) Is there a difference?
    +)Example block output

    Next steps

    • Experiment with different values for the constants. How does the solution change? In particular, what happens if you change T_max?
    • The dynamical equations use rectangular integration for the right-hand side terms. Modify the equations to use the Trapezoidal rule instead. (As an example, x_v[t-1] would become 0.5 * (x_v[t-1] + x_v[t]).) Is there a difference?
    diff --git a/previews/PR3913/tutorials/nonlinear/simple_examples/index.html b/previews/PR3913/tutorials/nonlinear/simple_examples/index.html index 92bc1298a19..691801a2a94 100644 --- a/previews/PR3913/tutorials/nonlinear/simple_examples/index.html +++ b/previews/PR3913/tutorials/nonlinear/simple_examples/index.html @@ -181,4 +181,4 @@ z ≥ 0 Objective value: 0.32699283491387243 x = 0.32699283491387243 -y = 0.2570658388068964 +y = 0.2570658388068964 diff --git a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/e676b1de.svg b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/9924f312.svg similarity index 88% rename from previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/e676b1de.svg rename to previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/9924f312.svg index fb73e051a7e..130da739aad 100644 --- a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/e676b1de.svg +++ b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/9924f312.svg @@ -1,182 +1,182 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/86e291c1.svg b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/c6d6fc0e.svg similarity index 88% rename from previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/86e291c1.svg rename to previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/c6d6fc0e.svg index 159a6bd00fa..567b3e7a6d3 100644 --- a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/86e291c1.svg +++ b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/c6d6fc0e.svg @@ -1,97 +1,97 @@ - + - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + - + - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/71af12c5.svg b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/dd4a8967.svg similarity index 87% rename from previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/71af12c5.svg rename to previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/dd4a8967.svg index aca03de1872..2c4be72346d 100644 --- a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/71af12c5.svg +++ b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/dd4a8967.svg @@ -1,48 +1,48 @@ - + - + - + - + - - - - - - - - - - - - - - - - - - - - - - - - - - - - - + + + + + + + + + + + + + + + + + + + + + + + + + + + + + diff --git a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html index 16880a92704..c8270072fdf 100644 --- a/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html +++ b/previews/PR3913/tutorials/nonlinear/space_shuttle_reentry_trajectory/index.html @@ -221,7 +221,7 @@ layout = grid(3, 2), linewidth = 2, size = (700, 700), -)Example block output
    function q(h, v, a)
    +)
    Example block output
    function q(h, v, a)
         ρ(h) = ρ₀ * exp(-h / hᵣ)
         qᵣ(h, v) = 17700 * √ρ(h) * (0.0001 * v)^3.07
         qₐ(a) = c₀ + c₁ * rad2deg(a) + c₂ * rad2deg(a)^2 + c₃ * rad2deg(a)^3
    @@ -255,7 +255,7 @@
         layout = grid(3, 1),
         linewidth = 2,
         size = (700, 700),
    -)
    Example block output
    plot(
    +)
    Example block output
    plot(
         rad2deg.(value.(ϕ)),
         rad2deg.(value.(θ)),
         value.(scaled_h);
    @@ -265,4 +265,4 @@
         xlabel = "Longitude (deg)",
         ylabel = "Latitude (deg)",
         zlabel = "Altitude (100,000 ft)",
    -)
    Example block output +)Example block output diff --git a/previews/PR3913/tutorials/nonlinear/tips_and_tricks/index.html b/previews/PR3913/tutorials/nonlinear/tips_and_tricks/index.html index 1b8d08d2be8..8802d865f8a 100644 --- a/previews/PR3913/tutorials/nonlinear/tips_and_tricks/index.html +++ b/previews/PR3913/tutorials/nonlinear/tips_and_tricks/index.html @@ -69,4 +69,4 @@ @assert is_solved_and_feasible(model) Test.@test objective_value(model) ≈ √3 atol = 1e-4 Test.@test value.(x) ≈ [1.0, 1.0] atol = 1e-4 -println("Memoized approach: function_calls = $(function_calls)")
    Memoized approach: function_calls = 22

    Compared to the naive approach, the memoized approach requires half as many function evaluations.

    +println("Memoized approach: function_calls = $(function_calls)")
    Memoized approach: function_calls = 22

    Compared to the naive approach, the memoized approach requires half as many function evaluations.

    diff --git a/previews/PR3913/tutorials/nonlinear/user_defined_hessians/index.html b/previews/PR3913/tutorials/nonlinear/user_defined_hessians/index.html index 3599113340d..e1f45703561 100644 --- a/previews/PR3913/tutorials/nonlinear/user_defined_hessians/index.html +++ b/previews/PR3913/tutorials/nonlinear/user_defined_hessians/index.html @@ -39,6 +39,6 @@ Dual solution : * Work counters - Solve time (sec) : 3.57661e-02 + Solve time (sec) : 3.75781e-02 Barrier iterations : 14 - + diff --git a/previews/PR3913/tutorials/transitioning/transitioning_from_matlab/index.html b/previews/PR3913/tutorials/transitioning/transitioning_from_matlab/index.html index 2860007a199..239915732cd 100644 --- a/previews/PR3913/tutorials/transitioning/transitioning_from_matlab/index.html +++ b/previews/PR3913/tutorials/transitioning/transitioning_from_matlab/index.html @@ -58,7 +58,7 @@ 6 1.1746e-09 -1.2507e-09 2.43e-09 1.59e-16 6.59e-17 2.83e-10 3.87e-10 9.90e-01 --------------------------------------------------------------------------------------------- Terminated with status = solved -solve time = 897μs

    The exclamation mark here is a Julia-ism that means the function is modifying its argument, model.

    Querying solution status

    After the optimization is done, you should check for the solution status to see what solution (if any) the solver found.

    Like YALMIP and CVX, JuMP provides a solver-independent way to check it, via the command:

    is_solved_and_feasible(model)
    true

    If the return value is false, you should investigate with termination_status, primal_status, and raw_status, See Solutions for more details on how to query and interpret solution statuses.

    Extracting variables

    Like YALMIP, but unlike CVX, with JuMP you need to explicitly ask for the value of your variables after optimization is done, with the function call value(x) to obtain the value of variable x.

    value.(m[1][1, 1])
    0.0

    A subtlety is that, unlike YALMIP, the function value is only defined for scalars. For vectors and matrices you need to use Julia broadcasting: value.(v).

    value.(m[1])
    3×3 Matrix{Float64}:
    +solve time =  649μs

    The exclamation mark here is a Julia-ism that means the function is modifying its argument, model.

    Querying solution status

    After the optimization is done, you should check for the solution status to see what solution (if any) the solver found.

    Like YALMIP and CVX, JuMP provides a solver-independent way to check it, via the command:

    is_solved_and_feasible(model)
    true

    If the return value is false, you should investigate with termination_status, primal_status, and raw_status, See Solutions for more details on how to query and interpret solution statuses.

    Extracting variables

    Like YALMIP, but unlike CVX, with JuMP you need to explicitly ask for the value of your variables after optimization is done, with the function call value(x) to obtain the value of variable x.

    value.(m[1][1, 1])
    0.0

    A subtlety is that, unlike YALMIP, the function value is only defined for scalars. For vectors and matrices you need to use Julia broadcasting: value.(v).

    value.(m[1])
    3×3 Matrix{Float64}:
      0.0  0.0  0.0
      0.0  0.0  0.0
      0.0  0.0  0.0

    There is also a specialized function for extracting the value of the objective, objective_value(model), which is useful if your objective doesn't have a convenient expression.

    objective_value(model)
    -5.999999998825352

    Dual variables

    Like YALMIP and CVX, JuMP allows you to recover the dual variables. In order to do that, the simplest method is to name the constraint you're interested in, for example, @constraint(model, bob, sum(v) == 1) and then, after the optimzation is done, call dual(bob). See Duality for more details.

    Reformulating problems

    Perhaps the biggest difference between JuMP and YALMIP and CVX is how far the package is willing to go in reformulating the problems you give to it.

    CVX is happy to reformulate anything it can, even using approximations if your solver cannot handle the problem.

    YALMIP will only do exact reformulations, but is still fairly adventurous, for example, being willing to reformulate a nonlinear objective in terms of conic constraints.

    JuMP does no such thing: it only reformulates objectives into objectives, and constraints into constraints, and is fairly conservative at that. As a result, you might need to do some reformulations manually, for which a good guide is the Modeling with cones tutorial.

    Vectorization

    In MATLAB, it is absolutely essential to "vectorize" your code to obtain acceptable performance. This is because MATLAB is a slow interpreted language, which sends your commands to fast libraries. When you "vectorize" your code you are minimizing the MATLAB part of the work and sending it to the fast libraries instead.

    There's no such duality with Julia.

    Everything you write and most libraries you use will compile down to LLVM, so "vectorization" has no effect.

    For example, if you are writing a linear program in MATLAB and instead of the usual constraints = [v >= 0] you write:

    for i = 1:n
    @@ -157,4 +157,4 @@
         x = randn(d, 1) + 1i * randn(d, 1);
         y = x * x';
         rho = y / trace(y);
    -end
    +end