Int J App Pharm, Vol 10, Issue 6, 2018, 211-216Original Article


CENTRAL COMPOSITE DESIGNFOR OPTIMIZING EXTRACTION OF EGCG FROM GREEN TEA LEAF (CAMELLIA SINENSIS L.)

EKA INDRA SETYAWAN1, ERNA PRAWITA SETYOWATI2, ABDUL ROHMAN3, AKHMAD KHARIS NUGROHO4*

1Department of Pharmacy, Faculty ofMathematics and Natural Science, University of Udayana, Bali, Indonesia, 2Departement of Pharmaceutical Biology, Faculty of Pharmacy, Gadjah Mada University, Yogyakarta, Indonesia, 3Departement of Pharmaceutical Chemistry, Faculty of Pharmacy, Gadjah Mada University, Yogyakarta, Indonesia, 4Departement of Pharmaceutics, Faculty of Pharmacy, Gadjah Mada University, Yogyakarta, Indonesia
Email: a.k.nugroho@ugm.ac.id

Received: 20 Aug 2018, Revised and Accepted: 21 Sep 2018


ABSTRACT

Objective: This study was intendedto optimize the extraction condition using central composite design.

Methods: Central composite cesign with three independent variables, namely water temperature, brewing time, and brewing numberwere used to obtain the optimum extraction condition. Two dependent variables, namely yield of extraction and epigallocatechingallate level were used as a response parameter. Epigallocatechin gallate level was determined by using high-performance liquid chromatography method.

Results: Extraction yield was varied from 0.30 g to 0.72 g. All variables, namely water temperature, brewing time, and brewing number were able to increase the extraction yield. Epigallocatechingallatelevel was varied from 190.23 mg/g to 301.74 mg/g. Water temperature, brewing time, and bothinteraction were able to increase the epigallocatechingallate level in green tea extract.

Conclusion: Optimum extraction condition was shown using hot water at a temperature of 95 °C for 20 min and two-times infusions. The condition obtained extraction yield and epigallocatechingallateof 0.70 g and 286.87 mg/g dry weight, respectively.

Keywords:Greentea, Extraction, Epigallocatechingallate, Optimization, Central composite design


INTRODUCTION

Tea (Camellia sinensis L.) is derived from China and it was known for several thousand years ago[1]. Green tea is widely used as a healthy beverage[2,3]. The health merits related togreen tea consumption have been associated with the epigallocatechingallate (EGCG)compound. EGCG has a broad spectrum of biological activities as well as, anticancer, antioxidant, antibacterial, and antimutagenic[4,5]. Green tea also contains caffeine, theophylline, theobromine and phenolic acids like gallic acid[6,7]. The green tea compounds varydepending on climate, seasons, tea variety, and age of leaf[1].

The fabrication method of green tea beverage varies in the whole world. In Japan, green tea leaves are brewed using hot water for two minutes and prepare them for two-three infusions. The Chinese are mostly preparing green tea leaves by brewing in hot water (70-80 °C) and usually repeatedly brewed seven times. However, the most common way is steeping green tea leaves using a hot water at the temperature at 70-100 °C for 1-20 min[7–9]. The development of green tea as a pharmaceutical product needs a proper extraction procedure. Many factors during extraction procedure, specifically solvents, time, temperature and ratio of liquid-solid determine the efficacy of extract[10–13]. Consequently, optimization of extraction condition is needed to maximize the green tea efficacy.

Severalstudieshave been declaredin optimization extraction ofgreen tea including a comparison of some extraction method ofTurkish green tea[6]. Optimizing process of green tea extraction using hot water[9]. Influence of green tea preparation on the bioactive compounds[14]. Although previous study[1,6,9,14]has identified several factors that affect the effectiveness of extraction using a water-solvent (temperature, time, water ratio, tea particle size, and pH) but not a single publication has investigated and reported the application of experimental design of central composite design (CCD)on the optimizing process of green tea extraction. The design of experimental (DoE) exhibits several advantages including maximizing process knowledge with the minimum use of resources, provide accurate information in the most efficient way possible,identify factor interactions, allow the prediction of the process behavior within the design space, enable the optimization of critical quality attributes through appropriate selection of critical process parameters setting[15]. Therefore, this study was intended to optimize the extraction condition namely water temperature, brewing time, and brewing number to get the maximumlevel of extraction yield and EGCGfrom green tea leaf using CCD.

MATERIALS AND METHODS

Materials

Adried sample of green tea was purchased from PT. MitraKerinci (West Sumatera, Indonesia). EGCG 95% was purchased from Sigma-Aldrich (Singapore). Methanol,acetonitrile, and ortho-phosphate acid were purchased from Merck (Germany).

Instrumentation and software

The stipulation of the EGCG level in green tea extract was carried out using a high-performance liquid chromatograhy (HPLC) system equipped with Smart-Line pump 1000 V7603, UV detector (Smart-Line 2500 A5140), injector (Rheodyn Loop A135), Eurosphere C18 column (250 x 4.6 mm, i. d 5 µm). The mobile phase (0.1% ortho-phosphoric acid: water: acetonitrile: methanol with a ratio of 14:7:3:1 v/v/v/v), flow rate 1.2 ml/min. The mobile phase was set at pH 4.00 by buffering with triethylamine.Chromgate software version 3.1 for data analysis. DoE was computed and analyzed applying Design-Experts® software 7.1.5.

Green tea extract preparation

A single stepand multiple step extraction were applied to prepare a green tea extract. 10 g dried green tea[6] were brewed in 250 ml hot water with a different temperature and time by following the CCD design (table 1). The solution was chilled in cold water for 10 min. 100 ml of ethyl acetate was used to separated a non-polar compounds.A water bath was used to evaporate an ethyl acetate and the yield was accurately weighed. While the multiple step extraction, samples were brewed two-times on the same conditions with 150 mlofhot water and continuedin 100 ml of hot water.

Quantitation of EGCG from green tea extract

The extracts (10 mg) were disolve in mobile phase (10 ml) and sonicated for 15 min. A nylon membrane (0.45 µm) was used to filter a mixture and sample (20 µl) was injected into a port. Analytes were detected at a wavelength of 280 nm[16–19].

Method validation of HPLC system

The system suitability test was performed by injecting an analytes at a concentration of 100 ppm for six-times. The validationprocess was carried out by appraising various criteria, namely linearity, selectivity, accuracy, precision limit of detection (LoD), and limit of quantification (LoQ)[20].

Experimental design forCCD

A CCD with three factors (two numerical factors and one categorical factor) and five levels are selected for the optimization process. The factors were coded at five levels (-α,-1, 0, 1, α). Αn α-value is determined by the factor number and can be calculated by the following equation:

For two factors, it is 1.41. The number of the experiment can be calculated by the following equation:

Where k is the factor number and Cp is the replicates number of the central point[21]. Water temperature (A), brewing time (B), and brewing number (C) were selected for independent variables. Both the yield extraction (Y1) and EGCG level (Y2) were chosen in response. ANOVA was used to analyze the level of statistical significance of the predictedmodel. The suitability of the model prediction to the response was assesed with the coefficient determination of adjusted r-square (Adj. R2), predicted r-square (Pred. R2), and predicted residual sum of square (PRESS).

RESULTS AND DISCUSSION

Validation method

The % relative standard deviation (% RSD) of peak area and retention time was obtained<2% (table 1).

Table 1: System suitability test of EGCG (n=6)

Replication tR (min.) Asymetry USP Width USP Plates USP HETP USP
1 17.70 1.082 1.05 16406.03 4102
2 17.80 1.071 1.06 16618.00 4155
3 17.90 1.065 1.07 17395.34 4349
4 17.71 1.109 1.06 16886.00 4106
5 17.72 1.107 1.04 17361.20 4104
6 17.72 1.098 1.08 16937.67 4147
Mean 17.80 1.07 1.06 16806.46 4202.00
SD 0.10 0.01 0.01 520.89 130.03
%RSD 0.01 0.01 0.01 0.03 0.03

Selectivity was assessed from the resolution for each chromatogram. The chromatogramseparation obtained resolution (Rs) value of>2(Rs ≥2) (fig. 1) showingthat HPLC was selective enough.

The linearity of EGCG was determined by coefficient correlation(r-value). The concentrationused were 5, 10, 20, 30, 40, 50 ppm. The equation of the calibration curve wasy = 21254x–111.9. The calibration curve showed a good linearity witha r-value of 0.998.

Fig.1: HPLC chromatogram ofEGCG standard (a) and green tea extract (b)

From the linearregression, LoD and LoQ were determined as:

LoD and LoQ value obtained was 1.07 ppm and3.57 ppm, respectively. The accuracy ofthe HPLC method was performed by a standard addition method in which sample extract was spiked with EGCG standard solutions with a concentration of 10 ppm, 20 ppm, and 30 ppm and the recovery was determined. The percentage recovery ofEGCG obtained was a range of 98.2%-101.8%. The precision of HPLC was analyzedby repeatability test (intra-day precision) by analysis six replicated of sample extract was spiked with EGCG standard solutions with a concentration of 10 ppm, 20 ppm, and30 ppmand % RSDwere determined. The % RSD of EGCG obtained were a range of 1%-2%.

Experimental design

To maximize the yield of extraction and EGCG level, we have investigated the effect of three extraction variables, namely watertemperature, brewing time, and brewing number. Hot water was selected as a solvent because it provides the highest extract yield and EGCG comparedto others[6]. The selected temperature was range from 70-100 °C, based on the empirical experience of tea-consuming countries. Higher temperature results in EGCG instability[4,22,23] and epimerization EGCG becomes trans-epimer (-)-gallocatechingallate (GCG) and it is reversible[24]. The water temperature ranges are the optimum conditions, under this conditions the epimerizationprocess can be controlled[25]. The previous study[23] showed that brewing time also affects on the epimerization process of catechin. The extraction process more than 20 min will decrease the EGCG levels and lead to the degradation process and it is characterized by increased levels of GCG[24,26]. Therefore, in this study the brewing time is limited to 20 min.

We have investigated a multiple step extraction (brewing number), where the rest material from the first brewing was extracted again with the same conditions. Based on the previous study[1] the extraction yields drastically decreased while the content of major catechin increased. The decreasing in the extraction yield due to the degradation process of an important component in green tea. In this study, the brewing number is limited to two-times to get the optimum condition.

Yield of extraction

The results showed that the extraction yield was varied from 0.30 g to 0.72 g (table 2).

Table 2: CCD for the independent variables and their responses (n=18)

Std Run Factor A Factor B Factor C Response (Y1) Response (Y2)
Water temp Brewing time Brewing number Yield EGCG
°C min G mg/g dry weight
1 14 75.00 5.00 Level 1 of C 0.36 301.47
2 2 95.00 5.00 Level 1 of C 0.56 196.30
3 16 75.00 20.00 Level 1 of C 0.47 201.57
4 8 95.00 20.00 Level 1 of C 0.69 293.24
5 1 70.86 12.50 Level 1 of C 0.46 240.24
6 3 99.14 12.50 Level 1 of C 0.58 275.06
7 9 85.00 1.89 Level 1 of C 0.30 245.80
8 15 85.00 23.11 Level 1 of C 0.59 235.22
9 6 85.00 12.50 Level 1 of C 0.55 207.49
10 13 75.00 5.00 Level 2 of C 0.49 271.82
11 5 95.00 5.00 Level 2 of C 0.56 190.23
12 11 75.00 20.00 Level 2 of C 0.48 242.49
13 4 95.00 20.00 Level 2 of C 0.64 294.24
14 10 70.86 12.50 Level 2 of C 0.59 238.14
15 12 99.14 12.50 Level 2 of C 0.72 278.31
16 17 85.00 1.89 Level 2 of C 0.44 243.47
17 7 85.00 23.11 Level 2 of C 0.74 214.85
18 18 85.00 12.50 Level 2 of C 0.63 179.81

The experimental results can be illustrated by the following linear equations:

The actual value andmodel prediction value of the yield showed a good correlation (fig. 2a). Based on the ANOVA analysis, the linear equation has a p-value of 0.0002 (<0.05) indicating that the equationmodel is significant. The model selection focuses on PRESS, Adj. R2 and Pred. R2 value (table 3).The PRESS statistic illustrates how good the model fits the data. The PRESS valueshould be small relative to the other models under consideration.Adj. R2is a measure of the amount of variation about the mean explained by the model. Pred. R2 is a measure to see how good the resulting models predict the observed value.The Adj. R2-and Pred. R2should be within approximately 0.20 of each other to be in "reasonable agreement." If they are not, there may be a problem with either the data or the model.

Fig.2: Correlation between actual value and predicted value of extraction yield (a), correlation between actual and predicted value of EGCG level (b)

Table 3: Model summary statistic of the extraction yieldextraction yield

Source Std. R-squared Adj. R-squared Pred. R-squared PRESS
Dev.
Linear 0.067 0.736 0.6794 0.5545 0.11 Suggested
2FI 0.072 0.7569 0.6244 0.2918 0.17
Quadratic 0.070 0.8157 0.6518 0.2827 0.17
Cubic 0.071 0.9142 0.6353 + Aliased

The results of the ANOVA analysis, factors A, B, and C had a significant effect (table 4). The factors A, B, and C had a p-value of 0.0021, 0.0008, and 0.0221, respectively. The model showed that the factors A, B, and C had a positive effect on the extraction yield indicating an increase in these factors, extraction yield increases (fig. 3a). It is because the cell wall becomes more penetrable for the solvent to penetrate the membrane and the constituents solubility is increase[9,27,28]. The maximumextraction yield is shown by using water temperature at 95 °C for 20 min with two-times brewing.

Table 4: Analysis of variance (ANOVA) of the extraction yield

Yield (Y1)
ANOVA for response surface linear model
Analysis of variance table [partial sum of squares-type III]
Source Sum of df Mean F p-value
Squares Square Value Prob>F
Model 0.170 3 0.058 13.01 0.0002 significant
A-Water temp. 0.063 1 0.063 14.09 0.0021
B-Brewing time 0.082 1 0.082 18.32 0.0008
C-Brewing number 0.030 1 0.030 6.63 0.0221
Residual 0.063 14 4.47E-03
Cor Total 0.240 17

EGCG level

The results showed that the EGCG level was varied from 190.23 mg/g to 301.74 mg/g (table 2). The experimental results can be illustrated by the following quadratic equations:

Based on the ANOVA analysis the prediction model has a p-value of 0.0088 (<0.05). The coefficient determination of Adj. R2 and Pred. R2 was of 0.6874 and 0.3434 with a PRESS value of 16066.58 (table 5).

Table 5: Model summary statistic of the EGCG

EGCG level
Source Std. R-Squared Adj. R-Squared Pred. R-Squared PRESS
Dev
Linear 41.49 0.0149 -0.1962 -0.5989 39125.1
2FI 30.60 0.5790 0.3493 0.0644 22892.9
Quadratic 21.21 0.8345 0.6874 0.3434 16066.6 Suggested
Cubic 13.92 0.9683 0.8655 + Aliased

It shows that the experimental model was the best fit using quadratic equations. In this case, the prediction model terms are significant. The actual value and model prediction value of the EGCG showed a good correlation (fig. 2b). There were only three factors contribute significantly toward the EGCG level, namely AB, A2, and B2. This factor has p-value of 0.0004, 0.0047, and 0.0390, respectively (table 6).

Table 6: Analysis of variance (ANOVA) of the EGCG

Response 2 EGCG (Y2)
ANOVA for response surface quadratic model
Analysis of variance table [partial sum of squares-type III]
Source Sum of df Mean F p-value
Squares Square Value Prob>F
Model 20419.30 8 2552.41 5.67 0.0088 significant
A-Water temp. 245.80 1 245.80 0.55 0.4787
B-Brewing time 16.57 1 16.57 0.037 0.8521
C-Brewing number 102.87 1 102.87 0.23 0.6440
AB 13627.40 1 13627.4 30.28 0.0004
AC 4.81 1 4.81 0.011 0.9199
BC 169.83 1 169.83 0.38 0.5542
A2 6250.73 1 6250.73 13.89 0.0047
B2 2621.33 1 2621.33 5.83 0.0390
Residual 4050.07 9 450.01
Cor Total 24469.40 17

The quadratic equation above indicates that with an increasing factor A2, B2, and interaction between A and B, EGCG level increases (fig. 3b). It was contradicted with factor C, EGCG has not been released completely in the first infusion[29]. The extraction temperature over 80 °C lead apolimerization and epimerization reaction[23]. The highest level of EGCG is shown by using water temperature at 75 °C for 5 min with two-times brewing.

Optimization

The optimization process was performed by establishing the highest level of extraction yield and EGCG. The optimum conditions are based on the resulting desirability value. Desirability is an objective function that ranges from zero outside of the limits to one at the goal. The numerical optimization finds a point that maximizes the desirability function. The characteristics of a goal may be altered by adjusting the weight or importance. For several responses and factors, all goals get combined into one desirability function.The value is completely dependent on how closely the lower and upper limits are set relative to the actual optimum. The goal of optimization is to find a good set of conditions that will meetall the goals[15,30,31]. The results generated nine solutions for the optimum conditions. The selection of the optimum condition is focused on the highest desirability value (table 7).

Table 7: Solutions for 2 combinations of categoricfactor levels

Number Temperature Times Number Yield EGCG Desirability
1 95.0 20.00 Level 2 of C 0.72202 294.182 0.949 Selected
2 93.5 20.00 Level 2 of C 0.71262 278.389 0.865
3 95.0 20.00 Level 1 of C 0.64091 293.544 0.860
4 75.0 5.00 Level 2 of C 0.45353 278.888 0.559
5 75.0 5.36 Level 2 of C 0.45692 275.168 0.552
6 75.0 5.03 Level 1 of C 0.37273 288.719 0.423
7 75.0 5.40 Level 1 of C 0.37620 284.611 0.422
8 75.0 20.00 Level 2 of C 0.59658 204.895 0.349
9 75.0 18.50 Level 2 of C 0.58228 204.653 0.340

Fig.3: Interaction factors A, B, and C on the extraction yield (a), interaction factors A, B, and C on the EGCG level (b), graphic of optimum extraction condition on the desirability value (c)

The optimum condition was to use water temperature at 95°C with two-times brewing for 20 min (fig. 3c). The model predicted extraction yields and EGCG level of 0.72 g and 294.18 mg/g. Meanwhile, the results obtained extraction yield and EGCG level of 0.70 g and 286.87 mg/g. There were insignificantly different between predicted and observed (p-value of the yield and EGCG level of 0.622 and 0.323).

CONCLUSION

The optimization process for green tea extraction has been evaluated. By CCD and desirability value, the optimum condition for optimum functional components in green tea extraction was 95 °C for water temperature, 20 min brewing time, and two-times brewing to obtain a yield of 0.70 g and EGCG of 286.87 mg/g dry weight.

ACKNOWLEDGMENT

This research was supported by LembagaPengelola Dana Pendidikan (LPDP) and BeasiswaUnggulanDosen Indonesia-DalamNegeri (BUDI-DN)

AUTHORS CONTRIBUTIONS

All author the author contributed equally

CONFLICTOF INTERESTS

The author declares there is no conflict of interest

REFERENCES

  1. Perva-Uzunalić A, Skerget M, Knez Z. Extraction of active ingredients from green tea (Camellia sinensis): Extraction efficiency of major catechins and caffeine. Food Chem 2006;96:597–605.

  2. Ramadon D, Pramesti SS, Anwar E. Formulation, stability test and in vitro penetration study of transethosoma gel containing green tea (Camellia sinensis L.) leaves extract. Int J Appl Pharm 2017;9:91–6.

  3. Isnan AP, Jufri M. Formulation of niosomal gel containing green tea extract (Camellia sinensis L.) using thin-layer hydration. Int J Appl Pharm 2017;9:38–43.

  4. Hajiaghaalipour F, Sanusi J, Kanthimathi MS. Temperature and time of steeping affect the antioxidant properties of white, green, and black tea infusions. J Food Sci 2016;81:H246-54.

  5. Lambert JD, Kim DH, Zheng R, Yang CS. Transdermal delivery of (-)-epigallocatechin-3-gallate, a green tea polyphenol, in mice. J Pharm Pharmacol 2006;58:599–604.

  6. Demir E, Serdar G, Sokmen M. Comparison of some extraction methods for isolation of catechins and caffeine from turkish green tea. Int J Second Metab 2015;2:16–25.

  7. Banerjee S, Chatterjee J. Efficient extraction strategies of tea (Camellia sinensis) biomolecules. J Food Sci Technol 2015;52:3158–68.

  8. Venditti E, Bacchetti T, Tiano L. Hot vs. cold water steeping of different teas: Do they affect antioxidant activity? Food Chem 2010;119:1597–604.

  9. Vuong QV, Golding JB, Stathopoulos CE, Nguyen MH, Roach PD. Optimizing conditions for the extraction of catechins from green tea using hot water. J Sep Sci 2011;34:3099–106.

  10. Lee JW, Mo EJ, Choi JE. Effect of korean red ginseng extraction conditions on antioxidant activity, extraction yield, and ginsenoside Rg1 and phenolic content: optimization using response surface methodology. J Ginseng Res 2016;40:229–36.

  11. Sankalpa KB, Mathew SM. Response surface optimization of extraction parameters of green tea. Int J Agric Environ Biotechnol 2017;10:209.

  12. Lee JW, Mo EJ, Choi JE. Effect of extraction conditions of green tea on antioxidant activity and EGCG content: optimization using response surface methodology. J Ginseng Res 2016;40:270–4.

  13. Gadkari PV, Kadimi US, Balaraman M. Catechin concentrates of garden tea leaves (Camellia sinensis L.): extraction/isolation and evaluation of chemical composition. J Sci Food Agric 2014;94:2921–8.

  14. Komes D, Horzic D, Belscak A, Ganic KK, Vulic I. Green tea preparation and its influence on the content of bioactive compounds. Food Res Int 2010;43:167–76.

  15. N Politis S, Colombo P, Colombo GM, Rekkas D. Design of experiments (DoE) in pharmaceutical development. Drug Dev Ind Pharm 2017;43:889–901.

  16. Martono Y, Martono S. High-performance liquid chromatography analysis for determination of gallic acid, caffeine, and epigallocatechin gallate concentration in various tea bags product. Agritech 2013;32:362–9.

  17. Sugihartini N, Fudholi A, Pramono S, Sismindari S. Validation method of quantitative analysis of epigallocatechin gallate by high-performance liquid chromatography. Pharmaciana 2014;4:111–5.

  18. Saito ST, Welzel A, Suyenaga ES, Bueno F. A method for fast determination of epigallocatechin gallate (EGCG), epicatechin (EC), catechin (C) and caffeine (CAF) in green tea using HPLC. Ciênciae Tecnol Aliment 2006;26:394–400.

  19. Setyawan EI, Rohman A, Setyowati EP, Nugroho AK. Application of factorial design on the extraction of green tea leaves (Camellia sinensis L.). J Appl Pharm Sci 2018;8:131–8.

  20. Prabaningdyah NK, Riyanto S, Rohman A, Siregar C. Application of HPLC and response surface methodology for simultaneous determination of curcumin and desmethoxy curcumin in curcuma syrup formulation. J Appl Pharm Sci 2017;7:58–64.

  21. Bezerra MA, Santelli RE, Oliveira EP, Villar LS, Escaleira LA. Response surface methodology (RSM) as a tool for optimization in analytical chemistry. Talanta 2008;76:965–77.

  22. Labbe D, Tetu B, Trudel D, Bazinet L. Catechin stability of EGC-and EGCG-enriched tea drinks produced by a two-step extraction procedure. Food Chem 2008;111:139–43.

  23. Wang H, Helliwell K. Epimerisation of catechins in green tea infusions. Food Chem 2000;70:337–44.

  24. Krupkova O, Ferguson SJ, Wuertz Kozak K. Stability of (−)-epigallocatechin gallate and its activity in liquid formulations and. pdf. J Nutr Biochem 2016;37:1–12.

  25. Liang H, Liang Y, Dong J, Lu J. Tea extraction method in relation to control epimerization of catechin. J Sci Food Agric 2007;87:1748–52.

  26. Chen Z, Zhu QY, Tsang D, Huang Y. Degradation of green tea catechins in tea drinks. J Agric Food Chem 2001;49:477–82.

  27. Vuong QV, Golding JB, Nguyen M, Roach PD. Extraction and isolation of catechins from tea. J Sep Sci 2010;33:3415–28.

  28. Vuong QV, Stathopoulos CE, Nguyen MH, Golding JB, Roach PD. Isolation of green tea catechins and their utilization in the food industry. Food Rev Int 2011;27:227–47.

  29. Yang DJ, Hwang LS, Lin JT. Effects of different steeping methods and storage on caffeine, catechins and gallic acid in bag tea infusions. J Chromatogr A 2007;1156:312–20.

  30. Yu LX, Amidon G, Khan MA. Understanding pharmaceutical quality by design. AAPS J 2014;16:771–83.

  31. Collins LM, Dziak JJ, Li R. Design of experiments with multiple independent variables: a resource management perspective on complete and reduced factorial designs. Psychol Methods 2009;14:202–24.