Logistic regression has been the most commonly applied statistical method in the study of settlement locational patterns in archaeology (e.g. Kvamme 1988; Warren & Asch 2000; Woodman & Woodward 2002; Verhagen & Whitley 2020). However, in recent years it has been suggested that machine learning methods such as random forest might represent a valuable alternative (e.g. Verhagen & Whitley 2012; Harris, Kingsley & Sewell 2015). This paper provides an applied case study that employs and compares both methods. The paper thus contrasts the disparate modelling procedures associated with statistical modelling and machine learning in the form of algorithmic classification, while also using techniques within these frameworks that have seen little previous application in archaeology. While the paper compares these approaches, the ultimate aim of the study was to elucidate coastal settlement patterns in Mesolithic Norway. As such, the goal is not a balanced comparison of the potential performance of the two methods by applying them to idealised data sets, but rather to demonstrate and compare their use as applied to real world archaeological data with its own range of idiosyncrasies.
The Mesolithic in Norway has typically been understood in terms of a continuous increase in societal complexity, coupled with a decrease in mobility (e.g. Bergsvik 2001; Bjerck 2008; Glørstad 2010: 97). This development is claimed to be clearly reflected in the location of coastal sites relative to a range of environmental variables. However, while frequent reference to overarching settlement patterns and general developments in locational preferences throughout the period can be found in the literature, there is an overall lack of formal treatment of these patterns (Åstveit 2014). The substantive goals of the study were consequently to i) formalise and quantitatively evaluate previously suggested environmental determinants for coastal site location in Mesolithic Norway, and ii) determine if the relative importance of these variables change across major chronological transitions. This was done by means of a case study, represented by excavated and surveyed coastal Mesolithic sites from the municipalities of Larvik, Porsgrunn and Bamble, situated in south-eastern Norway.
Human presence in Norway (Figure 1) has not been recorded earlier than around 9400–9300 BCE (Damlien & Solheim 2017), signifying the beginning of the Early Mesolithic (EM). The classic perception of the EM is of a phase characterised by coastal exploitation by highly mobile groups (e.g. Bjerck 2008; Bang-Andersen 2012; Fuglestvedt 2012). The subsequent Middle Mesolithic (MM; 8200–6300 BCE) has been contested in the literature, with discussions concerning whether the phase has more in common with the highly mobile EM (Mansrud 2014), or if it signifies the emergence of what are deemed classic Late Mesolithic (LM) traits of semi-sedentism and more varied locational patterns in south-eastern Norway (Solheim & Persson 2016). The LM, lasting from around 6300–3900 BCE, is to mark a more definite overall decrease in mobility (Bjerck 2008; Glørstad 2010). While the LM only lasts until 3900 BCE, settlement patterns in the first part of the Early Neolithic are largely seen as a continuation of the LM in the region (Glørstad 2009). Sites dating up to around 3600 BCE were therefore included in this analysis as part of the LM.
|1||Site delineated by use of a GNSS-device, or a securely georeferenced record. Extensive database entry.||160|
|2||Secure spatial data. Slight damage to site or somewhat lacking database record.||247|
|3||Secure spatial data. Damaged site, such as outskirts of a quarry, and/or very limited database entry.||71|
|4||Surveyed by archaeologists. However, the database entry is extremely limited/unclear, the site geometry is only given as a point or small automatically generated circle, and/or finds are from the topsoil of a field, making the actual site location and extent uncertain.||107|
|5||Likely site but uncertain spatial information. Typical example is recurring stray finds in a field or other larger area.||92|
|6||Single stray find or unverified claims/suggestions of possible site.||105|
An important characteristic of the region as a whole is that due to isostatic rebound following the retreat of the Fennoscandian Ice Sheet, the land has continuously risen faster than the sea in south-eastern Norway (Sørensen et al. 2014). In addition, Mesolithic sites located beneath the marine limit are almost exclusively believed to have been utilised when they were situated on or a few meters from the shoreline. Recent investigations into the distribution of radiocarbon dates relative to the shoreline displacement curves of the region have largely verified this picture (Breivik, Fossum & Solheim 2018; Solheim 2020). This means that the sites are distributed along relic shorelines with older sites situated at higher elevations than younger sites. Due to the rate of rebound, sites were also shore-bound within relatively limited time-spans, meaning that the sites tend to contain internally consistent and chronologically distinct assemblages. Here it is assumed that all sites under study were located on the shoreline during their original occupation. While not entirely unproblematic, I believe that aggregating the results across as many cases as is done here will suppress noise caused by any sites potentially misclassified as shore-bound.
The area of concern is comprised of the municipalities of Porsgrunn, Bamble and Larvik in Vestfold and Telemark county (Figure 1). The region has been subject to extensive survey and excavation activity in the recent decade or so, leading to a dramatic increase in research activity and available data (e.g. Solheim & Damlien 2013; Jaksland & Persson 2014; Melvold & Persson 2014; Reitan & Persson 2014; Solheim 2017).
The most readily available, comprehensive and standardised source of information on archaeological investigations in Norway is held in the national heritage and monuments database Askeladden, which is managed by the Directorate for Cultural Heritage (Norwegian Directorate for Cultural Heritage 2018). However, as the database is mainly aimed at cultural resource management, the information it holds is predominantly of a bureaucratic nature. The only consistently available information of interest to this study is the spatial extent of the sites which is recorded during survey. All site and stray find records from the municipalities Bamble, Porsgrunn and Larvik were retrieved from the database and the records manually reviewed to exclude any undefinable and non-Stone Age records. Parallel to this, each record was given a quality score based on the criteria provided in Table 1, which pertains to the degree to which the sites have been adequately delineated by the spatial geometries provided in the database. The process resulted in 478 records deemed certain enough to allow for analysis.
The sites were then ascribed to the three chronological phases based on the lowest elevation value of the polygon representing the site, using the mean of the corresponding regional shoreline displacement curve given in Figure 2. All sites situated at elevations corresponding to a shoreline date lower than 3600 BCE were then removed, resulting in a final 462 records being retained for analysis.
To understand where sites are located in the landscape ultimately also depends on our knowledge of where they are verifiably not located, as this allows us to get at the degree of selectivity exhibited by prehistoric inhabitants (Kvamme & Jochim 1989: 2). As Stone Age sites are typically discovered by means of test-pitting in southern Norway, surveys do not provide a continuous field of known presence or absence of archaeological material, and no verified negative data is readily available from sources such as Askeladden. Random samples of control points representing assumed non-sites were therefore generated across the landscape (e.g. Kvamme 1988; Fisher et al. 1997). These were first constrained to avoid areas with higher slope values than any of the sites. This was done both because surveys are commonly directed by degree of slope (e.g. Nielsen et al. 2016: 369), and because this excludes extremely steep areas unsuitable for human occupation. Similarly, the samples were also constrained to fall within the elevation range of the sites, as areas outside of this would not have represented alternative coastal locations in the Mesolithic. Finally, samples were restricted to avoid present day lakes, because several of these are likely to have been present or part of the sea in the Mesolithic, and because they are typically only partially surveyed when water levels are low.
As the most substantial survey projects have followed from the expansion of infrastructure, this has led to severe spatial structuring in the retrieval of archaeological material. Two sampling frames were employed in an attempt to work around this issue. The first involved constraining the random sample by a 500 m buffer around the sites, in addition to the environmental constraints. This is somewhat arbitrary, but follows from the survey strategy that has been employed for highway projects, where a 400 m tract along the proposed highway is surveyed, with additional extensions for areas such as planned intersections and lay-bys (Eskeland 2017: 7). The second sampling frame involved creating a convex hull around these buffers, in addition to the environmental constraints. This larger hull constraint is likely to include more variability in the background populations for the variables considered, but it is less certain that any observed pattern is not simply an effect of including areas in the analysis where no archaeological investigation has taken place (cf. Kvamme 2020: 217). While the smaller buffer sampling frame is not a safeguard against this effect, and the considerable reduction in sample space is likely to exclude variability that was relevant for locational choices, any locational pattern that can be observed using both sampling schemes would result in a far more convincing result in terms of whether actual locational preferences have been discerned. The sample sizes were set to 1000 for each of the two sampling strategies for each of the three phases, totalling at 6000 random samples.
Below follows a presentation of the considered environmental covariates. These are mainly derived from previous informal studies of Mesolithic settlement patterns in Norway. Of these, the exposure of sites to the elements is the most central and has been emphasised in studies undertaken in most areas of the country (Bjerck 2008; Berg-Hansen 2009; Åstveit 2014). Exposure is also the locational variable that has been most explicitly linked to mobility, where a common sentiment is that higher mobility is reflected in higher degrees of site exposure. As societies in earlier periods are typically understood to have been more mobile, the general trend is argued to be an overall decrease in site exposure through the Mesolithic (e.g. Lindblom 1984; Jaksland 2001; Bjerck 2008; Breivik, Fossum & Solheim 2018). Svendsen (2014) has, however, pointed out that the exposure term as used in Norwegian Mesolithic research has referred to both lack of shelter from wind and sea, but also to the degree of visibility from sites. In an attempt to get at this distinction, exposure is operationalised using two variables.
Wind fetch is a fundamental concept in the study of ocean systems and environments that is commonly employed outside archaeology to estimate the exposure of locations to wind-generated wave action (Laing 1998, for archaeological applications see Nitter, Elvestad & Selsing 2013; Nitter & Coolen 2018). Wind-generated wave action is a complex phenomenon that can depend on a wide range of parameters. However, the most commonly applied models for wave exposure are founded in so-called fetch-based indices. Fetch is defined as the unobstructed distance of sea across which the wind travels towards a given location. The longer the uninterrupted distance the wind can travel the surface of the ocean, the higher waves will tend to be. Wave prediction models based on fetch involve various degrees of complexity, starting from relatively simplistic models that only take account of the length of the fetch, as is done here. While more complex models allow for more accurate predictions that also move beyond estimation of mere relative exposure (Malhotra & Fonseca 2007; Bekkby et al. 2008; Sundblad et al. 2014), investigations into the predictive power of fetch-based models have found that those based solely on fetch length still perform reasonably well in predicting the presence and absence of biological indicators of wave exposure (Burrows, Harvey & Robb 2008; Hill et al. 2010).
Here, estimation of average fetch length was based on the procedures presented by Ekebom, Laihonen and Suominen (2003) and Tolvanen and Suominen (2005). With the sea-level raised just above each random point and the centre point for the site polygons, this involved first drawing a line every 7.5 degrees in circumference around each point. The lines were then clipped by the raised coastline in the study area and by the present day coastline in the larger region (Figure 3). The average length of the lines was then returned. The coastline has also changed considerably outside of the study region throughout the Mesolithic, which means that the average fetch of the more exposed locations has presumably been underestimated. However, as the average fetch lengths will largely be determined by the immediate surroundings of a location, this seemed like less of a problem for the purposes of mapping general locational patterns.
Viewshed analysis was employed to investigate visibility patterns (Conolly & Lake 2006: 225–233; Gillings & Wheatley 2020). As my interest here were general visibility patterns, simple measures of total visible area from the analysed locations was deemed sufficient. The outer radii of the viewsheds was set to 5000 and 10,000 meters to represent views at a long and medium distance. These distances are somewhat arbitrary, but relatively common when mapping the size of views where a target has not been defined (e.g. Lake & Woodman 2000; Lopez-Romero 2008; Garcia 2013). The elevation of the observer point was set to 1.65 m above ground, and r.viewshed, the employed GRASS module, was set to take the curvature of the earth into account.
The sea level was raised to the lowest elevation of each site polygon, and the viewsheds computed from the centre points. For raising the sea level to the random point locations, a circular buffer with a radius of 11.9 meters was generated around each point. This equates to the median site size. Results were returned as the number of raster cells visible from each point.
Wren, Costopoulos and Hawley (2020) recently investigated the relationship between settlement location of the Wemindji and rapid isostatic rebound in James Bay, Canada. They found that the sites in the region tend to be situated at locations where the topography will have resulted in a higher than expected degree of coastal stability within a 2 km radius of the sites, and a higher than expected variability in shoreline emergence within 20 km of the sites. This is taken to reflect a settlement strategy favouring site locations with stable local surroundings that simultaneously offer ecological variability within wider resource catchments. Variation in when areas emerged from the sea means that these will be at various stages of ecological succession, following the transition from oceanic, to littoral, to terrestrial environments.
A similar approach is taken here, with a few adjustments to the methodology of Wren, Costopoulos and Hawley (2020). First, the shoreline displacement curves for the study region are only reasonably reliable up to around 100 masl. The 32 EM sites situated above 100 masl were consequently excluded from this part of the analysis. Furthermore, the shoreline displacement in south-eastern Norway cannot be approximated by a low-order polynomial. The maximum radius explored around sites and non-sites was therefore set to 1 km, due to uncertainty and variable uplift rates towards the outer edges of the distribution of sites.
The emergence raster in Figure 4 was created by reclassifying the elevation raster based on the regional displacement curves. As the assumption here is that all sites have been situated on the shoreline, all areas lower than the lowest elevation of the site polygons and non-site buffers were excluded from analysis for each location. Standard deviation in year of emergence was then retrieved using buffers with radii of 50, 500 and 1000 meters around the point locations.
Several authors have pointed to the fact that a substantial number of sites seem to have been situated on small islands, and especially so in the earlier parts of the Mesolithic (e.g. Nyland 2012; Bjerck & Zangrando 2013; Bjerck 2017). Behavioural explanations of this assertion has followed a general emphasis on the use of watercrafts and resource exploitation in archipelago environments, but has also been explicitly related to extensive seal hunting in the earliest part of the Mesolithic (Bjerck 2017), as well as concentrations of marine productivity in the lee of smaller islands (Breivik 2014; Schmitt 2015). For this analysis a context dependent algorithm available in the provided Python script was devised to identify if point locations would have been situated on islands, assuming they were shore-bound. If yes, then the size of the island was found.
It has also been suggested that Mesolithic sites tend to be located relative to different soils and sediments (see Bergsvik 1995; Berg-Hansen 2009). This suggestion is based on the assumed desire of hunter-gatherers to situate sites on well-drained locations. The sediment data used here was retrieved from the Geological Survey of Norway and has a resolution of 1:50,0000. The sediment data has an infiltration score, relating to how well the sediments drain and clean wastewater. While these are in part related to the potential for biological breakdown of toxins, they are also determined by degree of permeability (Geological Survey of Norway 2015). Thus, while the original motivation for the classification does not perfectly align with my intended use, it does appear to capture the relevant properties of the sediments. The infiltration level for each location was found by taking the mode on the site polygons and the non-site buffers.
Aspect may also have been important to locational choices in Mesolithic Norway. This is typically seen in relation to shelter (Berg-Hansen 2009: 47), a desire to face either land or the open sea (Darmark, Viken & Johannessen 2018), or to situate sites at locations that receive more sunlight throughout the day (Mikkelsen 1989: 58; Berg-Hansen 2009: 113). Here it was decided to focus on the possible relevance of aspect as related to sunlight, as the other proposed reasons for why aspect might be relevant should be captured by other variables. The aspect of each location, calculated as degrees from north, was therefore transformed to deviance from south by finding the absolute distance of each value from 180 degrees (Spencer & Bevan 2018).
The first statistical method applied is logistic regression, which forms the backbone of site locational analysis in archaeology. The most common approach to model building with regression methods in archaeology could be said to fall in the category of stepwise minimisation, sometimes also called data-driven model tuning, as this often starts with analysis of the relationship between predictors and the response, independently of the multivariate model (Conolly & Lake 2006: 182–183). This becomes very problematic when variables are included or excluded from further analysis based on the statistical significance of this relationship, as has sometimes been the case (e.g. Stančič & Veljanovski 2000: 152–153; Duncan & Beckman 2000: 36). This is in effect a form of p-value driven, forward stepwise variable selection, and is hampered by severe issues (Harrell 2015: 71–72). First of all this approach would exclude a variable without considering whether it might be an important predictor once other variables are controlled for, or if it might alter the effect of other predictors in the model. If such effects are present, the variable should be included in the model irrespective of whether or not it is a good predictor of the independent variable (Kohler & Parker 1986: 416; James et al. 2013: 89). Secondly, this method has a tendency to inflate model performance. This follows from the fact that the final model specification is typically evaluated using standard methods that do not take the model tuning process into account. Not accounting for the total number of variables considered, including those that were discarded, breaks the assumptions underlying most standard statistical hypothesis testing and estimation methods, leading to a deflation of p-values and confidence intervals, and an inflation of R2 values and coefficients (Harrell 2015).
However, the term stepwise selection is typically taken to refer to a form of automated model selection that has also seen application in archaeology (e.g. Bevan et al. 2013; Visentin & Carrer 2017; Spencer & Bevan 2018; Wachtel et al. 2018). Here, independent variables are excluded or included in the model at sequential steps that are stopped once a statistic that determines the relative success of the models does not improve. The Akaike and Bayesian information criteria (AIC and BIC, respectively) are the most frequently applied statistics for stepwise model selection in archaeology. Stepwise selection based on AIC and BIC are seen as an improvement over simple minimisation by use of p-values as a stopping criteria, as they take the total number of variables considered into account in the evaluation of the final model. The fundamental strategy of automated stepwise model selection has, however, received considerable criticism (e.g. Henderson & Denison 1989; Derksen & Keselman 1992; Chatfield 1995; Malek, Berger & Coburn 2007; Burnham, Anderson & Huyvaert 2011; Harrell 2015), and the implications of multiple testing and model tuning are more profound and difficult to take account of in a satisfactory way, leading Harrell (2015: 69) to conclude that ‘AIC is just a restatement of the p-value, and as such, doesn’t solve the severe problems with stepwise variable selection other than forcing us to use slightly more sensible α values.’
The most basic model building strategy associated with regression techniques is the forced entry, direct or simultaneous technique, where all independent variables are included from the start, with no consideration of the relative importance, or the order by which the variables should be included (e.g. Stoltzfus 2011). This is typically best suited when there is little reason to hold any a priori assumptions about the nature of these aspects, and is the approach taken here. The main drawback of this approach is the danger of overfitting and including irrelevant variables that only contribute an increase in standard errors.
Given the dramatic increases in computational power over the last decades, iteratively fitting hundreds or even thousands of models has now become tractable. Faced with this, automated model specification through stepwise selection could appear to be one way to handle this flood of information. Furthermore, regression models can offer insight into the complex net of relative and absolute variable importance, the relationship between these, and an estimate of the confidence with which these assertions can be made. But, as shown above, several authors have argued that this potential is lost with the implementation of stepwise model selection. To fully utilise their capacity arguably requires decisive and rigorous implementation of a well-thought-out, thorough and at times time-consuming modelling strategy (e.g. Harrell 2015). It could perhaps be argued that in the face of a fragmented and sparse material such as that frequently encountered in archaeology, a looser and more exploratory modelling procedure is warranted. Woodman and Woodward (2002) have argued the precise opposite. They contend that this uncertainty is precisely where careful modelling is most necessary and beneficial, as this can help both elucidate the nature of the fragmentation and guide an analysis that could otherwise be led astray.
Relevant to this is the delineation that Breiman (2001b) makes between what he terms a data modelling culture and an algorithmic modelling culture in statistics. The data modelling culture is based on an assumption that the data under study represents independent draws from a data-generating process where the value on a response variable follows a stochastic model of the form f (parameters, predictor variables, random noise). The algorithmic modelling culture, on the other hand, only makes the assumption that the data represents independent results of a complex and mostly unknowable underlying multivariate process. The goal is to identify an algorithm that best predicts the outcome of this underlying process. Good prediction indicates a better emulation of the underlying process than a solution that predicts poorly. A normal criticism of this focus is that prediction is not explanation, and that despite predictive success, the algorithms in use are often too impenetrable to contribute much in the way of explanation. Breiman (2001b: 210) states that this dichotomy of interpretability and explanation as opposed to prediction is contrived: ‘The goal is not interpretability, but accurate information’. While regression models can offer a highly interpretable output in the form of coefficients and confidence intervals, they are argued to be easily distorted by resting on assumptions concerning the nature of the underlying distributions that are virtually never met in the analysis of real world phenomena. Additionally, they appear to often be outperformed when it comes to prediction. While the output of machine learning techniques is less interpretable, it is certainly less opaque than the original process under study. Hence, it is argued, they can provide far more reliable and accurate insight, even if this insight holds less detail.
Relatively high predictive power, ease of implementation and its non-parametric nature are among the elements that have led to the popularity of random forests (Hastie, Tibshirani & Friedman 2009: 587–604). Random forest is an ensemble method that leverages the increased predictive power gained from aggregating the results of a large number of de-correlated, high-variance, low-bias decision trees (Breiman 2001a). Decision trees for classification are based on identifying what variables best partition the data into classificatory groups at sequential splits (Baxter 2003: 116–118). At each split the variable to use is decided based on how well the candidate variables partitions the data into the correct groups. The degree of discriminatory success is also termed purity, and is often given by the Gini impurity score, which represents how often a random observation would be labelled incorrectly on the given split. While classification trees are highly interpretable and often perform well in classifying the original training data, they have a tendency towards high variance (Hastie, Tibshirani & Friedman 2017: 312).
To avoid overfitting while reducing the amount of variance, random forest works by combining bootstrap aggregation of the training data with a random selection of predictor variables to be used in the construction of each individual tree (Box 1). Thus, for each tree the training data is first randomly redrawn with replacement, which results in around 2/3 of the original data being evaluated in the training of the entire forest—a process also known as bagging. The remaining 1/3 is known as the out-of-bag (OOB) sample, and can be used for subsequent model validation and variable importance estimates. Following each resampling, a classification tree is grown. For each node in the tree, a random subset of predictors is drawn, and the predictor returning the lowest Gini impurity score is selected at that node split. The number of randomly selected predictors evaluated at each node is recommended to start atfor classification trees, where p is the number of independent variables. The number of variables to be evaluated at each split, the parameter mtry, is then explored during model tuning. As there is no danger of overfitting associated with generating too many trees, the arbitrarily large number of 5000 trees were generated for each forest here. While this came at a computational cost, it meant that only the mtry parameter required tuning.
Box 1: Random forest for classification (modified from Hastie, Tibshirani & Friedman 2017:588)
An important output of random forests is the variable importance estimates that rank the variables based on their ability to correctly classify the input data. Following Parr et al. (2018), variable importance was here found by means of the permutation importance method. This is based on first running the OOB-sample through the final forest to establish the baseline accuracy. Then the column of values for an independent variable is randomly shuffled, and the OOB-sample is run through again. The difference in accuracy between the two runs then gives the variable importance measure. It is crucial to note that these can only be used to evaluate the relative importance of variables, and do not provide estimates of effect size.
Internal model validation was done by means of bootstrap resampling for the logistic regression models (Kvamme 1988; Verhagen 2009). The purpose of applying this method is to replace distributional assumptions and asymptotic results with computationally derived confidence intervals (Fox 2008: 605), and to avoid both fitting and evaluating model performance using the exact same data (Hastie, Tibshirani & Friedman 2017: 249–254). This entailed iteratively resampling the original data and fitting each model 9999 times. For each iteration the coefficients were retrieved, in addition to the Brier score and Area under the receiver operating curve (AUC). The Brier score is a proper accuracy score, meaning that it summarises calibration, the difference between the predicted probability and the observed probability of an outcome, as well as model resolution, the spread of the predictive distribution (Rufibach 2010). The measure ranges from 0 to 1, where 0 represents perfect accuracy. The score is not especially meaningful on its own, however, and is best suited for comparative purposes. The AUC score has a more intuitive interpretation than the Brier score, but only considers the discriminatory abilities of the model (Hosmer, Lemeshow & Sturdivant 2013: 173–182). The AUC ranges from 0 to 1, where 1 represents perfect classification, and 0.5 represents no improvement over random classification. The accuracy scores are reported as the mean result across bootstrap samples. The coefficients were evaluated by means of 95% bootstrap percentile intervals, constituted by the range between the 2.5th and 97.5th percentiles of coefficient values generated across the bootstrap samples (Fox 2008: 595).
Variable importance estimates and model performance measures for the random forests were found using nested k-fold cross-validation instead of the bootstrap (Box 2, and below for the imputation of missing values). The reason for this is that while the logistic regression models were fit using the simultaneous technique, a model tuning step was included for the random forests to identify the optimal number of random variables to be evaluated at each split in the classification trees (the parameter mtry). Single bootstrap resampling results in some overlap between the original data and the resampled observations, meaning tuning and validating with this technique would likely lead to overfitting and overestimation of model performance (Hastie, Tibshirani & Friedman 2017: 250). Basic cross-validation involves randomly splitting the data into k folds, training the model using all but one fold, and then validating the result against the retained fold (Verhagen 2009: 92; Hastie, Tibshirani & Friedman 2017: 241–249). This is then repeated until each fold has been used as the validation set. The nested version of cross-validation entails that for each of these validation steps the folds not retained are split into an additional k folds. Here a complete sweep of possible mtry settings was done for each inner cycle, and the mtry achieving the best performance by means of AUC was returned and used for the current outer fold. The final AUC and Brier scores, as well as variable importance measures are reported as averaged across the outer validation cycle.
Box 2: Nested 5-fold cross-validation of random forests
For each of 5 imputed datasets:
Return mean Brier, AUC and variable importance from imputed datasets.
Below follows a presentation of predefined model parameters and the pre-processing steps that were taken. With the exception of imputation, the response variable was kept out of this process to maintain inferential validity.
Apart from aspect deviating from south, all continuous variables were transformed for the logistic regression models by taking the natural logarithm due to extreme distributions. Continuous variables were then normalised to take on values between 0 and 1 to better facilitate a comparison of the impact of each variable, although at the cost of distorting the interpretability of effect sizes (cf. Spencer & Bevan 2018). In the random forests, the variables were included using raw values. For a second set of models directly comparing the location of sites between the different phases, as opposed to sites and non-sites, all variables with the exception of the binary island/mainland variable were transformed by finding the percentile rank of each site value as compared to the values in the corresponding hull sample. In an attempt to achieve more sensible diachronic comparisons, this adjusted the values by variation in the surrounding landscape as captured by the hull samples for each phase.
There are a host of different methods for identifying and dealing with collinearity (e.g. Dormann et al. 2012; Tomaschek, Hendrix & Baayen 2018). The approach taken here was a relatively straightforward one, where Pearson’s r and Spearman’s ρ was found for each predictor variable pair for each chronological phase. In the case of problematic levels of correlation between predictor variables across all phases (|r| or |ρ| > 0.8), all but one of the correlating variables were removed from analysis. The choice of what variable to retain was based on what variable appeared to best summarise the collinear group in substantive terms (Table 2).
|Location (island/mainland)||loc||0 = island
1 = mainland
|Infiltration ability||infil||Ordinal 1–4|
|Deviation from south||dev_south||Continuous|
|Viewshed 5 km||view_5||Continuous||A: +||view|
|Viewshed 10 km||view_10||Continuous||A: –|
|Emergence 50 m||emerg_50||Continuous||B: +||emerg_shdist|
|Emergence 500 m||emerg_500||Continuous||B & C: –|
|Emergence 1 km||emerg_1k||Continuous||C: +||emerg_lgdist|
Following the lack of previous quantitative studies on which to base this analysis, linearity with the log-odds of the response could not be assumed for any of the predictors in the logistic regression models. To allow for non-linearity, pre-specified natural splines with default quantile knots could have been included (Harrell 2015: 26–28). However, with 104 sites for the EM representing the smallest effective sample size, the inclusion of more than 10 model parameters would likely lead to overfitting, following the most lenient m/10 rule provided by Harrell (2015: 72–73), where m is effective sample size. Consequently, as there were no grounds on which to prioritise among variables to include with splines, none were used. Similarly, due to the large number of possible two-way interaction effects, no interaction terms were included in the models as there were no grounds on which to prioritise among these (cf. Harrell 2015: 36–38).
In total, shoreline emergence was missing for 32 sites and 725 non-sites, while infiltration level was given as unclassified for one site and 138 non-sites. Imputation of these missing values was deemed most appropriate. Unless the number of cases that have missing data is very low, or the values are missing completely at random, which is rarely the case, the alternative of deleting observations can lead to dramatic loss of information and bias in all model estimates (Nakagawa & Freckleton 2008). Imputation for the logistic regression models was done using predictive mean matching (van Buuren & Groothuis-Oudshoorn 2011). This is based on performing ordinary least squares regression on the column with missing values, using the other variables in the data as predictors. From the resulting coefficients a random draw is then made, and these coefficients are used to predict the entire column containing missing values, including those values that are not missing. Each missing value is then given the originally observed value of one of its predicted closest neighbours by a random draw, typically among the five closest cases. This process is then ideally repeated multiple times, and subsequent analysis is based on a pooling of the results from running each imputed dataset through the full analysis. As the imputations done for the logistic regression were to be nested in a bootstrap, a single imputation was performed per bootstrap sample (Brand et al. 2018).
Random forest provides its own method for imputing missing values based on its proximity and classification capabilities (Breiman 2003). This works by first setting the missing values to the average of the column and then growing and running the dataset through a random forest. For each classification tree in the forest, each observation that ends up in the same terminal node as the observation with the missing value is counted as similar. The value to be imputed is then given as the average across the proximal observations, weighted by the number of times they ended up in the same terminal node. This entire process is then repeated using the new values instead of the column average. Here five sequential random forests were grown, with each forest growing 5000 trees. This process was then repeated five times, creating five imputed datasets that each were run through the estimation and validation process described above.
This section presents and examines the results of applying the two disparate quantitative approaches to the data, and the implications these findings have for the Mesolithic settlement patterns in the region. The results from comparing sites and non-sites are given in Figures 5, 6, 7, 8, 9, 10 and the results from comparing the different phases in Figures 12, 13, 14. It is striking that the two different sampling frames for non-sites largely return coinciding results for each phase, and that apart from some minor fluctuations, the random forests and logistic regression models perform about equally well. It is worth repeating that this has not been a controlled and balanced test of their potential performance, not least because the methods were subjected to different validation procedures. Confirming the findings by use of methods with different strength and weaknesses is nonetheless a benefit as this makes the final results more reliable, and in the case of discrepancies, more nuanced. This is especially true as the sample sizes did not allow for much complexity in the logistic regression models.
Moving on to the substantive results, Hosmer, Lemeshow and Sturdivant (2013: 177) state that AUC scores from 0.6–0.8 could generally be taken to indicate poor to acceptable discrimination, which is achieved when comparing sites to non-sites across all results given in Figures 5, 6, 7, 8, 9, 10. This indicates that while the included variables are capturing some amount of patterning associated with the sites, a lot remains unexplained. The two exposure variables are driving most of the achieved results. This is irrespective of phase and whether the samples are from the hull or buffer constraints, and is evident in both variable importance estimates for the random forests and the coefficients of the logistic regression models. This is with the exception of the logistic regression models for the LM, which unlike the corresponding random forests, places more weight on the shoreline emergence variables than the exposure variables. In addition, the viewshed coefficient for the LM is also tending towards positive values, but is not significantly different from zero. The otherwise consistent nature of the relationship between viewshed and fetch length is somewhat surprising, however, where the coefficients indicate that larger view sizes and smaller average fetch lengths characterises the location of the sites. This pattern could consequently speak to a settlement strategy that favours open immediate surroundings and site locations that are sheltered from larger expanses of open sea.
While the only consistently significant variables for the EM is related to the exposure of sites, both the MM and LM sites also have a tendency to be situated in locations with a high degree of variation in shoreline emergence in close proximity around the sites. The LM sites additionally display a tendency to have stable surroundings within the larger of the considered catchments. The most immediate behavioural implication of this result could be that the sites in both phases represent locations from where resources within a short distance were exploited, as this points towards ecological variation in close proximity of the sites. One perspective might also follow from the fact that the shoreline emergence variables are based on a transformation from elevation to year of emergence, which means that they are not entirely divorced from the relief of the local landscape, or possibly bathymetry, depending on if the sites were strictly shore-bound or not. An implication of this finding could consequently be that the variation in the immediate proximity of the MM and LM sites is related to good fishing grounds (Darmark, Viken & Johannessen 2018). The relevance of the significantly stable wider catchments in the LM could then be that this stability reflects a more predictable pattern for the exploitation of flora and fauna. As bathymetry is not treated here, a possible increase in the relevance of bathymetric variation in the MM and LM has to be left as a suggestion, however, and the nature of the apparent relevance of shoreline emergence as a whole could clearly benefit from being evaluated while also considering bathymetric and topographic variation directly.
For the second set of models that compares the location of sites across phases, the island variables drove most of the result due to the fact that the number of islands in the study area has varied dramatically throughout the Mesolithic (Figure 11). The island variables were therefore included in the models to control for their effect, but left out of the plots to make the comparison of the smaller effect sizes of the remaining variables discernable. In addition, the accuracy scores are given as the accuracy achieved by the two island variables subtracted from the accuracy achieved by the full model. The few significant coefficients in these models have minute effect sizes and the variables apart from the island variables only contribute minute changes in the accuracy scores. This indicates that the settlement patterns, excluding the island variables, largely coincide across all phases. Furthermore, following the logistic regression models comparing sites to non-sites, only sites from the MM appear to have a consistently significant propensity towards being situated with respect to islands, where these have been slightly favoured, and sites have a higher tendency to be situated on smaller islands than could be expected by chance (Figures 7 and 8). The corresponding random forests do not place as much emphasis on the island variables, which might be caused by collinearity leading their importance to be split between the two variables. The impact of the island variables is, however, relatively small even when combined, which could indicate that even though significant in the logistic regression models, they might not have been of a huge importance in the MM (see also Figure 11).
A shift from a resource base focused on the hunting of sea mammals towards a wider subsistence spectrum that includes the regular exploitation of ungulates, birds, shellfish and especially an intensification of fishing is a gradual development commonly believed to characterise the Norwegian Stone Age (Breivik 2014; Bjerck et al. 2016; Ritchie, Hufthammer & Bergsvik 2016; Jørgensen 2020; Mjærum & Mansrud 2020). Furthermore, a transition to a more diverse marine economy centred around fishing has been argued to have major implications for the mobility patterns and settlement strategies of coastal hunter-gatherers, where such a shift could indicate a decrease in mobility (see above and Boethius 2017; Boethius & Ahlström 2018). The location of MM and LM sites with respect to variation in shoreline emergence, as identified in this study, could therefore be consistent with economic diversification and a decrease in mobility. However, the negligible performance measures and effect sizes in the comparison between phases given in Figures 12, 13, 14 do not allow for the conclusion that the settlement patterns underwent any consequential changes between the three considered phases. In addition, the models comparing sites and non-sites indicate that location relative to exposure has for the most part been more important than the shoreline emergence variables. Furthermore, the effect sizes for the two exposure variables are comparable across all phases, and in the comparison between phases these variables have a relatively steady impact around zero, indicating that site location with respect to exposure has been similar in all phases. Thus, if degree of site exposure is taken to be a reflection of the economic basis for settlement, as has been proposed (e.g. Bjerck 2009; Breivik 2014), the patterns discerned here would indicate a stable subsistence base throughout the Mesolithic. An alternative explanation to the apparent stability in settlement patterns could of course also be that these might simply not be sensitive to changes in the subsistence patterns of coastal hunter-fisher-gatherers in the archipelago environment of south-eastern Norway, and that this setting demanded that settlement patterns take on a distinct form, irrespective of variation along other social and cultural dimensions. One possible reason for this could perhaps follow from a dependency on boating that this landscape is likely to have represented (e.g. Bjerck 2008; Glørstad 2013). This might, in turn, have constrained the variation space available for locational strategies. It is, however, important to underscore that the limited performance of the models do mean that while no conclusion of clear diachronic difference can be drawn, this does not mean that the settlement patterns were necessarily the same—a considerable amount of variation does remain unaccounted for.
This study was aimed at elucidating general settlement patterns among coastal sites from the Mesolithic of south-eastern Norway through statistical modelling and algorithmic classification. Although many of employed procedures followed from idiosyncrasies in the analysed data, presenting the modelling rationale and execution in some detail allowed for the demonstration of some concrete techniques with wider applicability, and hopefully contributes to an increased awareness of the necessity of employing thorough and conscious modelling strategies in archaeological research. Given the lack of previous quantitative investigations on which to base this study, few assumptions could be made concerning the nature of the inter-relationship between independent variables and their relationship with the dependent variable. This put substantial pressure on the modelling procedures associated with the logistic regression models. This follows from the fact that while these aspects can have a large effect on the final models, their elucidation has to be balanced with a concern for the potentially adverse effects of model tuning and so-called data dredging that might undermine any findings. While an attempt at navigating this modelling process as best as possible was made, it was therefore also decided to apply the non-parametric machine learning method of random forest. Random forest provided a robust, although less informative output with which to compare the more nuanced, but sensitive results of logistic regression. However, given the similar performance of the two methods, as applied in this context, logistic regression should be given preference in the choice between the two due to its probabilistic and more informative output.
The main substantive contribution of the study pertains to the discerned tendency for sites to be situated with open immediate surroundings and shelter from larger expanses of open sea, as well as the failure to identify any major diachronic differences in the locational patterns as a whole. While this final point is not a robust finding given some fluctuations in the shoreline emergence variables and the overall limited model performances, it is nonetheless an indication that the clear changes in settlement patterns suggested to take place by earlier studies might have been exaggerated. This is given further support by the fact that site exposure has been emphasised as one of the major ways in which locational patterns are to have varied throughout the Norwegian Mesolithic (e.g. Lindblom 1984; Jaksland 2001; Bjerck 2008; Breivik 2014; Breivik, Fossum & Solheim 2018). This variation has not been identified for the sites treated here. Taking a cue from Åstveit (2014), this might suggest that a sensible point of departure in the study of these societies would be to consider them hunter-fisher-gatherers societies, and to explicitly assume a null-hypothesis of no temporal difference. This would help counteract influence from any implicit assumption of a societal development that follows a linear trend-line moving towards ever increasing degrees of sedentism and societal complexity.
Finally, it is worth noting that the chronological phases have here been treated with no consideration of the stability or homogeneity of patterns within the individual phases, nor the nature of the transition between these. While it was possible to identify some patterns employing this framework, it is not given that these represent the best chronological categories for the aggregation of the sites (Reitan 2016). Similarly, no consideration of potential spatial variation has been considered, nor any discrepancies associated with different site types. These dimensions are likely to hold variation not discerned here, and as such represent clear candidates for further analysis. Nonetheless, as long as the scale and assumptions underlying the results are kept in mind when they are being interpreted, the coarser perspective and adherence to an established chronological framework arguably constitutes a reasonable starting point in the analysis of a material that has not been subject to formal quantitative treatment in the past.
This paper is based on my dissertation for the degree of MSc Computational Archaeology: GIS, Data Science and Complexity at University College London, written under the invaluable supervision of Mark Lake. In addition, the paper was developed within the international research network ‘Coast-inland dynamics in prehistoric hunter-gatherer societies’ (PrehCOAST), which has been a great arena for exploring ideas presented in the paper. Thanks also to Steinar Solheim who provided very helpful comments on an earlier draft, as well as to the two anonymous reviewers who provided insightful and thorough comments that helped improve the manuscript greatly. All errors and deficiencies remain entirely my own.
The author has no competing interests to declare.
Bang-Andersen, S. 2012. Colonizing contrasting landscapes. the pioneer coast settlement and inland utilization in southern Norway 10,000–9500 years before present. Oxford Journal of Archaeology, 31(2): 103–120. DOI: https://doi.org/10.1111/j.1468-0092.2012.00381.x
Bekkby, T, Isachsen, PE, Isæus, M and Bakkestuen, V. 2008. GIS modeling of wave exposure at the seabed: a depth-attenuated wave exposure model. Marine Geodesy, 31(2): 117–127. DOI: https://doi.org/10.1080/01490410802053674
Bevan, A, Crema, E, Li, X and Palmisano, A. 2013. Intensities, interactions, and uncertainties: some new approaches to archaeological distributions. In: Bevan, A and Lake, M (eds.) Computational approaches to archaeological spaces. Walnut Creek: Left Coast Press, pp. 27–52.
Bjerck, HB. 2009. Colonizing seascapes: comparative perspectives on the development of maritime relations in Scandinavia and Patagonia. Arctic Anthropology, 46(1–2): 118–131. DOI: https://doi.org/10.1353/arc.0.0019
Bjerck, HB. 2017. Settlements and seafaring: Reections on the integration of boats and settlements among marine foragers in Early Mesolithic Norway and the Yámana of Tierra del Fuego. The Journal of Island and Coastal Archaeology, 12(2): 276–299. DOI: https://doi.org/10.1080/15564894.2016.1190425
Bjerck, HB, Breivik, HM, Piana, EL and Zangrando, JFA. 2016. Exploring the role of pinnipeds in the human colonization of the seascapes of Patagonia and Scandinavia. In: Bjerck, HB, Breivik, HM, Fretheim, SE, Piana, EL, Skar, B, Tivoli, AM and Zangrando, JFA (eds.) Marine Ventures: Archaeological Perspectives on Human-Sea Relations. Sheffield: Equinox Publishing, pp. 53–73.
Bjerck, HB and Zangrando, AF. 2013. Marine ventures: Comparative perspectives on the dynamics of early human approaches to the seascapes of Tierra del Fuego and Norway. The Journal of Island and Coastal Archaeology, 8(1): 79–90. DOI: https://doi.org/10.1080/15564894.2012.756083
Boethius, A. 2017. Signals of sedentism: Faunal exploitation as evidence of a delayed-return economy at Norje Sunnansund, an Early Mesolithic site in south-eastern Sweden. Quaternary Science Reviews, 162: 145–168. DOI: https://doi.org/10.1016/j.quascirev.2017.02.024
Boethius, A and Ahlström, T. 2018. Fish and resilience among Early Holocene foragers of southern Scandinavia: A fusion of stable isotopes and zooarchaeology through Bayesian mixing modelling. Journal of Archaeological Science, 93: 196–210. DOI: https://doi.org/10.1016/j.jas.2018.02.018
Brand, J, van Buuren, S, le Cessie, S and van den Hout, W. 2018. Combining multiple imputation and bootstrap in the analysis of cost-effectiveness trial data. Statistics in Medicine, 38(2): 210–220. DOI: https://doi.org/10.1002/sim.7956
Breiman, L. 2001a. Random forests. Machine learning, 45(1): 5–32. DOI: https://doi.org/10.1023/A:1010933404324
Breiman, L. 2001b. Statistical modeling: The two cultures. Statistical Science, 16(3): 199–231. DOI: https://doi.org/10.1214/ss/1009213726
Breiman, L. 2003. Manual – setting up, using, and understanding random forests V4. 0. 2003. Available at: https://www.stat.berkeley.edu/~breiman/papers.html [Last accessed 20 October 2020].
Breivik, HM. 2014. Palaeo-oceanographic development and human adaptive strategies in the Pleistocene-Holocene transition: A study from the Norwegian coast. The Holocene, 24(11): 1478–1490. DOI: https://doi.org/10.1177/0959683614544061
Breivik, HM, Fossum, G and Solheim, S. 2018. Exploring human responses to climatic uctuations and environmental diversity: Two stories from Mesolithic Norway. Quaternary International, 465: 258–275. DOI: https://doi.org/10.1016/j.quaint.2016.12.019
Burnham, KP, Anderson, DR and Huyvaert, KP. 2011. AIC model selection and multimodel inference in behavioral ecology: some background, observations, and comparisons. Behavioral Ecology and Sociobiology, 65(1): 23–35. DOI: https://doi.org/10.1007/s00265-010-1029-6
Burrows, MT, Harvey, R and Robb, L. 2008. Wave exposure indices from digital coastlines and the prediction of rocky shore community structure. Marine Ecology Progress Series, 353: 1–12. DOI: https://doi.org/10.3354/meps07284
Chatfield, C. 1995. Model uncertainty, data mining and statistical inference. Journal of the Royal Statistical Society: Series A (Statistics in Society), 158(3): 419–444. DOI: https://doi.org/10.2307/2983440
Conolly, J and Lake, M. 2006. Geographical Information Systems in Archaeology. Cambridge: Cambridge University Press. DOI: https://doi.org/10.1017/CBO9780511807459
Damlien, H and Solheim, S. 2017. The pioneer settlement of eastern Norway. In: Blankholm, HP (ed.) Early Economy and Settlement in Northern Europe. Pioneering, Resource Use, Coping with Change. Sheffield: Equinox Publishing, pp. 335–367.
Darmark, K, Viken, S and Johannessen, LS. 2018. A good place. Stone Age locations in southern Norway: A diachronic GIS approach. In: Reitan, G and Sundström, L (eds.) Kystens steinalder i Aust-Agder: Arkeologiske undersøkelser i forbindelse med ny E18 Tvedestrand-Arendal. Oslo: Cappelen Damm Akademisk, pp. 5–16. DOI: https://doi.org/10.23865/noasp.50
Derksen, S and Keselman, HJ. 1992. Backward, forward and stepwise automated subset selection algorithms: Frequency of obtaining authentic and noise variables. British Journal of Mathematical and Statistical Psychology, 45(2): 265–282. DOI: https://doi.org/10.1111/j.2044-8317.1992.tb00992.x
Dormann, CF, Elith, J, Bacher, S, Buchmann, C, Carl, G, Carré, G, Marquéz, JRG, Gruber, B, Lafourcade, B, Leitão, PJ, Münkemüller, T, McClean, C, Osborne, PE, Reineking, B, Schröder, B, Skidmore, AK, Zurell, D and Lautenbach, S. 2012. Collinearity: a review of methods to deal with it and a simulation study evaluating their performance. Ecography, 36(1): 27–46. DOI: https://doi.org/10.1111/j.1600-0587.2012.07348.x
Duncan, RB and Beckman, KA. 2000. The application of GIS predictive site location models within Pennsylvania and West Virginia. In: Wescott, KL and Brandon, RJ (eds.) Practical Applications of GIS for Archaeologists: A Predictive Modeling Kit. London: Taylor & Francis, pp. 33–58. DOI: https://doi.org/10.1201/b16822-4
Ekebom, J, Laihonen, P and Suominen, T. 2003. A GIS-based step-wise procedure for assessing physical exposure in fragmented archipelagos. Estuarine, Coastal and Shelf Science, 57(5–6): 887–898. DOI: https://doi.org/10.1016/S0272-7714(02)00419-5
Fisher, P, Farrelly, C, Maddocks, A and Ruggles, C. 1997. Spatial analysis of visible areas from the Bronze Age cairns of Mull. Journal of Archaeological Science, 24(7): 581–592. DOI: https://doi.org/10.1006/jasc.1996.0142
Fuglestvedt, I. 2012. The pioneer condition on the Scandinavian Peninsula: the last frontier of a ‘Palaeolithic way’ in Europe. Norwegian Archaeological Review, 45(1): 1–29. DOI: https://doi.org/10.1080/00293652.2012.669998
Garcia, A. 2013. GIS-based methodology for Palaeolithic site location preferences analysis. A case study from Late Palaeolithic Cantabria (Northern Iberian Peninsula). Journal of Archaeological Science, 40(1): 217–226. DOI: https://doi.org/10.1016/j.jas.2012.08.023
Geological Survey of Norway. 2015. Produktspesifikasjon: ND_løsmasser, versjon 3.0. Available at: https://www.ngu.no/en/topic/datasets [Last accessed 20 October 2020].
Gillings, M and Wheatley, D. 2020. GIS-based visibility analysis. In: Gillings, M, Hacıgüzeller, P and Lock, G (eds.) Archaeological Spatial Analysis: A Methodological Guide. London & New York: Routledge, pp. 313–332. DOI: https://doi.org/10.4324/9781351243858-17
Glørstad, H. 2009. The northern province? The neolithisation of southern Norway. In: Glørstad, H and Prescott, C (eds.) Neolithisation as if history mattered. Processes of Neolithisation in North-Western Europe. Gothenburg: Bricoleur Press, pp. 135–168.
Glørstad, H. 2013. Where are the missing boats? The pioneer settlement of Norway as long-term history. Norwegian Archaeological Review, 46(1): 57–80. DOI: https://doi.org/10.1080/00293652.2013.777095
Harrell, FE. 2015. Regression modeling strategies: with applications to linear models, logistic and ordinal regression, and survival analysis. 2nd ed. New York: Springer. DOI: https://doi.org/10.1007/978-3-319-19425-7
Hastie, T, Tibshirani, R and Friedman, J. 2017. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. 2nd ed. New York: Springer. DOI: https://doi.org/10.1007/978-0-387-84858-7
Henderson, DA and Denison, DR. 1989. Stepwise regression in social and psychological research. Psychological Reports, 64(1): 251–257. DOI: https://doi.org/10.2466/pr0.19126.96.36.199
Hill, NA, Pepper, AR, Puotinen, ML, Hughes, MG, Edgar, GJ, Barrett, NS, Stuart-Smith, RD and Leaper, R. 2010. Quantifying wave exposure in shallow temperate reef systems: applicability of fetch models for predicting algal biodiversity. Marine Ecology Progress Series, 417: 83–95. DOI: https://doi.org/10.3354/meps08815
Hosmer, DW, Lemeshow, S and Sturdivant, RX. 2013. Applied logistic regression. 3rd ed. John Wiley & Sons. DOI: https://doi.org/10.1002/9781118548387
James, G, Witten, D, Hastie, T and Tibshirani, R. 2013. An Introduction to Statistical Learning: with Applications in R. New York: Springer. DOI: https://doi.org/10.1007/978-1-4614-7138-7
Jørgensen, EK. 2020. Scalar effects in ground slate technology and the adaptive consequences for circumpolar maritime hunter-gatherers. Journal of Archaeological Method and Theory, 2020. DOI: https://doi.org/10.1007/s10816-020-09463-w
Kohler, TA and Parker, SC. 1986. Predictive models for archaeological resource location. In: Schiffer, MB (ed.) Advances in archaeological method and theory, vol. 9. New York: Academic Press, pp. 397–452. DOI: https://doi.org/10.1016/B978-0-12-003109-2.50011-8
Kvamme, KL. 1988. Development and testing of quantitative models. In: Judge, JW and Sebastian, L (eds.) Quantifying the present and predicting the past: theory, method, and application of archaeological predictive modelling. Denver: US Department of the Interior, Bureau of Land Management, pp. 325–428.
Kvamme, KL. 2020. Analysing regional environmental relationships. In: Gillings, M, Hacıgüzeller, P and Lock, G (eds.) Archaeological Spatial Analysis: A Methodological Guide. London & New York: Routledge, pp. 212–230. DOI: https://doi.org/10.4324/9781351243858-12
Kvamme, KL and Jochim, MA. 1989. The environmental basis of Mesolithic settlement. In: Bonsall, C (ed.) The Mesolithic in Europe. Papers presented at the third international symposium, Edinburgh 1985. Edinburgh: John Donald, pp. 1–12.
Lake, M and Woodman, PE. 2000. Viewshed analysis of site location on Islay. In: Mithen, S (ed.) Hunter-Gatherer Landscape Archaeology: The Southern Hebrides Mesolithic Project 1988–98. Vol. 2: Archaeological fieldwork on Colonsay, computer modelling, experimental archaeology, and final interpretations. Cambridge: McDonald Institute for Archaeological Research, pp. 497–503.
Lopez-Romero, EGdlA. 2008. Characterizing the evolution of visual landscapes in the late prehistory of south-west Morbihan (Brittany, France). Oxford Journal of Archaeology, 27(3): 217–239. DOI: https://doi.org/10.1111/j.1468-0092.2008.00305.x
Malek, MH, Berger, DE and Coburn, JW. 2007. On the inappropriateness of stepwise regression analysis for model building and testing. European Journal of Applied Physiology, 101(2): 263–264. DOI: https://doi.org/10.1007/s00421-007-0485-9
Malhotra, A and Fonseca, MS. 2007. WEMo (Wave Exposure Model): formulation, procedures and validation. NOAA Technical Memorandum NOS NCCOS #65. Beaufort, North Carolina: National Ocean Service of the National Oceanic and Atmospheric Administration.
Melvold, S and Persson, P. (eds.) 2014. Vestfoldbaneprosjektet – Arkeologiske undersøkelser i forbindelse med ny jernbane mellom Larvik og Porsgrunn. Bind 1. Oslo: Museum of Cultural History, University of Oslo. DOI: https://doi.org/10.23865/noasp.61
Mjærum, A and Mansrud, A. 2020. Resource management in Late Mesolithic Eastern Norway? Fishing in the coastal, interior and mountain areas and its socio-economic implications. In: Schülke, A (ed.) Coastal Landscapes of the Mesolithic, Human engagement with the coast from the Atlantic to the Baltic sea. London & New York: Routledge, pp. 264–299. DOI: https://doi.org/10.4324/9780203730942-14
Nakagawa, S and Freckleton, RP. 2008. Missing inaction: the dangers of ignoring missing data. Trends in Ecology & Evolution, 23(11): 592–596. DOI: https://doi.org/10.1016/j.tree.2008.06.014
Nielsen, SV, Åkerstrøm, J, Stokke, JSF and Eskeland, KF. 2016. Quartz utilization along the coast of southern Norway: Results from a Stone Age survey in Aust-Agder. In: Bjerck, HB, Breivik, HM, Fretheim, E, Piana, B, Skar, A, Tivoli, A and Zangrando, AFJ (eds.) Marine Ventures: Archaeological Perspectives on Human-Sea Relations. Sheffield: Equinox Publishing, pp. 367–381.
Nitter, M and Coolen, J. 2018. Any way the wind blows… Wind fetch as a determinant factor of the quality of landing sites. In: von Carnap-Bornheim, C, Daim, F, Ettel, P and Warnke, U (eds.) Harbours as objects of interdisciplinary research – archaeology + history + geosciences. Mainz: Verlag des Römisch-Germanischen Zentralmuseums, pp. 45–56.
Nitter, M, Elvestad, E and Selsing, L. 2013. Maritime site protection and the fetch method: an example from Rogaland, Norway. International Journal of Nautical Archaeology, 42(1): 87–102. DOI: https://doi.org/10.1111/j.1095-9270.2012.00365.x
Norwegian Directorate for Cultural Heritage. 2018. Askeladden versjon 3.0 brukerveiledning. Available at: https://www.riksantikvaren.no/veileder/askeladden-versjon-3-0-brukerveiledning/ [Last accessed 20 October 2020].
Parr, T, Turgutlu, K, Csiszar, C and Howard, J. 2018. Beware default Random forest importances. Available at: https://explained.ai/rfimportance/index.html [Last accessed 20 October 2020].
Reitan, G. 2016. Mesolittisk kronologi i Sørøst-Norge—et forslag til justering. Viking, 79: 23–51. DOI: https://doi.org/10.5617/viking.3903
Reitan, G and Persson, P. (eds.) 2014. Vestfoldbaneprosjektet-Arkeologiske undersøkelser i forbindelse med ny jernbane mellom Larvik og Porsgrunn. Bind 2. Oslo: Museum of Cultural History, University of Oslo. DOI: https://doi.org/10.23865/noasp.62
Ritchie, K, Hufthammer, AK and Bergsvik, KA. 2016. Fjord fishing in Mesolithic Western Norway. Environmental Archaeology, 21(4): 309–316. DOI: https://doi.org/10.1080/14614103.2015.1118212
Rufibach, K. 2010. Use of Brier score to assess binary predictions. Journal of Clinical Epidemiology, 63(8): 938–939. DOI: https://doi.org/10.1016/j.jclinepi.2009.11.009
Schmitt, L. 2015. Early colonization, glacial melt water, and island mass effect in the archipelago of Western Sweden: A case history. Oxford Journal of Archaeology, 34(2): 109–117. DOI: https://doi.org/10.1111/ojoa.12051
Solheim, S. (ed.) 2017. E18 Rugtvedt-Dørdal. Arkeologiske undersøkelser av lokaliteter fra steinalder og jernalder i Bamble kommune, Telemark fylke. Oslo: Museum of Cultural History, University of Oslo. DOI: https://doi.org/10.23865/noasp.58
Solheim, S. 2020. Mesolithic coastal landscapes. Demography, settlement patterns and subsistence economy in southeastern Norway. In: Schülke, A (ed.) Coastal Landscapes of the Mesolithic, Human engagement with the coast from the Atlantic to the Baltic sea. London & New York: Routledge, pp. 44–72. DOI: https://doi.org/10.4324/9780203730942-4
Solheim, S and Damlien, H. (eds.) 2013. E18 Bommestad-Sky. Undersøkelser av lokaliteter fra mellommesolitikum, Larvik kommune, Vestfold fylke. Oslo: Museum of Cultural History, University of Oslo. DOI: https://doi.org/10.23865/noasp.53
Solheim, S and Persson, P. 2016. Marine adaptation in the Middle Mesolithic of south-eastern Norway. In: Bjerck, HB, Breivik, HM, Fretheim, E, Piana, B, Skar, A, Tivoli, A and Zangrando, AFJ (eds.) Marine Ventures: Archaeological Perspectives on Human-Sea Relations. Sheffield: Equinox Publishing, pp. 255–270.
Sørensen, R, Henningsmoen, KE, Høeg, H and Gälman, V. 2014. Holocene landhevningsstudier i søndre Vestfold og sørøstre Telemark – revidert kurve. In: Vestfoldbaneprosjektet. Arkeologiske undersøkelser i forbind-else med ny jernbane mellom Larvik og Porsgrunn kommune. Bind 1. Oslo: Museum of Cultural History, University of Oslo, pp. 236–247. DOI: https://doi.org/10.23865/noasp.61
Spencer, C and Bevan, A. 2018. Settlement location models, archaeological survey data and social change in Bronze Age Crete. Journal of Anthropological Archaeology, 52: 71–86. DOI: https://doi.org/10.1016/j.jaa.2018.09.001
Stančič, Z and Veljanovski, T. 2000. Understanding Roman settlement patterns through multivariate statistics and predictive modelling. In: Lock, G (ed.) Beyond the Map: Archaeology and Spatial Technologies. Amsterdam: IOS Press, pp. 147–156.
Stoltzfus, JC. 2011. Logistic regression: a brief primer. Academic Emergency Medicine, 18(10): 1099–1104. DOI: https://doi.org/10.1111/j.1553-2712.2011.01185.x
Sundblad, G, Bekkby, T, Isæus, M, Nikolopoulos, A, Norderhaug, K and Rinde, E. 2014. Comparing the ecological relevance of four wave exposure models. Estuarine, Coastal and Shelf Science, 140: 7–13. DOI: https://doi.org/10.1016/j.ecss.2014.01.008
Tolvanen, H and Suominen, T. 2005. Quantification of openness and wave activity in archipelago environments. Estuarine, Coastal and Shelf Science, 64(2–3): 436–446. DOI: https://doi.org/10.1016/j.ecss.2005.03.001
Tomaschek, F, Hendrix, P and Baayen, RH. 2018. Strategies for addressing collinearity in multivariate linguistic data. Journal of Phonetics, 71: 249–267. DOI: https://doi.org/10.1016/j.wocn.2018.09.004
van Buuren, S and Groothuis-Oudshoorn, K. 2011. mice: Multivariate imputation by chained equations in R. Journal of Statistical Software, 45(3): 1–67. DOI: https://doi.org/10.18637/jss.v045.i03
Verhagen, P. 2009. Predictive models put to the test. In: Kamermans, H, van Leusen, M and Verhagen, P (eds.) Archaeological Prediction and Risk Management. Alternatives to Current Practice. Leiden: Leiden University Press, pp. 71–122.
Verhagen, P and Whitley, TG. 2012. Integrating archaeological theory and predictive modelling: A live report from the scene. Journal of Archaeological Method and Theory, 19(1): 49–100. DOI: https://doi.org/10.1007/s10816-011-9102-7
Verhagen, P and Whitley, TG. 2020. Predictive spatial modelling. In: Gillings, M, Hacıgüzeller, P and Lock, G (eds.) Archaeological Spatial Analysis: A Methodological Guide. London & New York: Routledge, pp. 231–246. DOI: https://doi.org/10.4324/9781351243858-13
Visentin, D and Carrer, F. 2017. Evaluating Mesolithic settlement patterns in mountain environments (Dolomites, Eastern Italian Alps): the role of research biases and locational strategies. Archeologia e Calcolatori, 28(1): 129–154.
Wachtel, I, Zidon, R, Garti, S and Shelach-Lavi, G. 2018. Predictive modeling for archaeological site locations: Comparing logistic regression and maximal entropy in north Israel and north-east China. Journal of Archaeological Science, 92: 28–36. DOI: https://doi.org/10.1016/j.jas.2018.02.001
Warren, RE and Asch, DL. 2000. A predictive model of archaeological site location in the Eastern Prairie Peninsula. In: Wescott, KL and Brandon, JR (eds.) Practical applications of GIS for archaeologists: a predictive modeling kit. London: Taylor & Francis, pp. 5–32. DOI: https://doi.org/10.1201/b16822-3
Woodman, PE and Woodward, M. 2002. The use and abuse of statistical methods in archaeological site location modelling. In: Wheatley, D, Earl, G and Poppy, S (eds.) Contemporary themes in archaeological computing. Oxford: Oxbow, pp. 39–43.
Wren, CD, Costopoulos, A and Hawley, M. 2020. Settlement choice under conditions of rapid shoreline displacement in Wemindji Cree Territory, subarctic Quebec. Quaternary International, 549: 191–196. DOI: https://doi.org/10.1016/j.quaint.2018.05.049