Participatory surface algal bloom monitoring in Finland in 2011–2013
© Kotovirta et al.; licensee Springer. 2014
Received: 20 July 2014
Accepted: 19 November 2014
Published: 2 December 2014
Algal mass occurrences are one of the most distinguishing effects of eutrophication in lakes and the coastal waters of the Baltic Sea. Algal bloom occurrence in water bodies varies greatly in terms of both space and time, even during short periods, which makes reliable monitoring of blooms difficult. In this paper, we explore the possibilities to extend the sensor network both spatially and temporally by applying participatory sensing to surface algal bloom monitoring in Finnish lakes and the coastal areas of the Baltic Sea.
Two participatory sensing systems were used to collect visual algae observations by citizens: the mobile phone application Levävahti (Algae Watch) and the collaborative web service Järviwiki (Lake wiki), during the summers of 2011–2013. Citizen observations were compared with the visual observations performed by trained expert observers, and mean correlations between citizen and expert observations were calculated using the bootstrapping method: 0.72, 95% confidence interval (CI) [0.53 0.86]; 0.65, 95% CI [0.35 0.86]; and 0.56, 95% CI [0.29 0.76] for the years 2011, 2012 and 2013.
Surface algal bloom monitoring is needed to obtain data on algal bloom frequency and intensity, in particular in lakes where the use of satellite remote sensing has limitations and/or phytoplankton monitoring is infrequent or totally lacking. The correlations between expert and citizen observations suggest that citizen observers can provide additional information to support algal bloom monitoring of inland and coastal waters.
Algal bloom monitoring
Algal mass occurrences, in particular cyanobacterial surface blooms, are one of the most distinguishing effects of eutrophication in lakes and the coastal waters of the Baltic Sea (Solimini et al. ). It is therefore logical that the frequency and intensity of cyanobacterial blooms are used in the assessment of the ecological status of surface water bodies in Europe under the European Water Framework Directive (European Commission ; Carvalho et al. ). Algal bloom occurrence in water bodies varies greatly in terms of both space and time, even during short periods, which makes reliable monitoring of blooms difficult. Traditional manual monitoring with biweekly to monthly or longer sampling frequency easily leads to situations in which not all bloom events can be detected. Remote sensing of algal mass occurrences by satellites can provide high temporal and spatial resolution bloom information of sea areas (e.g. Reinart and Kutser ). Monitoring of small water bodies by satellite remote sensing requires images with a good spatial resolution (<30 m). At present, such images are not operationally available on a daily basis. One possible way to increase information on cyanobacterial surface bloom situations is to conduct visual observations of blooms by trained observers at fixed observation sites and periods, a method that has been used in Finland since 1998 to estimate average weekly surface bloom situations (Rapala et al. ). Although these results cannot at present be used as a bloom metric to assess ecological status, due to a lack of reference conditions and class boundary values, they can be used to support classification decisions by expert judgement (Aroviita et al. ). Due to the large number of lakes in Finland (>188 000 with a surface area of >5 acres), visual observations by trained observers are restricted to a rather limited set of lakes.
One possible way to increase both temporal and spatial coverage of surface bloom visual observations in a larger number of lakes and the coastal regions of the Baltic Sea is to include citizens as observers. This has already started in Finland, but the applicability of the observations made by citizens has not been verified before.
Citizen science and participatory sensing
Citizen contributions to environmental monitoring are increasing (Conrad and Hilchey ). This is part of a broader emerging field of citizen science in which citizens produce scientifically meaningful observations or analyses (Haklay ). Citizen science has been successfully applied to ecological research, e.g. for monitoring birds, insects and invasive plants (Dickinson et al. ), and citizens have been involved in environmental monitoring, to some extent, for over a hundred years (e.g. the Christmas Bird Watch, started by ornithologists of North America, has been ongoing since 1900, Haklay ).
Recent advances in information and communication technology (ICT) and increased awareness of the status of the environment, in particular global climate change, have activated people even more to participate in monitoring (Burke et al. ). Mobile devices with GPS receivers provide a useful platform for collecting data about the environment. Citizens can provide observations actively themselves (i.e. participatory sensing), enable their mobile devices to collect data automatically (i.e. opportunistic sensing, Lane et al. ) and analyse or discuss the data or the environmental conditions using proprietary software or social media tools such as Facebook, Google+ and Twitter.
Methods for participatory and opportunistic citizen sensing have been presented for various applications and in various forms. Eiman () presented a method for mapping noise levels in a city area, while Paxton and Benford () described a study in which CO2 level measurements were observed with a handheld device and combined with written observations and video clips. Mednis et al. () developed a system for road irregularity detection using data from accelerometers of mobile phones.
Citizen sensing has been applied to hydrology, and, e.g., Olmanson et al. () used citizen Secchi depth measurements as in-situ data source for satellite image calibration, Sunyoung et al. () developed a mobile application (Creek Watch) for citizens to monitor waterways (amount of water, rate of flow and amount of litter), Lowry and Fienen () presented a method for stream stage monitoring in which citizen passers-by make observation using fixed measuring devices, Toivanen et al. () presented a method for observing Secchi depth and turbidity using an inexpensive measurement device and a mobile phone camera, and Leeuw and Boss () developed the HydroColor app which estimates the concentration of total suspended matter and the backscattering coefficient from water reflectance measured by a mobile phone camera. The European Environment Agency published the Marine LitterWatch mobile phone-based app (http://www.eea.europa.eu/themes/coast_sea/marine-litterwatch) in 2013 to involve citizens in the monitoring of marine litter distribution and composition. The app was specifically developed for the needs of the EU’s Marine Strategy Framework Directive.
Suggested architectures and platforms for more generic participatory sensing include G-Sense (Perez et al. ), PRISM (Platform for Remote Sensing using Smartphones) (Das et al. ), the personal environmental impact report PEIR (Mun et al. ) and the EnviObserver participatory sensing system (Kotovirta et al. ).
Focus of this paper
In this paper we discuss the results of applying participatory sensing to surface algal bloom monitoring in Finnish lakes and the coastal areas of the Baltic Sea during the summers of 2011, 2012 and 2013. The hypothesis is that voluntary citizen monitoring can extend the existing sensor and observation networks both spatially and temporally and provide useful information about cyanobacterial bloom coverage. We compared the citizen observations with weekly observations made by trained experts and found a clear correlation between the bloom intensity averages, supporting our hypothesis.
Number of observations
Yearly counts and correlations
Correlation of original datasets
Mean of bootstrap correlations
Citizen spatial correlation
Citizen count correlation
The number of volunteer citizen observations was highest in the summer of 2011. This probably resulted from a worse surface algal bloom situation (i.e. more surface blooms) in 2011 than in subsequent years, which probably made citizens more eager to make observations. The overall algal bloom intensity was estimated by taking the average value of all the expert observations, which was 0.21 for the summer of 2011, 0.15 for the summer of 2012 and 0.19 for the summer of 2013. These correlate with the total number of citizen observations (831, 303 and 443).
Every year during the test period, the citizen activity tends to decrease towards the end of the summer, although the bloom events have not yet decreased markedly. This drop in observation activity may be explained by the summer holiday season in Finland, which commonly starts in mid-summer and lasts until the beginning of August, i.e. weeks 25 to 31. There are more potential citizen observers near waters (e.g. through boating, water sports, active use of summer cottages) in the middle of the holiday season.
In addition to the surface bloom situation and holiday season, other factors are likely to influence the observer activity. We published invitations to participate in the pilot study in local and national news services and at water-related events and exhibitions at the beginning of the summer algal growth season in Finland, but we did not follow up how well the message was received by potential users. We did not require any registration for the mobile part of the system, which makes the adoption of the system easier, but, at the same time, it makes the analysis in detail of the user activity and motivation of making observations more difficult.
Different frameworks have been suggested to motivate citizen observers. Reddy et al. ([2010a]) presented a recruitment framework for identifying potential participants for data collections, and Juong-Sik and Hoh () discussed an incentive mechanism for stimulating participatory sensing applications. Micro-payments as an incentive mechanism are explored by Reddy et al. ([2010b]). We used a simple motivation mechanism in which users received notifications about the algae situation and reminders to contribute to observations. In the future, more efforts are needed to recruit suitable observers and to motivate them to continue making observations. Sunyoung et al. () suggest that creating a successful citizen sensing application requires the application to be designed together with various stakeholders and ensuring that the gathered data can be put to use. Currently, as part of the MARMONI EU Life+ project (http://marmoni.balticseaportal.net/wp/), representatives of non-governmental organizations and school teachers are trained to make algae (cyanobacterial bloom and bladderwrack occurrence) and Secchi depth observations. The idea is that the representatives will act as trainers in their organizations and schools.
In general, the citizens are motivated to participate in environmental science projects (Roy et al. ). However, one challenge of harnessing citizen observers is to find an economically sustainable solution that motivates not just the citizens and researchers but also the system developers to innovate, update and maintain state-of-the-art, easy-to-use tools for making observations. Citizen sensing activities and campaigns can be funded in the context of research projects, but to fully empower citizens as observers of various environmental parameters also requires new commercial innovations.
The quality of the collected information is an important concern of citizen sensing (Haklay et al. , Comber et al. ). In many cases, the quality varies, it is not documented at all, it fails to follow scientific principles of sampling design, and its coverage is incomplete (Goodchild and Li ).
When looking at the data and graphs of this study, we note that the citizen observation averages are biased towards higher bloom intensity values than the expert observation averages. This can be explained by noting that the citizens made fewer ‘no algae detected’ observations than the experts. Trained observers are instructed to make observations whether there are algae or not, but citizens make observations whenever they find it useful. Citizens probably make observations more often when algae are visible and tend to omit ‘no algae’ reports.
When the observations are based on human senses, the measurements are not of uniform quality but vary according to individual capabilities. In this study the citizen observers had also the possibility to submit photos along with their classification of algal blooms. The quality of these photos varies depending on the mobile phone model, the camera resolution, the distance, angle of view and degree of possible surface reflection, and therefore automatic classification of algal blooms is not feasible. However, the photos can be used visually as an additional method to verify the citizen observations.
As in any data gathering task relying on volunteer user contributions, there is a risk of faulty input by human errors or even service misuse. The risk of misuse may be even higher when no registration to the service is required and the abusers cannot be tracked. It is important to determine the quality of user observations, especially when using the data for evaluating and validating predictive models or as ground-truth data for reference. During the performed pilot trials, no service misuse was detected, and no actions to remedy that kind of activity were necessary. Obvious test uses of the system were detected manually, but in the future some automatic identification of faulty or accidental observations should be implemented to improve the data quality. For example, Alabri and Hunter () describe a framework combining data quality control and trust metrics to enhance the reliability of citizen science data, and Kuan et al. () as well as Yang et al. () propose reputation management systems to evaluate the trustworthiness of gathered data by co-observers and data end-users.
Data privacy is one concern that must be considered, and it is discussed in several studies, e.g. Christin et al. () conducted a survey on privacy in mobile participatory sensing applications and showed that almost all applications capture location and time information. Methods for protecting privacy have been presented, e.g. by Kazemi and Shahabi (). In our case the mobile citizen observers were anonymous so the privacy was not the primary concern, however, with the missing contact details we could not ask for feedback about the mobile system. Even though the names of the observers were not public (or not even available), individual identities could be inferred from the location information, e.g. if a summer cottage is used as a regular observation station. If data privacy becomes an issue later on the exact location could be hidden in the published data and stored unaltered for research purposes.
Our study was based on realistic data collected from experts making observations regularly in stationary locations and citizens making observations at more or less sporadic locations and times. The dataset did not enable very accurate comparison of expert and citizen observations in terms of space and time. We compared average values of large geographic area, which introduced errors in the data and therefore uncertainties in the results, as the algal bloom may develop differently in different parts of the averaged area. To study the quality of citizen observations in more detail, a special campaign could be organised to ensure that citizens and experts observe the same algae situation in the same region at the same time.
Usefulness of the data collected
Based on our analysis, the systematic positive correlations between the expert and citizen algae observations in consequent years suggest that citizen observers can extend the current observation network spatially and temporally and provide additional information that supports the monitoring of the algal bloom situation. Already now the visual algal bloom observations by experts are used as supporting information for the Water Framework Directive (WFD) ecological classification of surface waters. All lakes in Finland cannot be monitored by authorities with available resources, thus citizens can provide additional information from areas that are not currently monitored and additional sampling of water quality can be carried out in areas where citizens have reported algal blooms.
The reliability and usefulness of citizen observations for monitoring terrestrial and marine environments have been analysed in several studies. Obrecht et al. () conclude that citizen Secchi depth measurements are nearly identical with the measurements made by professionals. Delaney et al. () identified obstacles in citizen monitoring and concluded that, with proper training, citizens can provide reliable aid in collecting knowledge about both native and invasive crabs. A study by Gallo and Waitt () concludes that citizen scientists are able to detect and report invasive plants in their local areas, and the data can be used by professional scientists. [D’Hondt et al. (2012)] created noise maps based on citizen observations and concluded that they are comparable with official simulation-based noise maps. Lottig et al. () analysed over 140 000 Secchi observations from 3251 lakes in the USA and demonstrated that citizen science can provide the critical monitoring data needed to improve spatial and temporal scales.
Surface algal bloom monitoring is needed to obtain data on algal bloom frequency and intensity, in particular in lakes where the use of satellite remote sensing has limitations and/or phytoplankton monitoring is infrequent or totally lacking. In this paper we present how citizens can also take part in the algal bloom monitoring in Finland and thus accumulate additional information on bloom occurrences. Observations by untrained citizen observers were collected in the summers of 2011, 2012 and 2013 and compared with the trained expert observations. Two systems for citizen sensing were developed and applied in the study: a mobile phone application called Levävahti (Algae Watch) and a collaborative web service about Finnish lakes called Järviwiki (Lake wiki). A clear correlation between the expert and citizen observations was found in the analysis, which suggests that citizen observers can provide additional information for algae monitoring.
Europe is facing increasing monitoring requirements to meet obligations under, for example, the Water Framework Directive and the UN Convention on Biological Diversity (CBD). This opens up opportunities to develop and test new innovations for citizen science and community-based environmental monitoring. These innovations should not only provide new ways of gathering data but also engage and encourage the community in sustainable management of the environment.
Visual observations of algal bloom situation
In the visual algal bloom monitoring of Finnish waters, cyanobacteria bloom intensity is evaluated both by expert and citizen observers using four classes: 0 = not detected, 1 = detected, 2 = high amount and 3 = very high amount (Rapala et al. ). Experts observe from June to September in the fixed shore observation sites, and citizens make additional observations for all water bodies at any time of year as frequently as they wish. The visual surface bloom observations focus on cyanobacteria (blue-green algae), as many bloom-forming cyanobacteria can form dense surface scums that can be toxic to humans as well as to other biota:
0: Not detected. No algae on the water surface or on the shore line. The Secchi depth visibility is normal.
1: Detected. Greenish flakes (cyanobacteria colonies) detected in the water or when taken into a transparent container, or narrow stripes on the shore. The Secchi depth is reduced by algae.
2: High amount. The water is clearly coloured by algae, small surface scums or cyanobacterial mass on the beach are detected.
3: Very high amount. Wide and heavy surface scums or thick aggregates of cyanobacteria are detected on the shore.
Trained expert observations
National surface algal bloom monitoring in Finland has been carried out since 1998. It is coordinated by the Finnish Environment Institute (SYKE) and carried out in co-operation with local environmental authorities, municipalities and private trained persons (Rapala et al. ). The aim of monitoring is to provide an up-to-date overview of the cyanobacterial situation and information about the spatial and temporal variation during the summer.
The visual observations are made weekly by expert observers, i.e. authorities and trained volunteers, in approximately 320 pre-determined locations in Finland, of which approximately 260 represent lakes and approximately 60 coastal areas of the Baltic Sea. Observation sites have been selected to represent various types of waters with differing trophy, water colour (humic content), size and geographical location. Many observation sites are located near public beaches or cities. Many expert observers represent regional environment authorities from municipalities who are responsible for the monitoring of the status of recreational or drinking waters, incl. beaches, and who have been trained to detect cyanobacteria blooms by the phytoplankton and monitoring experts of the Centres of Economic Development, Transport and Environment or the Finnish Environment Institute (SYKE).
In this study, we concentrate on visual observations, as these can be compared with the citizen observations. However, other means are also used in algal monitoring, e.g. for the Finnish coastal areas of the Baltic Sea the information is obtained from satellite imagery, commercial ships with ship-of-opportunity devices and the Border Guard. In addition, if the amount of algae is visually estimated to be high or very high a sample is taken for the qualitative analysis of the bloom taxa using microscopy.
The Levävahti application (Algae Watch) was implemented on a participatory sensing platform called EnviObserver (Kotovirta et al. ) and was made available for Nokia (Java ME) and Android-based mobile phones in the summer of 2011; for Nokia (Java ME), Android and iPhone phones in 2012 and 2013; and for Windows phones in 2013. The on-line observations were stored together with a GPS location, time and voluntary image taken by the user.
Järviwiki (Lake wiki) is a collaborative web service for sharing information about lakes in Finland, raising awareness and promoting protection of waters. The users of Järviwiki can write about or discuss a lake and set up their own observation sites and report on water parameters such as algal blooms, surface water temperature and ice cover. The visualizations of observations received from the Levävahti application and the observation sites in Järviwiki were implemented in the Järviwiki web service.
Citizen observers for the study were recruited by publishing invitations in local and national news services and water-related events and exhibitions at the beginning of the summer season in Finland. Cyanobacterial blooms are typically observed in Finnish waters from late June until the end of August. The mobile phone application was open to everyone without registration, requiring only downloading of the software. The Järviwiki web service was also open to everyone, but registration was needed to set up an observation site.
To evaluate the usefulness of citizen observations, they were compared with the visual observations by experts. Due to the nature of this observation campaign, the locations and timing of the mobile phone citizen observations were quite sporadic, compared with the regular weekly observations by trained observers in pre-determined locations. The differences in location and timing did not enable direct comparisons between individual observations. Instead, we used averaging of both space and time and compared the averaged values. We calculated weekly averages for the whole geographic area of the dataset in Finland and for two smaller geographical areas (see Figure 1) to study the geographical variability of the observations. The sizes of the smaller areas were selected heuristically so that there were enough expert and citizen observations to calculate weekly averages. The smallest area was used only for the year 2011 dataset which contained enough observations for the analysis. The time range was restricted to weeks 24 to 38 (approx. early June to mid-Sept) in order to have enough citizen observations for weekly averaging. The algal blooming occurs during the summer months in Finland and the citizens appeared to be more active observers during the summer time.
We calculated the correlations between the weekly averages of citizen and expert observations for each year. In order to estimate the accuracy of the correlations we used the bootstrapping method, in which the observed data are used as an approximating distribution of the real distribution. We resampled random samples from each week’s dataset and constructed a sampled observation dataset for each week that was equal in size to the original dataset. We then calculated new sampled averages for each week, and used those in calculating the correlations between citizen and expert observations. We repeated the process 1000 times and got distributions for weekly averages and also for the correlations of the weekly averages, and from the distributions we calculated the confidence intervals both for the weekly averages and the correlations of averages.
To study the variation of weekly averages of citizen observations we used the width of the 95% confidence interval as a measure of variation and calculated its correlation with the spatial distribution of citizen observations. The spatial distance between observations might (partly) explain the variation, as the algae situation may progress differently in different latitudes, or even in different lakes in the same latitude. The spatial distribution was calculated as a mean distance of the observations from their geographical centre point. We also calculated the correlation of the variation with the number of citizen observations.
The work has been conducted in the Measurement, Monitoring and Environmental Assessment research programme funded by Tekes, the Finnish Funding Agency for Technology and Innovation, in the Pathway project funded by the Academy of Finland, and in the EU Life+ funded project GisBloom (Life09 ENV/FI/000569). We want to thank Markku Huttunen and Renne Tergujeff from VTT for their participation in the design and development of the Levävahti (Algae Watch) mobile application; Olli Saarela from VTT for his advice on data analysis; Seppo Kaitala, Maria Kämäri, Jari Silander and Juha-Markku Leppänen from the Finnish Environment Institute for participating in the design of Levävahti and the recruitment of participants; and Ville Peltola and Asko Relas from IBM Finland for participating in the mobile application design and developing the first iPhone version of LeväVahti for the summer of 2011.
- Alabri A, Hunter J (2010) Enhancing the quality and trust of citizen science data. In: Proceedings of 2010 6th IEEE International Conference on e-Science, eScience 2010, Brisbane, Australia, 7–10 Dec 2010Google Scholar
- Aroviita J, Hellsten S, Jyväsjärvi J, Järvenpää L, Järvinen M, Karjalainen S-M, Kauppila P, Keto A, Kuoppala M, Manni K, Mannio J, Mitikka S, Olin M, Perus J, Pilke A, Rask M, Riihimäki J, Ruuskanen A, Siimes K, Sutela T, Vehanen T, Vuori K-M: Guidelines for the ecological and chemical status classification of surface waters for 2012–2013 – updated assessment criteria and their application. Environmental Administration Guidelines 7/2012, Finnish Environment Institute (SYKE). 2012.Google Scholar
- Burke J, Estrin D, Hansen M, Parker A, Ramanathan N, Reddy S, Srivastava M B (2006) Participatory Sensing. In: Proceedings of the International Workshop on World-Sensor-Web (WSW'2006), ACM, Boulder, CO, USA, 31 OctGoogle Scholar
- Carvalho L, Poikane S, Lyche Solheim A, Phillips G, Borics G, Catalan J, De Hoyos C, Drakare S, Dudley BJ, Järvinen M, Laplace-Treyture C, Maileht K, McDonald C, Mischke U, Moe J, Morabito G, Nõges P, Nõges T, Ott I, Pasztaleniec A, Skjelbred B, Thackeray SJ: Strength and uncertainty of lake phytoplankton metrics for assessing eutrophication impacts in lakes. Hydrobiologia 2013, 704: 127–140. doi:10.1007/s10750–012–1344–1 doi:10.1007/s10750-012-1344-1 10.1007/s10750-012-1344-1View ArticleGoogle Scholar
- Christin D, Reinhardt A, Kanhere SS, Hollick M: A survey on privacy in mobile participatory sensing applications. J Syst Softw 2011,84(11):1928–1946. 10.1016/j.jss.2011.06.073View ArticleGoogle Scholar
- Comber A, See L, Fritz S, Van der Velde M, Perger C, Foody G: Using control data to determine the reliability of volunteered geographic information about land cover. Int J Appl Earth Obs Geoinf 2013, 23: 37–48. ISSN 0303–2434, Available online http://dx.doi.org/10.1016/j.jag.2012.11.002 Accessed 8 Oct 2014 ISSN 0303–2434, Available online http://dx.doi.org/10.1016/j.jag.2012.11.002 Accessed 8 Oct 2014 10.1016/j.jag.2012.11.002View ArticleGoogle Scholar
- Commission E: Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework for Community action in the field of water policy. Off J Eur Communities 2000, 327: 1–72.Google Scholar
- Conrad C, Hilchey K: A review of citizen science and community-based environmental monitoring: issues and opportunities. Environ Monit Assess 2011, 176: 273–291. doi:10.1007/s10661–010–1582–5 doi:10.1007/s10661-010-1582-5 10.1007/s10661-010-1582-5View ArticleGoogle Scholar
- D’Hondt E, Stevens M, Jacobs A: Participatory noise mapping works! An evaluation of participatory sensing as an alternative to standard techniques for environmental monitoring. Pervasive Mob Comput 2013,9(5):681–694. ISSN 1574–1192, 10.1016/j.pmcj.2012.09.002 ISSN 1574–1192, 10.1016/j.pmcj.2012.09.002 10.1016/j.pmcj.2012.09.002View ArticleGoogle Scholar
- Das T, Mohan P, Padmanabhan V, Ramjee R, Sharma A: PRISM: Platform for Remote Sensing using Smartphones. In Proceedings of the 8th International Conference on Mobile Systems, Applications, and Services (MobiSys ′10). ACM, New York, NY, USA; 2010.Google Scholar
- Delaney DG, Sperling CD, Adams CS, Leung B: Marine invasive species: validation of citizen science and implications for national monitoring networks. Biol Invasions 2008, 10: 1. doi:10.1007/s10530–007–9114–0 doi:10.1007/s10530-007-9114-0 10.1007/s10530-007-9114-0View ArticleGoogle Scholar
- Dickinson JL, Shirk J, Bonter D, Bonney R, Crain RL, Martin J, Phillips T, Purcell K: The current state of citizen science as a tool for ecological research and public engagement. Front Ecol Environ 2012,10(6):291–297. 10.1890/110236View ArticleGoogle Scholar
- Eiman K: NoiseSPY: a real-time mobile phone platform for urban noise monitoring and mapping. Mob Netw Appl 2010,15(4):562–574. 10.1007/s11036-009-0217-yView ArticleGoogle Scholar
- Gallo T, Waitt D: Creating a successful citizen science model to detect and report invasive species. Bioscience 2011,61(6):459–465. doi:10.1525/bio.2011.61.6.8 doi:10.1525/bio.2011.61.6.8 10.1525/bio.2011.61.6.8View ArticleGoogle Scholar
- Goodchild MF, Li L: Assuring the quality of volunteered geographic information. Spat Stat 2012, 1: 110–120. ISSN 2211–6753, available online http://dx.doi.org/10.1016/j.spasta.2012.03.002 Accessed 8 Oct 2014 ISSN 2211–6753, available online http://dx.doi.org/10.1016/j.spasta.2012.03.002 Accessed 8 Oct 2014 10.1016/j.spasta.2012.03.002View ArticleGoogle Scholar
- Haklay M: Citizen Science and Volunteered Geographic Information – Overview and Typology of Participation. In Volunteered Geographic Information, Public Participation and Crowdsourced Production of Geographic Knowledge. Edited by: Sui DZ, Elwood S, Goodchild MF. Springer, Berlin; 2012.Google Scholar
- Haklay M, Basiouka S, Antoniou V, Ather A (2010) How many volunteers does it take to map an area well? The validity of Linus’ Law to volunteered geographic information. Cartogr J 47(4):315–322, , [10.1179/000870410X12911304958827]Google Scholar
- Juong-Sik L, Hoh B: Dynamic pricing incentive for participatory sensing. Pervasive Mob Comput 2010,6(6):693–708. 10.1016/j.pmcj.2010.08.006View ArticleGoogle Scholar
- Kazemi L, Shahabi C: Towards Preserving Privacy in Participatory Sensing. In 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops). IEEE Computer Society, Seattle, WA, United States; 2011.Google Scholar
- Kotovirta V, Toivanen T, Tergujeff R, Huttunen M: Participatory Sensing in Environmental Monitoring – Experiences. Innovative Mobile and Internet Services in Ubiquitous Computing (IMIS), 2012 Sixth International Conference, Palermo, Italy 4–6 July 2012 2012, 155–162. doi:10.1109/IMIS.2012.70 doi:10.1109/IMIS.2012.70 10.1109/IMIS.2012.70View ArticleGoogle Scholar
- Kuan LH, Salil SK, Wen H: Are You Contributing Trustworthy Data?: the Case for a Reputation System in Participatory Sensing. In Proceedings of the 13th ACM international conference on Modeling, analysis, and simulation of wireless and mobile systems (MSWIM ′10). ACM, New York, NY, USA; 2010.Google Scholar
- Lane ND, Eisenman SB, Musolesi M, Miluzzo E, Campbell A (2008) Urban sensing systems: opportunistic or participatory? In: Proceedings of the 9th workshop on Mobile computing systems and applications, CA, USA, 25–26 Feb 2008Google Scholar
- Leeuw T, Boss E (2014) Crowdsourcing water quality data using the iPhone camera. Poster presented at the 2014 Ocean Science Meeting, Honolulu, Hawaii, 22 Feb-3 March 2014. Available online Accessed 18 July 2014, [http://www.eposters.net/pdfs/crowdsourcing-water-quality-data-using-the-iphone-camera.pdf] Leeuw T, Boss E (2014) Crowdsourcing water quality data using the iPhone camera. Poster presented at the 2014 Ocean Science Meeting, Honolulu, Hawaii, 22 Feb-3 March 2014. Available online Accessed 18 July 2014
- Lottig NR, Wagner T, Norton Henry E, Spence Cheruvelil K, Webster KE, Downing JA, Stow CA: Long-term citizen-collected data reveal geographical patterns and temporal trends in lake water clarity. PLoS ONE 2014,9(4):e95769. doi:10.1371/journal.pone.0095769 doi:10.1371/journal.pone.0095769 10.1371/journal.pone.0095769View ArticleGoogle Scholar
- Lowry CS, Fienen MN: CrowdHydrology: crowdsourcing hydrologic data and engaging citizen scientists. GroundWater 2013,51(1):151–156. 10.1111/j.1745-6584.2012.00956.xView ArticleGoogle Scholar
- Mednis A, Strazdins G, Zviedris R, Kanonirs G (2011) Real time pothole detection using Android smartphones with accelerometers. In: Proceedings of the 7th IEEE International Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS’11), Barcelona, Spain 27–29 June 2011, pp 1–6Google Scholar
- Mun M, Reddy S, Shilton K, Yau N, Burke J, Estrin D, Hansen M, Howard E, West R, Boda P (2009) PEIR, the personal environmental impact report, as a platform for participatory sensing systems research. In: MobiSys '09 Proceedings of the 7th international conference on Mobile systems, applications, and services, Kraków, Poland, 22–25 June 2009Google Scholar
- Obrecht DV, Milanick M, Perkins BD, Ready D, Jones JR: Evaluation of data generated from lake samples collected by volunteers. Lake Reserv Manag 1998, 14: 21–27. doi:10.1080/07438149809354106 doi:10.1080/07438149809354106 10.1080/07438149809354106View ArticleGoogle Scholar
- Olmanson LG, Bauer ME, Brezonik PL: A 20-year Landsat water clarity census of Minnesota’s 10,000 lakes. Remote Sense Environ 2008, 112: 4086–4097. doi:10.1016/j.rse.2007.12.013 doi:10.1016/j.rse.2007.12.013 10.1016/j.rse.2007.12.013View ArticleGoogle Scholar
- Paxton M, Benford S: Experiences of Participatory Sensing in the Wild. In Proceedings of the 11th International Conference on Ubiquitous Computing (UbiComp ′09). ACM, New York, NY, USA; 2009:265–274. 10.1145/1620545.1620584View ArticleGoogle Scholar
- Perez A, Labrador M, Barbeau J: G-sense: a scalable architecture for global sensing and monitoring. IEEE Netw 2010,24(4):57–64. 10.1109/MNET.2010.5510920View ArticleGoogle Scholar
- Rapala J, Kilponen J, Järvinen M, Lahti K (2012) Finland: Guidelines for Monitoring of Cyanobacteria and their Toxins. In: Chorus I (ed) Current Approaches to Cyanotoxin Risk Assessment, Risk Management and Regulations in Different Countries. Federal Environment Agency (Umweltbundesamt), Germany, pp 54–62, . Accessed 18 July 2014, [http://www.uba.de/uba-info-medien-e/4390.html]
- Reddy S, Estrin D, Srivastava M (2010a) Recruitment framework for participatory sensing data collections. In: Proceedings of the 8th International Conference on Pervasive Computing, Helsinki, Finland, pp 138–155Google Scholar
- Reddy S, Estrin D, Hansen M, Srivastava M: Examining Micro-Payments for Participatory Sensing Data Collections. In Proceedings of the 12th ACM International Conference on Ubiquitous Computing (Ubicomp ′10). ACM, New York, NY, USA; 2010b:33–36. 10.1145/1864349.1864355View ArticleGoogle Scholar
- Reinart A, Kutser T: Comparison of different satellite sensors in detecting cyanobacterial bloom events in the Baltic Sea. Remote Sens Environ 2006, 102: 74–85. 10.1016/j.rse.2006.02.013View ArticleGoogle Scholar
- Roy HE, Pocock MJO, Preston CD, Roy DB, Savage J (2012) Understanding citizen science & environmental monitoring. Final report on behalf of UK Environmental Observation Framework. NERC Centre for Ecology & Hydrology and Natural History Museum. , [http://www.ceh.ac.uk/products/publications/documents/citizensciencereview.pdf]
- Indicators and methods for the ecological status assessment under the Water Framework Directive. European Commission, Luxembourg; 2006.Google Scholar
- Sunyoung K, Robson C, Zimmerman T, Pierce J, Haber E: Creek Watch: Pairing Usefulness and Usability for Successful Citizen Science. In Proceedings of the 2011 Annual Conference on Human Factors in Computing Systems (CHI ′11). ACM, New York, NY, USA; 2011:2125–2134.Google Scholar
- Toivanen T, Koponen S, Kotovirta V, Molinier M, Chengyuan P (2013) Water quality analysis using an inexpensive device and a mobile phone. Environ Syst Res 2(9) doi:10.1186/2193–2697–2-9Google Scholar
- Yang H, Zhang J, Roe P: Using reputation management in participatory sensing for data classification. Procedia Comput Sci 2011, 5: 190–197. 10.1016/j.procs.2011.07.026View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited.