title: A bone suppression model ensemble to improve COVID-19 detection in chest X-rays

abstract: Chest X-ray (CXR) is a widely performed radiology examination that helps to detect abnormalities in the tissues and organs in the thoracic cavity. Detecting pulmonary abnormalities like COVID-19 may become difficult due to that they are obscured by the presence of bony structures like the ribs and the clavicles, thereby resulting in screening/diagnostic misinterpretations. Automated bone suppression methods would help suppress these bony structures and increase soft tissue visibility. In this study, we propose to build an ensemble of convolutional neural network models to suppress bones in frontal CXRs, improve classification performance, and reduce interpretation errors related to COVID-19 detection. The ensemble is constructed by (i) measuring the multi-scale structural similarity index (MS-SSIM) score between the sub-blocks of the bone-suppressed image predicted by each of the top-3 performing bone-suppression models and the corresponding sub-blocks of its respective ground truth soft-tissue image, and (ii) performing a majority voting of the MS-SSIM score computed in each sub-block to identify the sub-block with the maximum MS-SSIM score and use it in constructing the final bone-suppressed image. We empirically determine the sub-block size that delivers superior bone suppression performance. It is observed that the bone suppression model ensemble outperformed the individual models in terms of MS-SSIM and other metrics. A CXR modality-specific classification model is retrained and evaluated on the non-bone-suppressed and bone-suppressed images to classify them as showing normal lungs or other COVID-19-like manifestations. We observed that the bone-suppressed model training significantly outperformed the model trained on non-bone-suppressed images toward detecting COVID-19 manifestations.


title: Probing the High-energy $\gamma$-ray Emission Mechanism in the Vela Pulsar via Phase-resolved Spectral and Energy-dependent Light Curve Modeling

abstract: Recent kinetic simulations sparked a debate regarding the emission mechanism responsible for pulsed GeV $\gamma$-ray emission from pulsars. Some models invoke curvature radiation, while other models assume synchrotron radiation in the current-sheet. We interpret the curved spectrum of the Vela pulsar as seen by H.E.S.S. II (up to $\sim$100 GeV) and the $Fermi$ Large Area Telescope (LAT) to be the result of curvature radiation due to primary particles in the pulsar magnetosphere and current sheet. We present phase-resolved spectra and energy-dependent light curves using an extended slot gap and current sheet model, invoking a step function for the accelerating electric field as motivated by kinetic simulations. We include a refined calculation of the curvature radius of particle trajectories in the lab frame, impacting the particle transport, predicted light curves, and spectra. Our model reproduces the decrease of the flux of the first peak relative to the second one, evolution of the bridge emission, near-constant phase positions of peaks, and narrowing of pulses with increasing energy. We can explain the first of these trends because we find that the curvature radii of the particle trajectories in regions where the second $\gamma$-ray light curve peak originates are systematically larger than those associated with the first peak, implying that the spectral cutoff of the second peak is correspondingly larger. However, an unknown azimuthal dependence of the $E$-field as well as uncertainty in the precise spatial origin of the GeV emission, precludes a simplistic discrimination of emission mechanisms.


title: Thermal QCD phase transition and its scaling window from Wilson twisted mass fermions

abstract: We investigate the thermal QCD phase transition and its scaling properties on the lattice. The simulations are performed with $N_f=2+1+1$ Wilson twisted mass fermions at pion masses from physical up to heavy quark regime. We introduce a novel chiral order parameter, which is free from linear mass contributions and turns out to be very useful for the study of scaling behaviour. Our results are compatible with $O(4)$ universal scaling for the physical pion mass and the temperature range $[120:300]$ MeV. Violations to scaling at larger masses and other possible scenarios, including mean field behaviour and $Z(2)$ scaling scenario are also discussed. We provide an estimation for the critical temperature in the chiral limit $T_0$.


title: Experimental evaluation of sensor attacks and defense mechanisms in feedback systems

abstract: In this work, we evaluate theoretical results on the feasibility of, the worst-case impact of, and defense mechanisms against a stealthy sensor attack in an experimental setup. We demonstrate that for a controller with stable dynamics the stealthy sensor attack is possible to conduct and the theoretical worst-case impact is close to the achieved practical one. However, although the attack should theoretically be possible when the controller has integral action, we show that the integral action slows the attacker down and the attacker is not able to remain stealthy if it has not perfect knowledge of the controller state. In addition to that, we investigate the effect of different anomaly detectors on the attack impact and conclude that the impact under detectors with internal dynamics is smaller. Finally, we use noise injection into the controller dynamics to unveil the otherwise stealthy attacks.


title: MSC-VO: Exploiting Manhattan and Structural Constraints for Visual Odometry

abstract: Visual odometry algorithms tend to degrade when facing low-textured scenes -from e.g. human-made environments-, where it is often difficult to find a sufficient number of point features. Alternative geometrical visual cues, such as lines, which can often be found within these scenarios, can become particularly useful. Moreover, these scenarios typically present structural regularities, such as parallelism or orthogonality, and hold the Manhattan World assumption. Under these premises, in this work, we introduce MSC-VO, an RGB-D -based visual odometry approach that combines both point and line features and leverages, if exist, those structural regularities and the Manhattan axes of the scene. Within our approach, these structural constraints are initially used to estimate accurately the 3D position of the extracted lines. These constraints are also combined next with the estimated Manhattan axes and the reprojection errors of points and lines to refine the camera pose by means of local map optimization. Such a combination enables our approach to operate even in the absence of the aforementioned constraints, allowing the method to work for a wider variety of scenarios. Furthermore, we propose a novel multi-view Manhattan axes estimation procedure that mainly relies on line features. MSC-VO is assessed using several public datasets, outperforming other state-of-the-art solutions, and comparing favourably even with some SLAM methods.


title: Microwave Quantum Radar using a Josephson Traveling Wave Parametric Amplifier

abstract: Detection of low-reflectivity objects can be improved by the so-called quantum illumination procedure. However, quantum detection probability exponentially decays with the source bandwidth. The Josephson Parametric Amplifiers (JPAs) technology utilized as a source, generating a pair of entangled signals called two-mode squeezed vacuum states, shows a very narrow bandwidth limiting the operation of the microwave quantum radar (MQR). In this paper, for the first time, a microwave quantum radar setup based on quantum illumination protocol and using a Josephson Traveling Wave Parametric Amplifier (JTWPA) is proposed. Measurement results of the developed JTWPA, pumped at 12 GHz, show an ultrawide bandwidth equal to 10 GHz at X-band making our MQR a promising candidate for the detection of stealth objects.


title: Dixmier trace and the DOS of magnetic operators

abstract: The main goal of this work is to provide two new formulas for the computation of the trace per unit volume, and consequently the integrated density of states (IDOS), for magnetic operators. These formulas also permit the use of the Dixmier trace in the spectral analysis of magnetic operators. The second of these formulas, named energy shell formula, permits to approximate the IDOS by a finite sums of averaged expectation values of the spectral projections.


title: On a Parabolic-Elliptic system with gradient dependent chemotactic coefficient

abstract: We consider a second order PDEs system of Parabolic-Elliptic type with chemotactic terms. The system describes the evolution of a biological species "$u$" moving towards a higher concentration of a chemical stimuli "$v$" in a bounded and open domain of $ \mathcal{R}^N$. In the system considered, the chemotaxis sensitivity depends on the gradient of $v$, i.e., the chemotaxis term has the following expression $$- div \left(\chi u |\nabla v|^{p-2}\nabla v \right),$$ where $\chi $ is a positive constant and $p$ satisfies $$p \in (1, \infty), \quad \mbox{ if } N=1 \quad \mbox{ and } \quad p\in \left(1, \frac{N}{N-1}\right), \quad \mbox{ if } N\geq 2.$$ We obtain uniform bounds in time in $L^{\infty}(\Omega)$ of the solutions. For the one-dimensional case we prove the existence of infinitely many non-constant steady-states for $p\in (1,2)$ for any $\chi$ positive and a given positive mass.


title: Dual Parameterization of Sparse Variational Gaussian Processes

abstract: Sparse variational Gaussian process (SVGP) methods are a common choice for non-conjugate Gaussian process inference because of their computational benefits. In this paper, we improve their computational efficiency by using a dual parameterization where each data example is assigned dual parameters, similarly to site parameters used in expectation propagation. Our dual parameterization speeds-up inference using natural gradient descent, and provides a tighter evidence lower bound for hyperparameter learning. The approach has the same memory cost as the current SVGP methods, but it is faster and more accurate.


title: Harmonic Modeling, Data Generation, and Analysis of Power Electronics-Interfaced Residential Loads

abstract: Integration of electronics-based residential appliances and distributed energy resources in homes is expected to rise with grid decarbonization. These devices may introduce significant harmonics into power networks that need to be closely studied in order to accurately model and forecast load. However, it can be difficult to obtain harmonic-rich voltage and current data -- necessary for identifying accurate load models -- for residential electrical loads. Recognizing this need, first a set of electronics-based end-use loads is identified and modeled in an electromagnetic transients program tool for a residence. Second, an impedance-varying method is proposed to generate harmonic data that captures harmonic propagation to the supply voltage and harmonic interactions among end-use loads connected to the same supply voltage. Third, a harmonic-rich dataset produced via the proposed methodology is demonstrated to successfully identify frequency coupling matrix-based harmonic load models using the least-squares method. Numerical results demonstrate the accuracy of the model. The impact of limited data availability on model identification is also explored.


title: Structure-aware Image Inpainting with Two Parallel Streams

abstract: Recent works in image inpainting have shown that structural information plays an important role in recovering visually pleasing results. In this paper, we propose an end-to-end architecture composed of two parallel UNet-based streams: a main stream (MS) and a structure stream (SS). With the assistance of SS, MS can produce plausible results with reasonable structures and realistic details. Specifically, MS reconstructs detailed images by inferring missing structures and textures simultaneously, and SS restores only missing structures by processing the hierarchical information from the encoder of MS. By interacting with SS in the training process, MS can be implicitly encouraged to exploit structural cues. In order to help SS focus on structures and prevent textures in MS from being affected, a gated unit is proposed to depress structure-irrelevant activations in the information flow between MS and SS. Furthermore, the multi-scale structure feature maps in SS are utilized to explicitly guide the structure-reasonable image reconstruction in the decoder of MS through the fusion block. Extensive experiments on CelebA, Paris StreetView and Places2 datasets demonstrate that our proposed method outperforms state-of-the-art methods.


title: Arnold diffusion and Nekhoroshev theory

abstract: Starting with Arnold's pioneering work, the term "Arnold diffusion" has been used to describe the slow diffusion taking place in the space of the actions in Hamiltonian nonlinear dynamical systems with three or more degrees of freedom. The present text is an elaborated transcript of the introductory course given in the Milano I-CELMECH school on the topic of Arnold diffusion and its relation to Nekhoroshev theory. The course introduces basic concepts related to our current understanding of the mechanisms leading to Arnold diffusion. Emphasis is placed upon the identification of those invariant objects in phase space which drive chaotic diffusion, such as the stable and unstable manifolds emanating from (partially) hyperbolic invariant objects. Besides a qualitative understanding of the diffusion mechanisms, a precise quantification of the speed of Arnold diffusion can be achieved by methods based on canonical perturbation theory, i.e. by the construction of a suitable normal form at optimal order. As an example of such methods, we discuss the (quasi-)stationary-phase approximation for the selection of remainder terms acting as driving terms for the diffusion. Finally, we discuss the efficiency of such methods through numerical examples in which the optimal normal form is determined by a computer-algebraic implementation of a normalization algorithm.


title: Topological interface states induced by incident angle in the 1D elastic wave system

abstract: Topological interface states are currently attracting rapidly growing attention in classical wave systems. However, little work has been done on topological interface states in one-dimensional (1D) elastic wave systems, especially in the case of oblique incidence. This paper theoretically demonstrates the realization of topological interface states of elastic waves in a 1D composite plate structure composed of two phononic crystals (PCs) with different topological characteristics, which can be regulated by the incident angle. For the out-of-plane SH mode, multiple topological interface states can coexist in different common bandgaps. For the in-plane complex P-SV coupled mode, topological interface states can exist in both "partial-polarization" and "omni-polarization" bandgaps. All these interface states are in the wide frequency and incident angle regions. We also discuss the polarization and the mode conversion of the interface states. Our results provide an innovative method to excite and tune topologically protected interface states for elastic waves, which may have potential applications in obtaining strong local vibration for different polarized elastic wave modes.


title: On $\tau_q$-flatness and $\tau_q$-coherence

abstract: In this paper, we introduce and study the notions of $\tau_q$-flat modules and $\tau_q$-coheret rings. First, by investigating the Nagata rings of $\tau_q$-torsion theory, we show that the small finitistic dimensions of T$(R[x])$ are all equal to $0$ for any ring $R$. Then, we introduce the notion of $\tau_q$-VN regular rings (i.e. over which all modules are $\tau_q$-flat), and show that a ring $R$ is a $\tau_q$-VN regular ring if and only if T$(R[x])$ is a von Neumann regular ring. Finally, we obtain the Chase theorem for $\tau_q$-coheret rings: a ring $R$ is $\tau_q$-coherent if and only if any direct product of $R$ is $\tau_q$-flat if and only if any direct product of flat $R$-modules is $\tau_q$-flat. Some examples are provided to compare with the known conceptions.


title: Meta-Forecasting by combining Global Deep Representations with Local Adaptation

abstract: While classical time series forecasting considers individual time series in isolation, recent advances based on deep learning showed that jointly learning from a large pool of related time series can boost the forecasting accuracy. However, the accuracy of these methods suffers greatly when modeling out-of-sample time series, significantly limiting their applicability compared to classical forecasting methods. To bridge this gap, we adopt a meta-learning view of the time series forecasting problem. We introduce a novel forecasting method, called Meta Global-Local Auto-Regression (Meta-GLAR), that adapts to each time series by learning in closed-form the mapping from the representations produced by a recurrent neural network (RNN) to one-step-ahead forecasts. Crucially, the parameters ofthe RNN are learned across multiple time series by backpropagating through the closed-form adaptation mechanism. In our extensive empirical evaluation we show that our method is competitive with the state-of-the-art in out-of-sample forecasting accuracy reported in earlier work.


title: Mass-derivative relations for leptogenesis

abstract: In this work, a diagrammatic representation of thermal mass effects is derived from the $S$-matrix unitarity both in the classical and quantum Boltzmann equations. Within the example of the seesaw type-I leptogenesis, we discuss the connection of the Higgs thermal mass and the cancelations of infrared divergences in zero- and finite-temperature calculations of the right-handed neutrino decay and scattering processes.


title: Sampling Equivariant Self-attention Networks for Object Detection in Aerial Images

abstract: Objects in aerial images have greater variations in scale and orientation than in typical images, so detection is more difficult. Convolutional neural networks use a variety of frequency- and orientation-specific kernels to identify objects subject to different transformations; these require many parameters. Sampling equivariant networks can adjust sampling from input feature maps according to the transformation of the object, allowing a kernel to extract features of an object under different transformations. Doing so requires fewer parameters, and makes the network more suitable for representing deformable objects, like those in aerial images. However, methods like deformable convolutional networks can only provide sampling equivariance under certain circumstances, because of the locations used for sampling. We propose sampling equivariant self-attention networks which consider self-attention restricted to a local image patch as convolution sampling with masks instead of locations, and design a transformation embedding module to further improve the equivariant sampling ability. We also use a novel randomized normalization module to tackle overfitting due to limited aerial image data. We show that our model (i) provides significantly better sampling equivariance than existing methods, without additional supervision, (ii) provides improved classification on ImageNet, and (iii) achieves state-of-the-art results on the DOTA dataset, without increased computation.


title: Solving Traffic4Cast Competition with U-Net and Temporal Domain Adaptation

abstract: In this technical report, we present our solution to the Traffic4Cast 2021 Core Challenge, in which participants were asked to develop algorithms for predicting a traffic state 60 minutes ahead, based on the information from the previous hour, in 4 different cities. In contrast to the previously held competitions, this year's challenge focuses on the temporal domain shift in traffic due to the COVID-19 pandemic. Following the past success of U-Net, we utilize it for predicting future traffic maps. Additionally, we explore the usage of pre-trained encoders such as DenseNet and EfficientNet and employ multiple domain adaptation techniques to fight the domain shift. Our solution has ranked third in the final competition. The code is available at https://github.com/jbr-ai-labs/traffic4cast-2021.


title: Transferable Time-Series Forecasting under Causal Conditional Shift

abstract: This paper focuses on the problem of semi-supervised domain adaptation for time-series forecasting, which is underexplored in literatures, despite being often encountered in practice. Existing methods on time-series domain adaptation mainly follow the paradigm designed for the static data, which cannot handle domain-specific complex conditional dependencies raised by data offset, time lags, and variant data distributions. In order to address these challenges, we analyze variational conditional dependencies in time-series data and find that the causal structures are usually stable among domains, and further raise the causal conditional shift assumption. Enlightened by this assumption, we consider the causal generation process for time-series data and propose an end-to-end model for the semi-supervised domain adaptation problem on time-series forecasting. Our method can not only discover the Granger-Causal structures among cross-domain data but also address the cross-domain time-series forecasting problem with accurate and interpretable predicted results. We further theoretically analyze the superiority of the proposed method, where the generalization error on the target domain is bounded by the empirical risks and by the discrepancy between the causal structures from different domains. Experimental results on both synthetic and real data demonstrate the effectiveness of our method for the semi-supervised domain adaptation method on time-series forecasting.


title: Smallest chimeras under repulsive interactions

abstract: We present an exemplary system of three identical oscillators in a ring interacting repulsively to show up chimera patterns. The dynamics of individual oscillators is governed by the superconducting Josephson junction. Surprisingly, the repulsive interactions establish a symmetry of compelete synchrony in the ring, which is broken with increasing interactions when the junctions pass through serials of asynchronous states (periodic and chaotic), but finally emerge into chimera states. The chimera pattern appears in chaotic rotational motion of the three junctions when two junctions evolve coherently while the third junction is incoherent. For larger repulsive coupling, the junctions evolves into another chimera pattern in a periodic state when two junctions remain coherent in rotational motion and one transits to incoherent librational motion. This chimera pattern is sensitive to initial conditions, in the sense, that the chimera state flips to another pattern when two junctions switch to coherent librational motion and the third junction remains in rotational motion, but incoherent. The chimera patterns are detected by using partial and global error functions of the junctions while the librational and rotational motions are identified by a libration index. All the collective states, complete synchrony, desynchronization and two chimera patterns, are delineated in a parameter plane of the ring of junctions, where the boundaries of complete synchrony are demarcated by using the master stability function.


title: Probing the entanglement of operator growth

abstract: In this work we probe the operator growth for systems with Lie symmetry using tools from quantum information. Namely, we investigate the Krylov complexity, entanglement negativity, von Neumann entropy and capacity of entanglement for systems with SU(1,1) and SU(2) symmetry. Our main tools are two-mode coherent states, whose properties allow us to study the operator growth and its entanglement structure for any system in a discrete series representation of the groups under consideration. Our results verify that the quantities of interest exhibit certain universal features in agreement with the universal operator growth hypothesis. Moreover, we illustrate the utility of this approach relying on symmetry as it significantly facilitates the calculation of quantities probing operator growth. In particular, we argue that the use of the Lanczos algorithm, which has been the most important tool in the study of operator growth so far, can be circumvented and all the essential information can be extracted directly from symmetry arguments.

categories: hep-th cond-mat.stat-mech cond-mat.str-el quant-ph


title: Analysis of nanosciences and nanotechnology and their applications

abstract: The small world of matter is getting smaller and smaller. Nano sciences in recent years had huge developments allowing nanotechnologies to take enormous steps in the development of materials and processes. Numerous applications in a wide scope of fields are very beneficial for humans, and many researches in development are very promising. Applications in medicine, industry, electronics, energy, or aeronautics are only some examples of areas where enormous benefits exist, and potentialities are clear. Some nanotechnologies are already applied and others are in development or testing phases.


title: Quantifying the sustainability impact of Google Maps: A case study of Salt Lake City

abstract: Google Maps uses current and historical traffic trends to provide routes to drivers. In this paper, we use microscopic traffic simulation to quantify the improvements to both travel time and CO$_2$ emissions from Google Maps real-time navigation. A case study in Salt Lake City shows that Google Maps users are, on average, saving 1.7% of CO$_2$ emissions and 6.5% travel time. If we restrict to the users for which Google Maps finds a different route than their original route, the average savings are 3.4% of CO$_2$ emissions and 12.5% of travel time. These results are based on traffic conditions observed during the Covid-19 pandemic. As congestion gradually builds back up to pre-pandemic levels, it is expected to lead to even greater savings in emissions.


title: Cosmology with the SZ spectrum: measuring the Universe's temperature with galaxy clusters

abstract: The hot gas in clusters of galaxies creates a distinctive spectral distortion in the cosmic microwave background (CMB) via the Sunyaev-Zel'dovich (SZ) effect. The spectral signature of the SZ can be used to measure the CMB temperature at cluster redshift ($T_{\rm CMB}(z)$) and to constrain the monopole of the y-type spectral distortion of the CMB spectrum. In this work, we start showing the measurements of $T_{\rm CMB}(z)$ for a sample extracted from the Second Catalog of galaxy clusters produced by Planck (PSZ2) and containing 75 clusters selected from CHEX-MATE. Then we show the forecasts for future CMB experiments about the constraints on the monopole of the y-type spectral distortion of the CMB spectrum via the spectrum of the SZE.


title: The Impact of Vaccination Behavior on Disease Spreading Based on Complex Networks

abstract: Vaccination is an effective way to prevent and control the occurrence and epidemic of infectious diseases. However, many factors influence whether the residents decide to get vaccinated or not, such as the efficacy and side effects while individuals hope to obtain immunity through vaccination. In this paper, the public attitude toward vaccination is investigated, especially how it is influenced by the public estimation of vaccines efficacy and reliance on their neighbors' vaccination behavior. We find that improving people's trust in the vaccination greatly benefits increasing the vaccination rate and accelerating the vaccination process. Counterintuitively, if the individual's attitude towards vaccination is more reliant on his neighbors' vaccination behavior, more individuals will get vaccinated, and the vaccination process will speed up. Besides, individuals are more willing to get vaccinated if they have more neighbors.


title: Science, Technology and Non Equilibrium Statistical Mechanics

abstract: The binomial Science & Technology (S & T) is inseparable. In this contribution are presented some general considerations on the question of the aspect and interrelationships of the Science, Technology, Government and Society, and the role of Non Equilibrium Statistical Mechanics that are present in the nowadays highly sophisticated technologies and industrial processes that contribute to the wealth and well being of world society. The evolution of the Non Equilibrium Statistical Mechanics is briefly described. In present days remarkable development of all the modern technology, essential for the welfare and progress of the global society, imposes an immense stress on basic Physics, and consequently on Non Equilibrium Statistical Mechanics, in situations like, for example: fluids with complex structures, electronics and photonics involving systems out of equilibrium, nano-technologies, low-dimensional systems, non-linear and ultrafast processes in semiconductors devices, and soft matter. It is shown that the Non Equilibrium Statistical Mechanics can deal, within a certain degree of triumph, with some these situations, namely: 1. nonconventional thermo-hydrodynamics; 2. ultrafast relaxation processes in semiconductors devices; 3. nonequilibrium Bose-Einstein-like condensations and coherent states; 4. low-dimensional semiconductors; 5. thermo-statistics of complex structured systems; 6. nonlinear higher-order thermo-hydrodynamics; and 7. nonlinear transport in semiconductors devices. These areas are of particular interest, at the scientific, technological and at the production line, and therefore of relevance for government and society, successfully analyzed in terms of the formalism of Non Equilibrium Statistical Mechanics.


title: From social interactions to private environmental behaviours: The case of consumer food waste

abstract: Consumer food waste, like many environmental behaviours, takes place in private, and is not directly subject to social monitoring. Nevertheless, social interactions can affect private opinions and behaviours. This paper builds an agent-based model of interactions between consumers heterogeneous in their sociability, initial opinions and behaviours related to food waste and willingness to consider different opinions, in order to assess how social interactions can affect private behaviours. Compared to existing models of opinion dynamics, we innovate by including a range of ``cognitive dissonance'' between stated opinions and actual behaviours that consumers are willing to accept before changing one of the two. We calibrate the model using questionnaire data on household food waste in Italy. We find that a limited degree of mixing between different socio-demographic groups, namely adult and young consumers, is enough to trigger change, but a certain openness of mind is required from more wasteful individuals. Equally, a small group of environmentally committed consumers can attract a sizeable share of the population towards low-waste behaviours if they show a certain variability of opinions and are willing to compromise with individuals in their close neighbourhood in terms of opinions. These findings can help design effective interventions to promote pro-environmental behaviours, taking advantage of the beneficial network effects while anticipating negative externalities.


title: Learning to Cooperate with Unseen Agent via Meta-Reinforcement Learning

abstract: Ad hoc teamwork problem describes situations where an agent has to cooperate with previously unseen agents to achieve a common goal. For an agent to be successful in these scenarios, it has to have a suitable cooperative skill. One could implement cooperative skills into an agent by using domain knowledge to design the agent's behavior. However, in complex domains, domain knowledge might not be available. Therefore, it is worthwhile to explore how to directly learn cooperative skills from data. In this work, we apply meta-reinforcement learning (meta-RL) formulation in the context of the ad hoc teamwork problem. Our empirical results show that such a method could produce robust cooperative agents in two cooperative environments with different cooperative circumstances: social compliance and language interpretation. (This is a full paper of the extended abstract version.)


title: Reinforcement Learning Approach to Shortcuts between Thermodynamic States with Extra Constraints

abstract: We propose a systematic method based on reinforcement learning (RL) techniques to find the optimal path that can minimize the total entropy production between two equilibrium states of open systems at the same temperature in a given fixed time period. Benefited from the generalization of the deep RL techniques, our method can provide a powerful tool to address this problem in quantum systems even with two-dimensional continuous controllable parameters. We successfully apply our method on the classical and quantum two-level systems.


title: Numerisation D'un Siecle de Paysage Ferroviaire Fran\c{c}ais : recul du rail, cons\'equences territoriales et co\^ut environnemental

abstract: The reconstruction of geographical data over a century, allows to figuring out the evolution of the French railway landscape, and how it has been impacted by major events (eg.: WWII), or longer time span processes : industry outsourcing, metropolization, public transport policies or absence of them. This work is resulting from the fusion of several public geographical data (SNCF, IGN), enriched with the computer-assisted addition of multiple data gathered on the Internet (Wikipedia, volunteer geographic information). The dataset compounds almost every rail stations (even simple stops) and railway branch nodes, whose link to their respective rail lines allows to build the underlying consistent graph of the network. Every rail line has a "valid to" date (or approx) so that time evolution can be displayed. The present progress of that reconstruction sums up to roughly 90% of what is expected (exact total unknown). This allows to consider temporal demographic analysis (how many cities and towns served by the railway since 1925 up on today), and environmental simulations as well (CO2 cost by given destination ).


title: Detecting Edgeworth Cycles

abstract: We develop and test algorithms to detect "Edgeworth cycles," which are asymmetric price movements that have caused antitrust concerns in many countries. We formalize four existing methods and propose six new methods based on spectral analysis and machine learning. We evaluate their accuracy in station-level gasoline-price data from Western Australia, New South Wales, and Germany. Most methods achieve high accuracy in the first two, but only a few can detect the nuanced cycles in the third. Results suggest whether researchers find a positive or negative statistical relationship between cycles and markups, and hence their implications for competition policy, crucially depends on the choice of methods. We conclude with a set of practical recommendations.


title: On the role of tournament design in sporting success: A study of the North, Central American and Caribbean qualification for the 2022 FIFA World Cup

abstract: Playing in the FIFA World Cup finals is an ambition shared by several nations. Since, besides luck and skill, the probability of qualification depends on the design of the qualifiers, the study of these competitions forms an integral part of sports analytics. The Confederation of North, Central America and Caribbean Association Football (CONCACAF) announced a novel qualifying format for the 2022 FIFA World Cup in July 2019. However, the COVID-19 pandemic forced the organisers to return to a more traditional structure. The present chapter analyses how this reform impacted the chances of the national teams to qualify. It is found that the probability of participating in the FIFA World Cup finals can change by more than 5 percentage points under the assumption of fixed strengths for the teams. The idea behind the original design, to divide the contestants into two distinct sets, is worth considering due to the increased competitiveness of the matches played by the strongest and the weakest teams. We recommend mitigating the sharp nonlinearity caused by the seeding policy via a probabilistic rule to the analogy of the NBA draft lottery system.


title: Assessment of Sars-Cov-2 airborne infection transmission risk in public buses

abstract: In this study, we apply a novel combination of close proximity and room-scale risk assessment approaches for people sharing public transport environments to predict their contagion risk due to SARS-CoV-2 respiratory infection. In particular, the individual infection risk of susceptible subjects and the transmissibility of SARS-CoV-2 (expressed through the reproduction number) are evaluated for two types of buses, differing in terms of exposure time and crowding index: urban and long-distance buses. Infection risk and reproduction number are calculated for different scenarios as a function of the ventilation rates (both measured and estimated according to standards), crowding indexes, and travel times. The results show that for urban buses, the close proximity contribution significantly affects the maximum occupancy to maintain a reproductive number of < 1. In particular, full occupancy of the bus would be permitted only for an infected subject breathing, whereas for an infected subject speaking, masking would be required. For long-distance buses, full occupancy of the bus can be maintained only if specific mitigation solutions are simultaneously applied. For example, for an infected person speaking for 1 h, appropriate filtration of the recirculated air and simultaneous use of FFP2 masks would permit full occupancy of the bus for a period of almost 8 h. Otherwise, a high percentage of immunized persons (> 80%) would be needed.


title: Agent-based modelling of sports riots

abstract: Riots originating during, or in the aftermath of, sports events can incur significant costs in damages, as well as large-scale panic and injuries. A mathematical description of sports riots is therefore sought to better understand their propagation and limit these physical and financial damages. In this work, we present an agent-based modelling framework that describes the qualitative features of populations engaging in riotous behaviour. Agents, pertaining to either a 'rioter' or a 'bystander' sub-population, move on an underlying lattice and can either be recruited or defect from their respective subpopulation. In particular, we allow these individual-level recruitment and defection processes to vary with local population density. This agent-based modelling framework provides the unifying link between multi-population stochastic models and density-dependent reaction processes. Furthermore, the continuum description of this ABM framework is shown to be a system of nonlinear reaction-diffusion equations and faithfully agrees with the average ABM behaviour from individual simulations. Finally, we determine the unique correspondence between the underlying individual-level recruitment and defection mechanisms with their population-level counterparts, providing a link between local-scale effects and macroscale rioting phenomena.


title: IPAL: Breaking up Silos of Protocol-dependent and Domain-specific Industrial Intrusion Detection Systems

abstract: The increasing interconnection of industrial networks exposes them to an ever-growing risk of cyber attacks. To reveal such attacks early and prevent any damage, industrial intrusion detection searches for anomalies in otherwise predictable communication or process behavior. However, current efforts mostly focus on specific domains and protocols, leading to a research landscape broken up into isolated silos. Thus, existing approaches cannot be applied to other industries that would equally benefit from powerful detection. To better understand this issue, we survey 53 detection systems and find no fundamental reason for their narrow focus. Although they are often coupled to specific industrial protocols in practice, many approaches could generalize to new industrial scenarios in theory. To unlock this potential, we propose IPAL, our industrial protocol abstraction layer, to decouple intrusion detection from domain-specific industrial protocols. After proving IPAL's correctness in a reproducibility study of related work, we showcase its unique benefits by studying the generalizability of existing approaches to new datasets and conclude that they are indeed not restricted to specific domains or protocols and can perform outside their restricted silos.


title: Wolfram Model and the Technological Architecture of the Fourth Industrial Revolution

abstract: In this essay, we will defend the thesis that the multi-computational paradigm is a natural way of thinking about the fourth industrial revolution. This will be done considering the geometry that emerges as the continuum limit of multiway systems.


title: Time to critical condition in emergency services

abstract: Providing uninterrupted response service is of paramount importance for emergency medical services, regardless of the operating scenario. Thus, reliable estimates of the time to the critical condition, under which there will be no available servers to respond the next incoming call, become very useful measures of the system's performance. In this contribution, we develop a key performance indicator by providing an explicit formula for the average time to the shortage condition. Our analytical expression for this average time is a function of the number of parallel servers and the inter-arrival and service times. We assume exponential distributions of times in our analytical expression but for evaluating the mean first-passage time to the critical condition under more realistic scenarios we validate our result through exhaustive simulations with lognormal service time distributions. For this task we have implemented an simulator in $R$. Our results indicate that our analytical formula is an acceptable approximation under any situation of practical interest.


title: Natural Time-Series Analysis and Vedic Hindu Calendar System

abstract: Worldwide, calendars are classified into three categories, solar, lunar, and lunisolar, based on motions of Sun, Moon, and both, respectively. Being lunisolar, the Vedic Hindu calendars are capable of considering both solar and lunar activities. Therefore, these calendars can have potentially an upper hand over solar and lunar calendars. Several natural activities on the earth are due to the influences of the Sun and Moon, and the Hindu calendars are able to observe these patterns. Time series analysis plays a very crucial role in day-to-day applications and is one of the major components in the field of data science. The modern computations (including time series analysis) are performed with the Gregorian (solar) calendars. In this paper, the potential of the Hindu calendar is discussed from the time series analysis point of view. Some logical and experimental comments are discussed in this paper to motivate to dig further possibilities in the domain.


title: Conformer-based Hybrid ASR System for Switchboard Dataset

abstract: The recently proposed conformer architecture has been successfully used for end-to-end automatic speech recognition (ASR) architectures achieving state-of-the-art performance on different datasets. To our best knowledge, the impact of using conformer acoustic model for hybrid ASR is not investigated. In this paper, we present and evaluate a competitive conformer-based hybrid model training recipe. We study different training aspects and methods to improve word-error-rate as well as to increase training speed. We apply time downsampling methods for efficient training and use transposed convolutions to upsample the output sequence again. We conduct experiments on Switchboard 300h dataset and our conformer-based hybrid model achieves competitive results compared to other architectures. It generalizes very well on Hub5'01 test set and outperforms the BLSTM-based hybrid model significantly.


title: Nondestructive Testing of Composite Fibre Materials with Hyperspectral Imaging : Evaluative Studies in the EU H2020 FibreEUse Project

abstract: Through capturing spectral data from a wide frequency range along with the spatial information, hyperspectral imaging (HSI) can detect minor differences in terms of temperature, moisture and chemical composition. Therefore, HSI has been successfully applied in various applications, including remote sensing for security and defense, precision agriculture for vegetation and crop monitoring, food/drink, and pharmaceuticals quality control. However, for condition monitoring and damage detection in carbon fibre reinforced polymer (CFRP), the use of HSI is a relatively untouched area, as existing non-destructive testing (NDT) techniques focus mainly on delivering information about physical integrity of structures but not on material composition. To this end, HSI can provide a unique way to tackle this challenge. In this paper, with the use of a near-infrared HSI camera, applications of HSI for the non-destructive inspection of CFRP products are introduced, taking the EU H2020 FibreEUse project as the background. Technical challenges and solutions on three case studies are presented in detail, including adhesive residues detection, surface damage detection and Cobot based automated inspection. Experimental results have fully demonstrated the great potential of HSI and related vision techniques for NDT of CFRP, especially the potential to satisfy the industrial manufacturing environment.


title: General fractional calculus: Multi-kernel approach

abstract: For the first time, a general fractional calculus of arbitrary order was proposed by Yuri Luchko in the works Mathematics 9(6) (2021) 594 and Symmetry 13(5) (2021) 755. In these works, the proposed approaches to formulate this calculus are based either on the power of one Sonine kernel, or the convolution of one Sonine kernel with the kernels of the integer-order integrals. To apply general fractional calculus, it is useful to have a wider range of operators, for example, by using the Laplace convolution of different types of kernels. In this paper, an extended formulation of the general fractional calculus of arbitrary order is proposed. Extension is achieved by using different types (subsets) of pairs of operator kernels in definitions general fractional integrals and derivatives. For this, the definition of the Luchko pair of kernels is somewhat broadened, which leads to the symmetry of the definition of the Luchko pair. The proposed set of kernel pairs are subsets of the Luchko set of kernel pairs. The fundamental theorems for the proposed general fractional derivatives and integrals are proved.


title: Simulation of the behavior of the Leopardus guigna using random walkers

abstract: Considering that there is very little information on the behavior habits of guigna cats, as well as investigations in which small populations are captured to place radiocollars on them and then release them in the place where they were captured, which is done with the intention of collecting data on their positions in a territory and thus make estimates of the mean distances they usually travel. Under the hypothesis that guignas maintain a sedentary behavior in a specific area of a given territory, this paper shows one way to simulate a distribution of points in a territory using random walkers to emulate the distribution of the data that would be obtained by placing radiocollars in a population of guignas, with which it is possible to make estimates of the mean distances that move away from a certain fixed position, and the interactions they can have with points in the territory that represent a high probability of lethality, such as farms, packs of dogs, roads, urban areas, etc. It is necessary to mention that by estimating the possible interactions that a guignas population may have with possible predators in a territory with the help of a satellite image, it is possible to evaluate the points of a territory that represent a potentially lethal risk for the guignas, and thus generate relocation strategies that help preserve them.


title: Revealing the Global Linguistic and Geographical Disparities of Public Awareness to Covid-19 Outbreak through Social Media

abstract: The Covid-19 has presented an unprecedented challenge to public health worldwide. However, residents in different countries showed diverse levels of Covid-19 awareness during the outbreak and suffered from uneven health impacts. This study analyzed the global Twitter data from January 1st to June 30th, 2020, seeking to answer two research questions. What are the linguistic and geographical disparities of public awareness in the Covid-19 outbreak period reflected on social media? Can the changing pandemic awareness predict the Covid-19 outbreak? We established a Twitter data mining framework calculating the Ratio index to quantify and track the awareness. The lag correlations between awareness and health impacts were examined at global and country levels. Results show that users presenting the highest Covid-19 awareness were mainly those tweeting in the official languages of India and Bangladesh. Asian countries showed more significant disparities in awareness than European countries, and awareness in the eastern part of Europe was higher than in central Europe. Finally, the Ratio index could accurately predict global mortality rate, global case fatality ratio, and country-level mortality rate, with 21-30, 35-42, and 17 leading days, respectively. This study yields timely insights into social media use in understanding human behaviors for public health research.


title: Contextual Bayesian optimization with binary outputs

abstract: Bayesian optimization (BO) is an efficient method to optimize expensive black-box functions. It has been generalized to scenarios where objective function evaluations return stochastic binary feedback, such as success/failure in a given test, or preference between different parameter settings. In many real-world situations, the objective function can be evaluated in controlled 'contexts' or 'environments' that directly influence the observations. For example, one could directly alter the 'difficulty' of the test that is used to evaluate a system's performance. With binary feedback, the context determines the information obtained from each observation. For example, if the test is too easy/hard, the system will always succeed/fail, yielding uninformative binary outputs. Here we combine ideas from Bayesian active learning and optimization to efficiently choose the best context and optimization parameter on each iteration. We demonstrate the performance of our algorithm and illustrate how it can be used to tackle a concrete application in visual psychophysics: efficiently improving patients' vision via corrective lenses, using psychophysics measurements.


title: Emergence of Collective Behaviors from Local Voronoi Topological Perception

abstract: This article addresses how diverse collective behaviors arise from simple and realistic decisions made entirely at the level of each agent's personal space in the sense of the Voronoi diagram. We present a discrete time model in 2D in which individual agents are aware of their local Voronoi environment and may seek static target locations. In particular, agents only communicate directly with their Voronoi neighbors and make decisions based on the geometry of their own Voronoi cells. With two effective control parameters, it is shown numerically to capture a wide range of collective behaviors in different scenarios. Further, we show that the Voronoi topology facilitates the computation of several novel observables for quantifying discrete collective behaviors. These observables are applicable to all agent-based models and to empirical data.


title: Nuclear effects on the $\rho$ meson produced in the inclusive photonuclear reaction

abstract: The hadronic properties of the $\rho$ meson produced in the inclusive photonuclear reaction have been investigated. The elementary reaction occurring in the nucleus is assumed as $\gamma N \to \rho^0 N$. The $\rho$ meson, while propagating through the nucleus, interacts with the nuclear particles, and therefore, the properties of the $\rho$ meson can be modified because of this interaction. Being a short-lived particle, the $\rho$ meson decays to various elementary particles, such as, $e^+e^-$, $\pi^+\pi^-$, .... etc. The $e^+e^-$ invariant mass, i.e., the $\rho$ meson mass, distribution spectra have been calculated to extract the information about the parameters, viz., mass and width, of the $\rho$ meson in the nucleus. The calculated results have been compared with the data reported from Jefferson Laboratory.


title: Flow-augmentation I: Directed graphs

abstract: We show a flow-augmentation algorithm in directed graphs: There exists a randomized polynomial-time algorithm that, given a directed graph $G$, two vertices $s,t \in V(G)$, and an integer $k$, adds (randomly) to $G$ a number of arcs such that for every minimal $st$-cut $Z$ in $G$ of size at most $k$, with probability $2^{-\mathrm{poly}(k)}$ the set $Z$ becomes a minimum $st$-cut in the resulting graph. We also provide a deterministic counterpart of this procedure. The directed flow-augmentation tool allows us to prove fixed-parameter tractability of a number of problems parameterized by the cardinality of the deletion set, whose parameterized complexity status was repeatedly posed as open problems: (1) Chain SAT, defined by Chitnis, Egri, and Marx [ESA'13, Algorithmica'17], (2) a number of weighted variants of classic directed cut problems, such as Weighted $st$-Cut} or Weighted Directed Feedback Vertex Set. By proving that Chain SAT is FPT, we confirm a conjecture of Chitnis, Egri, and Marx that, for any graph $H$, if the List $H$-Coloring problem is polynomial-time solvable, then the corresponding vertex-deletion problem is fixed-parameter tractable.


title: Small UAVs-supported Autonomous Generation of Fine-grained 3D Indoor Radio Environmental Maps

abstract: Radio Environmental Maps (REMs) are a powerful tool for enhancing the performance of various communication and networked agents. However, generating REMs is a laborious undertaking, especially in complex 3-Dimensional (3D) environments, such as indoors. To address this issue, we propose a system for autonomous generation of fine-grained REMs of indoor 3D spaces. In the system, multiple small indoor Unmanned Aerial Vehicles (UAVs) are sequentially used for 3D sampling of signal quality indicators. The collected readings are streamlined to a Machine Learning (ML) system for its training and, once trained, the system is able to predict the signal quality at unknown 3D locations. The system enables automated and autonomous REM generation, and can be straightforwardly deployed in new environments. In addition, the system supports REM sampling without self-interference and is technology-agnostic, as long as the REM-sampling receivers features suitable sizes and weights to be carried by the UAVs. In the demonstration, we instantiate the system design using two UAVs and show its capability of visiting 72 waypoints and gathering thousands of Wi-Fi data samples. Our results also include an instantiation of the ML system for predicting the Received Signal Strength (RSS) of known Wi-Fi Access Points (APs) at locations not visited by the UAVs.


title: Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reports

abstract: Pre-training lays the foundation for recent successes in radiograph analysis supported by deep learning. It learns transferable image representations by conducting large-scale fully-supervised or self-supervised learning on a source domain. However, supervised pre-training requires a complex and labor intensive two-stage human-assisted annotation process while self-supervised learning cannot compete with the supervised paradigm. To tackle these issues, we propose a cross-supervised methodology named REviewing FreE-text Reports for Supervision (REFERS), which acquires free supervision signals from original radiology reports accompanying the radiographs. The proposed approach employs a vision transformer and is designed to learn joint representations from multiple views within every patient study. REFERS outperforms its transfer learning and self-supervised learning counterparts on 4 well-known X-ray datasets under extremely limited supervision. Moreover, REFERS even surpasses methods based on a source domain of radiographs with human-assisted structured labels. Thus REFERS has the potential to replace canonical pre-training methodologies.


title: Insight into the evolution of laser-induced plasma during successive deposition of laser energy

abstract: The interaction of high-temperature plasma with matter has several potential applications. In this study, we generated laser-induced plasma through single and successive laser energy deposition. The lifetime of the plasma is of paramount importance in most practical applications. However, this cannot be achieved with a single high-energy pulse due to some practical challenges. Therefore we carried out experimental and numerical investigations on the successive laser energy deposition and demonstrated its importance compared to the single pulse energy deposition. It has been observed that during successive energy deposition, the absorption of energy from the second pulse is nonlinear, and the reason for such behaviour is explained in this study. Due to the nonlinear absorption from the second pulse, this study therefore aims to present the pulse interval configuration between the successive pulses with which it is effective for practical use. In this study, some interesting and first direct observations of some new physical phenomena (generation of fourth-lobe and multiple shock waves) are observed during successive energy deposition when the pulse interval is 50 $ \mu{s} $ and 100 $ \mu{s} $. This study also adopted new approch based on Maxwell's theory of momentum exchange between light and matter to explain the newly observed and some previously unexplained physical phenomena. Finally, to understand the evolution of the laser-induced plasma, the volume and volumetric expansion rate are calculated, which can be useful in determining its lifetime and mixing rate with the surrounding medium.


title: Control of a fly-mimicking flyer in complex flow using deep reinforcement learning

abstract: An integrated framework of computational fluid-structural dynamics (CFD-CSD) and deep reinforcement learning (deep-RL) is developed for control of a fly-scale flexible-winged flyer in complex flow. Dynamics of the flyer in complex flow is highly unsteady and nonlinear, which makes modeling the dynamics challenging. Thus, conventional control methodologies, where the dynamics is modeled, are insufficient for regulating such complicated dynamics. Therefore, in the present study, the integrated framework, in which the whole governing equations for fluid and structure are solved, is proposed to generate a control policy for the flyer. For the deep-RL to successfully learn the control policy, accurate and ample data of the dynamics are required. However, satisfying both the quality and quantity of the data on the intricate dynamics is extremely difficult since, in general, more accurate data are more costly. In the present study, two strategies are proposed to deal with the dilemma. To obtain accurate data, the CFD-CSD is adopted for precisely predicting the dynamics. To gain ample data, a novel data reproduction method is devised, where the obtained data are replicated for various situations while conserving the dynamics. With those data, the framework learns the control policy in various flow conditions and the learned policy is shown to have remarkable performance in controlling the flyer in complex flow fields.


title: Formation Path Following Control of Underactuated AUVs -- With Proofs

abstract: This paper proposes a novel method for formation path following of multiple underactuated autonomous underwater vehicles. The method combines line-of-sight guidance with null-space-based behavioral control, allowing the vehicles to follow curved paths while maintaining the desired formation. We investigate the dynamics of the path-following error using cascaded systems theory, and show that the closed-loop system is uniformly semi-globally exponentially stable. We validate the theoretical results through numerical simulations.


title: Sequence learning, prediction, and replay in networks of spiking neurons

abstract: Sequence learning, prediction and replay have been proposed to constitute the universal computations performed by the neocortex. The Hierarchical Temporal Memory (HTM) algorithm realizes these forms of computation. It learns sequences in an unsupervised and continuous manner using local learning rules, permits a context specific prediction of future sequence elements, and generates mismatch signals in case the predictions are not met. While the HTM algorithm accounts for a number of biological features such as topographic receptive fields, nonlinear dendritic processing, and sparse connectivity, it is based on abstract discrete-time neuron and synapse dynamics, as well as on plasticity mechanisms that can only partly be related to known biological mechanisms. Here, we devise a continuous-time implementation of the temporal-memory (TM) component of the HTM algorithm, which is based on a recurrent network of spiking neurons with biophysically interpretable variables and parameters. The model learns high-order sequences by means of a structural Hebbian synaptic plasticity mechanism supplemented with a rate-based homeostatic control. In combination with nonlinear dendritic input integration and local inhibitory feedback, this type of plasticity leads to the dynamic self-organization of narrow sequence-specific subnetworks. These subnetworks provide the substrate for a faithful propagation of sparse, synchronous activity, and, thereby, for a robust, context specific prediction of future sequence elements as well as for the autonomous replay of previously learned sequences. By strengthening the link to biology, our implementation facilitates the evaluation of the TM hypothesis based on electrophysiological and behavioral data.


title: Error bound and exact penalty method for optimization problems with nonnegative orthogonal constraint

abstract: This paper is concerned with a class of optimization problems with the nonnegative orthogonal constraint, in which the objective function is $L$-smooth on an open set containing the Stiefel manifold ${\rm St}(n,r)$. We derive a locally Lipschitzian error bound for the feasible points without zero rows when $n>r>1$, and when $n>r=1$ or $n=r$ achieve a global Lipschitzian error bound. Then, we show that the penalty problem induced by the elementwise $\ell_1$-norm distance to the nonnegative cone is a global exact penalty, and so is the one induced by its Moreau envelope under a lower second-order calmness of the objective function. A practical penalty algorithm is developed by solving approximately a series of smooth penalty problems with a retraction-based nonmonotone line-search proximal gradient method, and any cluster point of the generated sequence is shown to be a stationary point of the original problem. Numerical comparisons with the ALM \citep{Wen13} and the exact penalty method \citep{JiangM22} indicate that our penalty method has an advantage in terms of the quality of solutions despite taking a little more time.


title: Cyber-Cosmos: A New Citizen Science Concept in A Dark Sky Destination

abstract: Astrotourism and related citizen science activities are becoming a major trend of a sustainable, high-quality tourism segment, core elements to the protection of Dark skies in many countries. In the Summer of 2020, in the middle of COVID pandemics, we started an initiative to train young students - Cyber-Cosmos - using an Unistellar eVscope, a smart, compact and user-friendly digital telescope that offers unprecedented opportunities for deep-sky observation and citizen science campaigns. Sponsored by the Ci\^encia Viva Summer program, this was probably the first continuous application of this equipment in a pedagogical and citizen-science context, and in a pandemic context. Pampilhosa da Serra, home to a certified Dark Sky destination (Aldeias do Xisto) in central Portugal, was the chosen location for this project, where we expect astrotourism and citizen science to flourish and contribute to space sciences education.


title: ProSTformer: Pre-trained Progressive Space-Time Self-attention Model for Traffic Flow Forecasting

abstract: Traffic flow forecasting is essential and challenging to intelligent city management and public safety. Recent studies have shown the potential of convolution-free Transformer approach to extract the dynamic dependencies among complex influencing factors. However, two issues prevent the approach from being effectively applied in traffic flow forecasting. First, it ignores the spatiotemporal structure of the traffic flow videos. Second, for a long sequence, it is hard to focus on crucial attention due to the quadratic times dot-product computation. To address the two issues, we first factorize the dependencies and then design a progressive space-time self-attention mechanism named ProSTformer. It has two distinctive characteristics: (1) corresponding to the factorization, the self-attention mechanism progressively focuses on spatial dependence from local to global regions, on temporal dependence from inside to outside fragment (i.e., closeness, period, and trend), and finally on external dependence such as weather, temperature, and day-of-week; (2) by incorporating the spatiotemporal structure into the self-attention mechanism, each block in ProSTformer highlights the unique dependence by aggregating the regions with spatiotemporal positions to significantly decrease the computation. We evaluate ProSTformer on two traffic datasets, and each dataset includes three separate datasets with big, medium, and small scales. Despite the radically different design compared to the convolutional architectures for traffic flow forecasting, ProSTformer performs better or the same on the big scale datasets than six state-of-the-art baseline methods by RMSE. When pre-trained on the big scale datasets and transferred to the medium and small scale datasets, ProSTformer achieves a significant enhancement and behaves best.


title: Pregeometric Spaces from Wolfram Model Rewriting Systems as Homotopy Types

abstract: How do spaces emerge from pregeometric discrete building blocks governed by computational rules? To address this, we investigate non-deterministic rewriting systems (multiway systems) of the Wolfram model. We express these rewriting systems as homotopy types. Using this new formulation, we outline how spatial structures can be functorially inherited from pregeometric type-theoretic constructions. We show how higher homotopy types are constructed from rewriting rules. These correspond to morphisms of an $n$-fold category. Subsequently, the $n \to \infty$ limit of the Wolfram model rulial multiway system is identified as an $\infty$-groupoid, with the latter being relevant given Grothendieck's homotopy hypothesis. We then go on to show how this construction extends to the classifying space of rulial multiway systems, which forms a multiverse of multiway systems and carries the formal structure of an ${\left(\infty, 1\right)}$-topos. This correspondence to higher categorical structures offers a new way to understand how spaces relevant to physics may arise from pregeometric combinatorial models. A key issue we have addressed here is to relate abstract non-deterministic rewriting systems to higher homotopy spaces. A consequence of constructing spaces and geometry synthetically is that it eliminates ad hoc assumptions about geometric attributes of a model such as an a priori background or pre-assigned geometric data. Instead, geometry is inherited functorially by higher structures. This is relevant for formally justifying different choices of underlying spacetime discretization adopted by models of quantum gravity. We conclude with comments on how our framework of higher category-theoretic combinatorial constructions, corroborates with other approaches investigating higher categorical structures relevant to the foundations of physics.


title: Misbehavior Detection Using Collective Perception under Privacy Considerations

abstract: In cooperative ITS, security and privacy protection are essential. Cooperative Awareness Message (CAM) is a basic V2V message standard, and misbehavior detection is critical for protection against attacking CAMs from the inside system, in addition to node authentication by Public Key Infrastructure (PKI). On the contrary, pseudonym IDs, which have been introduced to protect privacy from tracking, make it challenging to perform misbehavior detection. In this study, we improve the performance of misbehavior detection using observation data of other vehicles. This is referred to as collective perception message (CPM), which is becoming the new standard in European countries. We have experimented using realistic traffic scenarios and succeeded in reducing the rate of rejecting valid CAMs (false positive) by approximately 15 percentage points while maintaining the rate of correctly detecting attacks (true positive).


title: Vaccination rates modulate the correlation between country latitude and covid-19 surge date arising this autumn 2021

abstract: A clear linear correlation of covid-19 surge date with country latitude was observed last autumn 2020, but not with temperature, nor with humidity, pointing the seasonal vitamin D status decline as a contributor factor. Well vaccinated European countries are this autumn 2021 repeating explosive surges. We aim to evaluate the potential link between surge date, country latitude and population vaccination rate. Only a weak correlation was observed this autumn. However, after shifting the country latitude towards the south proportionally to its vaccination rate, a clear linear correlation was retrieved. This observation, joined to other ones, supports that vitamin D deficiency could reduce the vaccination efficiency. There is no objective benefit to hold a vitamin D deficiency. Thus, while European populations are undergoing the seasonal autumn-winter vitamin D status decline, it already makes sense to screen the elder people vitamin D status and fix individual deficiencies.


title: RADAMS: Resilient and Adaptive Alert and Attention Management Strategy against Informational Denial-of-Service (IDoS) Attacks

abstract: Attacks exploiting human attentional vulnerability have posed severe threats to cybersecurity. In this work, we identify and formally define a new type of proactive attentional attacks called Informational Denial-of-Service (IDoS) attacks that generate a large volume of feint attacks to overload human operators and hide real attacks among feints. We incorporate human factors (e.g., levels of expertise, stress, and efficiency) and empirical psychological results (e.g., the Yerkes-Dodson law and the sunk cost fallacy) to model the operators' attention dynamics and their decision-making processes along with the real-time alert monitoring and inspection. To assist human operators in dismissing the feints and escalating the real attacks timely and accurately, we develop a Resilient and Adaptive Data-driven alert and Attention Management Strategy (RADAMS) that de-emphasizes alerts selectively based on the abstracted category labels of the alerts. RADAMS uses reinforcement learning to achieve a customized and transferable design for various human operators and evolving IDoS attacks. The integrated modeling and theoretical analysis lead to the Product Principle of Attention (PPoA), fundamental limits, and the tradeoff among crucial human and economic factors. Experimental results corroborate that the proposed strategy outperforms the default strategy and can reduce the IDoS risk by as much as 20%. Besides, the strategy is resilient to large variations of costs, attack frequencies, and human attention capacities. We have recognized interesting phenomena such as attentional risk equivalency, attacker's dilemma, and the half-truth optimal attack strategy.


title: On optimization and solution of roots of a function using Taylor's expansion and fractional derivatives

abstract: A method is given for finding roots of a one-variable function using Taylor's expansion of that function and fractional derivative calculated at a suitable tangent point without using Newton's method, but is regarded as a variant of Halley and Newton's one. Several examples regarding polynomials are stated as well. Then, the given method is generalized to functions of several variables belonging to an $n$-dimensional space and one example is given for optimization and solution of a nonlinear system of equations by both our method and Gradient Descent one. A comparison of our method is made with Gradient descent one for a system of the functions of three variables. Our given method seems to be much more rapidly than the Newton's one since by finding a suitable point on the function's curve, the number of iterations is to be much less than Newton's iterative steps. We also find order of fractional derivative, which corresponds to equation's found root and compare tangent lines drawn at the root by both fractional and classical derivatives. The methods given in this paper can be used for optimization of function via fractional derivatives of order $\beta$.


title: Spatio-Temporal Urban Knowledge Graph Enabled Mobility Prediction

abstract: With the rapid development of the mobile communication technology, mobile trajectories of humans are massively collected by Internet service providers (ISPs) and application service providers (ASPs). On the other hand, the rising paradigm of knowledge graph (KG) provides us a promising solution to extract structured "knowledge" from massive trajectory data. In this paper, we focus on modeling users' spatio-temporal mobility patterns based on knowledge graph techniques, and predicting users' future movement based on the "knowledge'' extracted from multiple sources in a cohesive manner. Specifically, we propose a new type of knowledge graph, i.e., spatio-temporal urban knowledge graph (STKG), where mobility trajectories, category information of venues, and temporal information are jointly modeled by the facts with different relation types in STKG. The mobility prediction problem is converted to the knowledge graph completion problem in STKG. Further, a complex embedding model with elaborately designed scoring functions is proposed to measure the plausibility of facts in STKG to solve the knowledge graph completion problem, which considers temporal dynamics of the mobility patterns and utilizes PoI categories as the auxiliary information and background knowledge. Extensive evaluations confirm the high accuracy of our model in predicting users' mobility, i.e., improving the accuracy by 5.04% compared with the state-of-the-art algorithms. In addition, PoI categories as the background knowledge and auxiliary information are confirmed to be helpful by improving the performance by 3.85% in terms of accuracy. Additionally, experiments show that our proposed method is time-efficient by reducing the computational time by over 43.12% compared with existing methods.


title: Learning Large Neighborhood Search Policy for Integer Programming

abstract: We propose a deep reinforcement learning (RL) method to learn large neighborhood search (LNS) policy for integer programming (IP). The RL policy is trained as the destroy operator to select a subset of variables at each step, which is reoptimized by an IP solver as the repair operator. However, the combinatorial number of variable subsets prevents direct application of typical RL algorithms. To tackle this challenge, we represent all subsets by factorizing them into binary decisions on each variable. We then design a neural network to learn policies for each variable in parallel, trained by a customized actor-critic algorithm. We evaluate the proposed method on four representative IP problems. Results show that it can find better solutions than SCIP in much less time, and significantly outperform other LNS baselines with the same runtime. Moreover, these advantages notably persist when the policies generalize to larger problems. Further experiments with Gurobi also reveal that our method can outperform this state-of-the-art commercial solver within the same time limit.


title: Quantum Gravity on a Manifold with boundaries: Schr\"{o}dinger Evolution and Constraints

abstract: In this work, we derive the boundary Schr\"{o}dinger (functional) equation for the wave function of a quantum gravity system on a manifold with boundaries together with a new constraint equation defined on the timelike boundary. From a detailed analysis of the gravity boundary condition on the spatial boundary, we find that while the lapse and the shift functions are independent Lagrange multipliers on the bulk, on the spatial boundary, these two are related; namely, they are not independent. In the Hamiltonian ADM formalism, a new Lagrange multiplier, solving the boundary conditions involving the lapse and the shift functions evaluated on the spatial boundary, is introduced. The classical equation of motion associated with this Lagrange multiplier turns out to be an identity when evaluated on a classical solution of Einstein's equations. On the other hand, its quantum counterpart is a constraint equation involving the gravitational degrees of freedom defined only on the boundary. This constraint has not been taken into account before when studying the quantum gravity Schr\"{o}dinger evolution on manifolds with boundaries.


title: Results and future plans of the MoEDAL experiment

abstract: The unprecedented collision energy of the LHC has opened up a new discovery frontier. Unfortunately, signs of new physics have yet to be seen. The LHC's first dedicated search experiment, MoEDAL, started data taking for LHC Run 2. MoEDAL is designed to search highly ionising particle avatars of new physics using pp and heavy-ion collisions at the LHC. The planned upgrade for MoEDAL at Run 3 - the MAPP detector (MoEDAL Apparatus for Penetrating Particles) - will extend MoEDAL's physics reach to include feebly interacting and long-lived messengers of physics beyond the Standard Model. This will allow us to explore a number of models of new physics, including dark-sector models, in a complementary way to that of conventional LHC collider detectors. This article focuses on recent results and plans for the LHC Run 3.


title: Perturbational Complexity by Distribution Mismatch: A Systematic Analysis of Reinforcement Learning in Reproducing Kernel Hilbert Space

abstract: Most existing theoretical analysis of reinforcement learning (RL) is limited to the tabular setting or linear models due to the difficulty in dealing with function approximation in high dimensional space with an uncertain environment. This work offers a fresh perspective into this challenge by analyzing RL in a general reproducing kernel Hilbert space (RKHS). We consider a family of Markov decision processes $\mathcal{M}$ of which the reward functions lie in the unit ball of an RKHS and transition probabilities lie in a given arbitrary set. We define a quantity called perturbational complexity by distribution mismatch $\Delta_{\mathcal{M}}(\epsilon)$ to characterize the complexity of the admissible state-action distribution space in response to a perturbation in the RKHS with scale $\epsilon$. We show that $\Delta_{\mathcal{M}}(\epsilon)$ gives both the lower bound of the error of all possible algorithms and the upper bound of two specific algorithms (fitted reward and fitted Q-iteration) for the RL problem. Hence, the decay of $\Delta_\mathcal{M}(\epsilon)$ with respect to $\epsilon$ measures the difficulty of the RL problem on $\mathcal{M}$. We further provide some concrete examples and discuss whether $\Delta_{\mathcal{M}}(\epsilon)$ decays fast or not in these examples. As a byproduct, we show that when the reward functions lie in a high dimensional RKHS, even if the transition probability is known and the action space is finite, it is still possible for RL problems to suffer from the curse of dimensionality.


title: ParsiNorm: A Persian Toolkit for Speech Processing Normalization

abstract: In general, speech processing models consist of a language model along with an acoustic model. Regardless of the language model's complexity and variants, three critical pre-processing steps are needed in language models: cleaning, normalization, and tokenization. Among mentioned steps, the normalization step is so essential to format unification in pure textual applications. However, for embedded language models in speech processing modules, normalization is not limited to format unification. Moreover, it has to convert each readable symbol, number, etc., to how they are pronounced. To the best of our knowledge, there is no Persian normalization toolkits for embedded language models in speech processing modules, So in this paper, we propose an open-source normalization toolkit for text processing in speech applications. Briefly, we consider different readable Persian text like symbols (common currencies, #, @, URL, etc.), numbers (date, time, phone number, national code, etc.), and so on. Comparison with other available Persian textual normalization tools indicates the superiority of the proposed method in speech processing. Also, comparing the model's performance for one of the proposed functions (sentence separation) with other common natural language libraries such as HAZM and Parsivar indicates the proper performance of the proposed method. Besides, its evaluation of some Persian Wikipedia data confirms the proper performance of the proposed method.


title: The climatic interdependence of extreme-rainfall events around the globe

abstract: The identification of regions of similar climatological behavior can be utilized for the discovery of spatial relationships over long-range scales, including teleconnections. In this regard, the global picture of the interdependence patterns of extreme rainfall events (EREs) still needs to be further explored. To this end, we propose a top-down complex-network-based clustering workflow, with the combination of consensus clustering and mutual correspondences. Consensus clustering provides a reliable community structure under each dataset, while mutual correspondences build a matching relationship between different community structures obtained from different datasets. This approach ensures the robustness of the identified structures when multiple datasets are available. By applying it simultaneously to two satellite-derived precipitation datasets, we identify consistent synchronized structures of EREs around the globe, during boreal summer. Two of them show independent spatiotemporal characteristics, uncovering the primary compositions of different monsoon systems. They explicitly manifest the primary intraseasonal variability in the context of the global monsoon, in particular the `monsoon jump' over both East Asia and West Africa and the mid-summer drought over Central America and southern Mexico. Through a case study related to the Asian summer monsoon (ASM), we verify that the intraseasonal changes of upper-level atmospheric conditions are preserved by significant connections within the global synchronization structure. Our work advances network-based clustering methodology for (i) decoding the spatiotemporal configuration of interdependence patterns of natural variability and for (ii) the intercomparison of these patterns, especially regarding their spatial distributions over different datasets.


title: BiosecurID: a multimodal biometric database

abstract: A new multimodal biometric database, acquired in the framework of the BiosecurID project, is presented together with the description of the acquisition setup and protocol. The database includes eight unimodal biometric traits, namely: speech, iris, face (still images, videos of talking faces), handwritten signature and handwritten text (on-line dynamic signals, off-line scanned images), fingerprints (acquired with two different sensors), hand (palmprint, contour-geometry) and keystroking. The database comprises 400 subjects and presents features such as: realistic acquisition scenario, balanced gender and population distributions, availability of information about particular demographic groups (age, gender, handedness), acquisition of replay attacks for speech and keystroking, skilled forgeries for signatures, and compatibility with other existing databases. All these characteristics make it very useful in research and development of unimodal and multimodal biometric systems.


title: A Train Formation Plan with Elastic Capacity for Large-Scale Rail Networks

abstract: This paper studies the problem of optimizing the train formation plan and traffic routing (TFP&TR) simultaneously. Based on the previous research of TFP&TR with determinate parameters, we consider the fluctuation of flows and associate the elastic features of yard capacities and link capacities. To demonstrate such elastic peculiarities, the fuzzy theory is introduced and the membership function is designed to designate the satisfaction degree for the volumes of traffic flows. A non-linear integer programming model is developed considering various operational requirements and a set of capacity constraints, including link capacity, yard reclassification capacity and the maximal number of blocks a yard can be formed, while trying to minimize the total costs of accumulation, reclassification, and transportation.


title: Supervised Advantage Actor-Critic for Recommender Systems

abstract: Casting session-based or sequential recommendation as reinforcement learning (RL) through reward signals is a promising research direction towards recommender systems (RS) that maximize cumulative profits. However, the direct use of RL algorithms in the RS setting is impractical due to challenges like off-policy training, huge action spaces and lack of sufficient reward signals. Recent RL approaches for RS attempt to tackle these challenges by combining RL and (self-)supervised sequential learning, but still suffer from certain limitations. For example, the estimation of Q-values tends to be biased toward positive values due to the lack of negative reward signals. Moreover, the Q-values also depend heavily on the specific timestamp of a sequence. To address the above problems, we propose negative sampling strategy for training the RL component and combine it with supervised sequential learning. We call this method Supervised Negative Q-learning (SNQN). Based on sampled (negative) actions (items), we can calculate the "advantage" of a positive action over the average case, which can be further utilized as a normalized weight for learning the supervised sequential part. This leads to another learning framework: Supervised Advantage Actor-Critic (SA2C). We instantiate SNQN and SA2C with four state-of-the-art sequential recommendation models and conduct experiments on two real-world datasets. Experimental results show that the proposed approaches achieve significantly better performance than state-of-the-art supervised methods and existing self-supervised RL methods . Code will be open-sourced.


title: Commutative bidifferential algebra

abstract: Motivated by the Poisson Dixmier-Moeglin equivalence problem, a systematic study of commutative unitary rings equipped with a {\em biderivation}, namely a binary operation that is a derivation in each argument, is here begun, with an eye toward the geometry of the corresponding {\em $B$-varieties}. Foundational results about extending biderivations to localisations, algebraic extensions and transcendental extensions are established. Resolving a deficiency in Poisson algebraic geometry, a theory of base extension is achieved, and it is shown that dominant $B$-morphisms admit generic $B$-fibres. A bidifferential version of the Dixmier-Moeglin equivalence problem is articulated.


title: A Variational U-Net for Weather Forecasting

abstract: Not only can discovering patterns and insights from atmospheric data enable more accurate weather predictions, but it may also provide valuable information to help tackle climate change. Weather4cast is an open competition that aims to evaluate machine learning algorithms' capability to predict future atmospheric states. Here, we describe our third-place solution to Weather4cast. We present a novel Variational U-Net that combines a Variational Autoencoder's ability to consider the probabilistic nature of data with a U-Net's ability to recover fine-grained details. This solution is an evolution from our fourth-place solution to Traffic4cast 2020 with many commonalities, suggesting its applicability to vastly different domains, such as weather and traffic.


title: Data-driven Hedging of Stock Index Options via Deep Learning

abstract: We develop deep learning models to learn the hedge ratio for S&P500 index options directly from options data. We compare different combinations of features and show that a feedforward neural network model with time to maturity, Black-Scholes delta and a sentiment variable (VIX for calls and index return for puts) as input features performs the best in the out-of-sample test. This model significantly outperforms the standard hedging practice that uses the Black-Scholes delta and a recent data-driven model. Our results demonstrate the importance of market sentiment for hedging efficiency, a factor previously ignored in developing hedging strategies.


title: Numerical Investigation of a Rectangular Jet Exhausting over a Flat Plate with Periodic Surface Deformations at the Trailing Edge

abstract: In an attempt to reduce jet noise, blended wing concept vehicle utilizes rectangular jet exhaust ports exiting from above the wing ahead of the trailing edge. In this study, we take another look at the rectangular exhaust port configuration with some notional modifications to the geometry of the trailing edge to determine if the emitted noise levels due to jet interactions can be reduced with respect to a baseline configuration. We consider various horizontal and vertical offsets of the jet exit with respect to a flat plate standing in for the aft wing surface. We then introduce a series of sinusoidal deformations to the trailing edge of the plate of varying amplitude and wave number. Our results show that the emitted sound levels due to the jet--surface interactions can be significantly altered by the proposed geometry modifications. While sound levels remained fairly consistent over many configurations, there were some that showed both increased and decreased sound levels in specific directions. We present results here for the simulated configurations which showed the greatest decrease in overall sound levels with respect to the baseline. These results provide strong indications that such geometry modifications can potentially be tailored to optimize for further reductions in sound levels.


title: Long paths make pattern-counting hard, and deep trees make it harder

abstract: We study the counting problem known as #PPM, whose input is a pair of permutations $\pi$ and $\tau$ (called pattern and text, respectively), and the task is to find the number of subsequences of $\tau$ that have the same relative order as $\pi$. A simple brute-force approach solves #PPM for a pattern of length $k$ and a text of length $n$ in time $O(n^{k+1})$, while Berendsohn, Kozma and Marx have recently shown that under the exponential time hypothesis (ETH), it cannot be solved in time $f(k) n^{o(k/\log k)}$ for any function $f$. In this paper, we consider the restriction of #PPM, known as $\mathcal{C}$-Pattern #PPM, where the pattern $\pi$ must belong to a hereditary permutation class $\mathcal{C}$. Our goal is to identify the structural properties of $\mathcal{C}$ that determine the complexity of $\mathcal{C}$-Pattern #PPM. We focus on two such structural properties, known as the long path property (LPP) and the deep tree property (DTP). Assuming ETH, we obtain these results: 1. If $C$ has the LPP, then $\mathcal{C}$-Pattern #PPM cannot be solved in time $f(k)n^{o(\sqrt{k})}$ for any function $f$, and 2. if $C$ has the DTP, then $\mathcal{C}$-Pattern #PPM cannot be solved in time $f(k)n^{o(k/\log^2 k)}$ for any function $f$. Furthermore, when $\mathcal{C}$ is one of the so-called monotone grid classes, we show that if $\mathcal{C}$ has the LPP but not the DTP, then $\mathcal{C}$-Pattern #PPM can be solved in time $f(k)n^{O(\sqrt k)}$. In particular, the lower bounds above are tight up to the polylog terms in the exponents.


title: DriveGuard: Robustification of Automated Driving Systems with Deep Spatio-Temporal Convolutional Autoencoder

abstract: Autonomous vehicles increasingly rely on cameras to provide the input for perception and scene understanding and the ability of these models to classify their environment and objects, under adverse conditions and image noise is crucial. When the input is, either unintentionally or through targeted attacks, deteriorated, the reliability of autonomous vehicle is compromised. In order to mitigate such phenomena, we propose DriveGuard, a lightweight spatio-temporal autoencoder, as a solution to robustify the image segmentation process for autonomous vehicles. By first processing camera images with DriveGuard, we offer a more universal solution than having to re-train each perception model with noisy input. We explore the space of different autoencoder architectures and evaluate them on a diverse dataset created with real and synthetic images demonstrating that by exploiting spatio-temporal information combined with multi-component loss we significantly increase robustness against adverse image effects reaching within 5-6% of that of the original model on clean images.


title: Improving Visual Quality of Image Synthesis by A Token-based Generator with Transformers

abstract: We present a new perspective of achieving image synthesis by viewing this task as a visual token generation problem. Different from existing paradigms that directly synthesize a full image from a single input (e.g., a latent code), the new formulation enables a flexible local manipulation for different image regions, which makes it possible to learn content-aware and fine-grained style control for image synthesis. Specifically, it takes as input a sequence of latent tokens to predict the visual tokens for synthesizing an image. Under this perspective, we propose a token-based generator (i.e.,TokenGAN). Particularly, the TokenGAN inputs two semantically different visual tokens, i.e., the learned constant content tokens and the style tokens from the latent space. Given a sequence of style tokens, the TokenGAN is able to control the image synthesis by assigning the styles to the content tokens by attention mechanism with a Transformer. We conduct extensive experiments and show that the proposed TokenGAN has achieved state-of-the-art results on several widely-used image synthesis benchmarks, including FFHQ and LSUN CHURCH with different resolutions. In particular, the generator is able to synthesize high-fidelity images with 1024x1024 size, dispensing with convolutions entirely.


title: Target Speech Extraction: Independent Vector Extraction Guided by Supervised Speaker Identification

abstract: This manuscript proposes a novel robust procedure for the extraction of a speaker of interest (SOI) from a mixture of audio sources. The estimation of the SOI is performed via independent vector extraction (IVE). Since the blind IVE cannot distinguish the target source by itself, it is guided towards the SOI via frame-wise speaker identification based on deep learning. Still, an incorrect speaker can be extracted due to guidance failings, especially when processing challenging data. To identify such cases, we propose a criterion for non-intrusively assessing the estimated speaker. It utilizes the same model as the speaker identification, so no additional training is required. When incorrect extraction is detected, we propose a ``deflation'' step in which the incorrect source is subtracted from the mixture and, subsequently, another attempt to extract the SOI is performed. The process is repeated until successful extraction is achieved. The proposed procedure is experimentally tested on artificial and real-world datasets containing challenging phenomena: source movements, reverberation, transient noise, or microphone failures. The method is compared with state-of-the-art blind algorithms as well as with current fully supervised deep learning-based methods.


title: Event-based Motion Segmentation by Cascaded Two-Level Multi-Model Fitting

abstract: Among prerequisites for a synthetic agent to interact with dynamic scenes, the ability to identify independently moving objects is specifically important. From an application perspective, nevertheless, standard cameras may deteriorate remarkably under aggressive motion and challenging illumination conditions. In contrast, event-based cameras, as a category of novel biologically inspired sensors, deliver advantages to deal with these challenges. Its rapid response and asynchronous nature enables it to capture visual stimuli at exactly the same rate of the scene dynamics. In this paper, we present a cascaded two-level multi-model fitting method for identifying independently moving objects (i.e., the motion segmentation problem) with a monocular event camera. The first level leverages tracking of event features and solves the feature clustering problem under a progressive multi-model fitting scheme. Initialized with the resulting motion model instances, the second level further addresses the event clustering problem using a spatio-temporal graph-cut method. This combination leads to efficient and accurate event-wise motion segmentation that cannot be achieved by any of them alone. Experiments demonstrate the effectiveness and versatility of our method in real-world scenes with different motion patterns and an unknown number of independently moving objects.