title: A splitting algorithm for constrained optimization problems with parabolic equations

abstract: In this paper, an efficient parallel splitting method is proposed for the optimal control problem with parabolic equation constraints. The linear finite element is used to approximate the state variable and the control variable in spatial direction. And the Crank-Nicolson scheme is applied to discretize the constraint equation in temporal direction. For consistency, the trapezoidal rule and midpoint rule are used to approximate the integrals with respect to the state variable and the control variable of the objective function in temporal direction, respectively. Based on the separable structure of the resulting coupled discretized optimization system, a full Jacobian decomposition method with correction is adopted to solve the decoupled subsystems in parallel, which improves the computational efficiency significantly. Moreover, the global convergence estimate is established using the discretization error by the finite element and the iteration error by the full Jacobian decomposition method with correction. Finally, numerical simulations are carried out to verify the efficiency of the proposed method.


title: Optically transparent and thermally efficient 2D MoS2 heaters integrated with silicon microring resonators

abstract: Thermal tuning of the optical refractive index in the waveguides to control light phase accumulation is essential in photonic integrated systems and applications. In silicon photonics, microheaters are mainly realized by metal wires or highly doped silicon lines placed at a safe distance (1um) from the waveguide to avoid considerable optical loss. However, this poses a significant limitation for heating efficiency because of the excessive free-carrier loss when a heater is brought closer to the optical path. In this work, we present a new concept of using optically transparent 2D semiconductors (e.g. MoS2) for realizing highly efficient waveguide integrated heaters operating at telecom wavelengths. We demonstrate that a single-layer MoS2 heater with negligible optical absorption in the infrared can be placed in close proximity (only 30nm) to the waveguide and show the best-reported heating efficiency of 15 mW per FSR without sacrificing the optical insertion loss. The heater response time is 25us, limited by Au 1L-MoS2 Schottky contact. Both the efficiency and response time can be further significantly improved by realizing 2D MoS2 heaters with ohmic contacts. Our work shows clear advantages of employing 2D semiconductors for heaters applications and paves the way for developing novel energy-efficient, lossless 2D heaters for on-chip photonic integrated circuits.


title: Detecting microbiology in the upper atmosphere: relative-velocity filtered sampling

abstract: The purpose of this paper is to re-open from a practical perspective the question of the extent in altitude of the Earth's biosphere. We make a number of different suggestions for how searches for biological material could be conducted in the mesosphere and lower thermosphere, colloquially referred to as the ignoreosphere due to its lack of investigation in the meteorological community compared to other regions. Relatively recent technological advances such as CubeSats in Very Low Earth Orbit or more standard approaches such as the rocket borne MAGIC meteoric smoke particle sampler, are shown as potentially viable for sampling biological material in the ignoreosphere. The issue of contamination is discussed and a potential solution to the problem is proposed by the means of a new detector design which filters for particles based on their size and relative-velocity to the detector.

categories: astro-ph.EP astro-ph.IM physics.ao-ph physics.bio-ph


title: A New Scientific Indexing Model: U-Index

abstract: H-index has become more popular nowadays and is used for some scientific performance criteria in the world widely. This indexing method does not correctly measure any performance or carrier specifications because of the parameters that are used to form the measurement basis. H-index is located based on citation(C) and paper(N) parameters that involve no logical criterion on the counting process and so measurement on this basis can only give quantity results not any quality information. Therefore, we need a new indexing instrument to find out also the scientific quality unique to an individual author even if that takes into account the effect of multiple coauthorships. Ipso facto, we create a new bibliometric indicator or academic performance indicator called the u-index.


title: Dark Matter and $(g-2)_{e,\mu}$ in ISS(2,3) based Gauged $U(1)_{L_{e}-L{\mu}}$ Symmetric Model

abstract: We proposed a model which can explain the neutrino phenomenology, dark matter and anomalous magnetic moment$(g-2)$ in a common framework. The inverted sea saw (ISS)(2,3) mechanism has been incorporated, in which we get an extra sterile state and this state act as a viable dark matter candidate. The right handed neutrino mass is obtained in TeV scale, which is accessible at LHC. The anomaly free $U(1)_{L_{e}-L{\mu}}$ gauge symmetry is introduced to explain the anomalous magnetic moment of electron and muon because it provides a natural origin of $(g-2)$ in a very minimal setup. The corresponding MeV scale gauge boson successfully explain the anomalous magnetic moment of electron and muon$(g-2)_{e,\mu}$, simultaneously. Thus obtained neutrino phenomenology and relic abundance of dark matter are compatible with experimental results.


title: Convex subgraphs and spanning trees of the square cycles

abstract: We classify connected spanning convex subgraphs of the square cycles. We then show that every spanning tree of $C_n^2$ is contained in a unique nontrivial connected spanning convex subgraph of $C_n^2$. As a result, we obtain a purely combinatorial derivation of the formula for the number of spanning trees of the square cycles.


title: Further observations on the definition of global hyperbolicity under low regularity

abstract: The definitions of global hyperbolicity for closed cone structures and topological preordered spaces are known to coincide. In this work we clarify the connection with definitions of global hyperbolicity proposed in recent literature on Lorentzian length spaces and Lorentzian optimal transport, suggesting possible corrections for the terminology adopted in these works. It is found that in Kunzinger-S\"amann's Lorentzian length spaces the definition of global hyperbolicity coincides with that valid for closed cone structures and, more generally, for topological preordered spaces: the causal relation is a closed order and the causally convex hull operation preserves compactness. In particular, it is independent of the metric, chronological relation or Lorentzian distance.


title: Structural Controllability to Unveil Hidden Regulation Mechanisms in Unfolded Protein Response: the Role of Network Models

abstract: The Unfolded Protein Response is the cell mechanism for maintaining the balance of properly folded proteins in the endoplasmic reticulum , the specialized cellular compartment. Although it is largely studied from a biological point of view, much of the literature lacks a quantitative analysis of such a central signaling pathway. In this work, we aim to fill this gap by applying structural controllability analysis of complex networks to several Unfolded Protein Response networks to identify crucial nodes in the signaling flow. In particular, we first build different network models of the Unfolded Protein Response mechanism, relying on data contained in various protein-protein interaction databases. Then, we identify the driver nodes, essential for overall network control, i.e., the key proteins on which external stimulation may be optimally delivered to control network behavior. Our structural controllability analysis results show that the driver nodes commonly identified across databases match with known endoplasmic reticulum stress sensors. This potentially confirms that the theoretically identified drivers correspond to the biological key proteins associated with fundamental cellular activities and diseases. In conclusion, we prove that structural controllability is a reliable quantitative tool to investigate biological signaling pathways, and it can be potentially applied to networks more complex and less explored than Unfolded Protein Response.


title: Experimental Toolkit for Manipulating Executable Packing

abstract: Be it for a malicious or legitimate purpose, packing, a transformation that consists in applying various operations like compression or encryption to a binary file, i.e. for making reverse engineering harder or obfuscating code, is widely employed since decades already. Particularly in the field of malware analysis where a stumbling block is evasion, it has proven effective and still gives a hard time to scientists who want to efficiently detect it. While already extensively covered in the scientific literature, it remains an open issue especially when considering its detection time and accuracy trade-off. Many approaches, including machine learning, have been proposed but most studies often restrict their scope (i.e. malware and PE files), rely on uncertain datasets (i.e. built based on a super-detector or using labels from an questionable source) and do no provide any open implementation, which makes comparing state-of-the-art solutions tedious. Considering the many challenges that packing implies, there exists room for improvement in the way it is addressed, especially when dealing with static detection techniques. In order to tackle with these challenges, we propose an experimental toolkit, aptly called the Packing Box, leveraging automation and containerization in an open source platform that brings a unified solution to the research community and we showcase it with some experiments including unbiased ground truth generation, data visualization, machine learning pipeline automation and performance of open source packing static detectors.


title: Thermodynamically consistent diffuse-interface mixture models of incompressible multicomponent fluids

abstract: In this paper we derive a class of thermodynamically consistent diffuse-interface mixture models of incompressible multicomponent fluids. The class of mixture models is fully compatible with the continuum theory of mixtures. The resulting mixture models may be formulated either in constituent or in mixture quantities. This permits a direct comparison with the Navier-Stokes Cahn-Hilliard model with non-matching densities, which reveals the key modeling simplifications of the latter.


title: Data Augmentation for Imbalanced Regression

abstract: In this work, we consider the problem of imbalanced data in a regression framework when the imbalanced phenomenon concerns continuous or discrete covariates. Such a situation can lead to biases in the estimates. In this case, we propose a data augmentation algorithm that combines a weighted resampling (WR) and a data augmentation (DA) procedure. In a first step, the DA procedure permits exploring a wider support than the initial one. In a second step, the WR method drives the exogenous distribution to a target one. We discuss the choice of the DA procedure through a numerical study that illustrates the advantages of this approach. Finally, an actuarial application is studied.


title: Dust ion-acoustic dromions in Saturn's magnetosphere

abstract: Motivated by observations of localized electrostatic wavepackets by the Cassini and (earlier) by Voyager 1 and 2 mission(s) in Saturn's magnetosphere, we have investigated the existence conditions and the dynamical evolution of localized multi-dimensional structures in the Saturnian dusty plasma environment. To this effect, we have adopted a plasma-fluid model for dust-ion acoustic (DIA) excitations, taking into account the presence of a highly energetic (suprathermal, kappa-distributed) electron population in combination with massive dust particulates in the background. A multiple scales perturbation method was shown to lead to a Davey-Stewartson (DS) system of evolution equations, if one assumes perpendicular carrier wave propagation across the magnetic field (direction). The system is then shown to possess two regimes mainly, known in the literature as DS-I and DS-II. In the former case, if certain conditions are fulfilled, exponentially localized solutions are obtained, known as dromions. The combined effects of various physical parameters such as the electron spectral index, the ambient magnetic field (strength), and the dust concentration have been examined. A numerical investigation reveals that the dromion amplitude increases with higher dust concentration, while it decreases for lower $\kappa_e$ (i.e. with an increase in the suprathermal electron population component). A stronger magnetic field results in higher amplitude but narrower dromions. Our results provide a comprehensive framework for modeling modulated electrostatic wavepackets, in direct comparison with experimental data in planetary environments, in Saturn's magnetosphere, and elsewhere.


title: Uplink Power Control for Extremely Large-Scale MIMO with Multi-Agent Reinforcement Learning and Fuzzy Logic

abstract: In this paper, we investigate the uplink transmit power optimization problem in cell-free (CF) extremely large-scale multiple-input multiple-output (XL-MIMO) systems. Instead of applying the traditional methods, we propose two signal processing architectures: the centralized training and centralized execution with fuzzy logic as well as the centralized training and decentralized execution with fuzzy logic, respectively, which adopt the amalgamation of multi-agent reinforcement learning (MARL) and fuzzy logic to solve the design problem of power control for the maximization of the system spectral efficiency (SE). Furthermore, the uplink performance of the system adopting maximum ratio (MR) combining and local minimum mean-squared error (L-MMSE) combining is evaluated. Our results show that the proposed methods with fuzzy logic outperform the conventional MARL-based method and signal processing methods in terms of computational complexity. Also, the SE performance under MR combining is even better than that of the conventional MARL-based method.


title: ARIS: An open source platform for developing mobile learning experiences

abstract: Inspired by mobile, Internet enabled computing and the maturing field of educational game design, the ARIS project has designed an open source tool for rapidly producing locative, interactive, narrative-centric, educational experiences. In addition to the software, the project contributes a global community of active designers and a growing set of compelling mechanics for learners in such designs.


title: FrAug: Frequency Domain Augmentation for Time Series Forecasting

abstract: Data augmentation (DA) has become a de facto solution to expand training data size for deep learning. With the proliferation of deep models for time series analysis, various time series DA techniques are proposed in the literature, e.g., cropping-, warping-, flipping-, and mixup-based methods. However, these augmentation methods mainly apply to time series classification and anomaly detection tasks. In time series forecasting (TSF), we need to model the fine-grained temporal relationship within time series segments to generate accurate forecasting results given data in a look-back window. Existing DA solutions in the time domain would break such a relationship, leading to poor forecasting accuracy. To tackle this problem, this paper proposes simple yet effective frequency domain augmentation techniques that ensure the semantic consistency of augmented data-label pairs in forecasting, named FrAug. We conduct extensive experiments on eight widely-used benchmarks with several state-of-the-art TSF deep models. Our results show that FrAug can boost the forecasting accuracy of TSF models in most cases. Moreover, we show that FrAug enables models trained with 1\% of the original training data to achieve similar performance to the ones trained on full training data, which is particularly attractive for cold-start forecasting. Finally, we show that applying test-time training with FrAug greatly improves forecasting accuracy for time series with significant distribution shifts, which often occurs in real-life TSF applications. Our code is available at https://anonymous.4open.science/r/Fraug-more-results-1785.


title: Periodicity Intensity Reveals Insights into Time Series Data: Three Use Cases

abstract: Periodic phenomena are oscillating signals found in many naturally-occurring time series. A periodogram can be used to measure the intensities of oscillations at different frequencies over an entire time series but sometimes we are interested in measuring how periodicity intensity at a specific frequency varies throughout the time series. This can be done by calculating periodicity intensity within a window then sliding and recalculating the intensity for the window, giving an indication of how periodicity intensity at a specific frequency changes throughout the series. We illustrate three applications of this the first of which is movements of a herd of new-born calves where we show how intensity of the 24h periodicity increases and decreases synchronously across the herd. We also show how changes in 24h periodicity intensity of activities detected from in-home sensors can be indicative of overall wellness. We illustrate this on several weeks of sensor data gathered from each of the homes of 23 older adults. Our third application is the intensity of 7-day periodicity of hundreds of University students accessing online resources from a virtual learning environment (VLE) and how the regularity of their weekly learning behaviours changes throughout a teaching semester. The paper demonstrates how periodicity intensity reveals insights into time series data not visible using other forms of analysis


title: Platform-Independent and Curriculum-Oriented Intelligent Assistant for Higher Education

abstract: Miscommunication and communication challenges between instructors and students represents one of the primary barriers to post-secondary learning. Students often avoid or miss opportunities to ask questions during office hours due to insecurities or scheduling conflicts. Moreover, students need to work at their own pace to have the freedom and time for the self-contemplation needed to build conceptual understanding and develop creative thinking skills. To eliminate barriers to student engagement, academic institutions need to redefine their fundamental approach to education by proposing flexible educational pathways that recognize continuous learning. To this end, we developed an AI-augmented intelligent educational assistance framework based on a power language model (i.e., GPT-3) that automatically generates course-specific intelligent assistants regardless of discipline or academic level. The virtual intelligent teaching assistant (TA) system will serve as a voice-enabled helper capable of answering course-specific questions concerning curriculum, logistics and course policies. It is envisioned to improve access to course-related information for the students and reduce logistical workload for the instructors and TAs. Its GPT-3-based knowledge discovery component as well as the generalized system architecture is presented accompanied by a methodical evaluation of the system accuracy and performance.


title: Mimetic Muscle Rehabilitation Analysis Using Clustering of Low Dimensional 3D Kinect Data

abstract: Facial nerve paresis is a severe complication that arises post-head and neck surgery; This results in articulation problems, facial asymmetry, and severe problems in non-verbal communication. To overcome the side effects of post-surgery facial paralysis, rehabilitation requires which last for several weeks. This paper discusses an unsupervised approach to rehabilitating patients who have temporary facial paralysis due to damage in mimetic muscles. The work aims to make the rehabilitation process objective compared to the current subjective approach, such as House-Brackmann (HB) scale. Also, the approach will assist clinicians by reducing their workload in assessing the improvement during rehabilitation. This paper focuses on the clustering approach to monitor the rehabilitation process. We compare the results obtained from different clustering algorithms on various forms of the same data set, namely dynamic form, data expressed as functional data using B-spline basis expansion, and by finding the functional principal components of the functional data. The study contains data set of 85 distinct patients with 120 measurements obtained using a Kinect stereo-vision camera. The method distinguish effectively between patients with the least and greatest degree of facial paralysis, however patients with adjacent degrees of paralysis provide some challenges. In addition, we compared the cluster results to the HB scale outputs.


title: A note on the Cohen type theorem and the Eakin-Nagata type theorem for uniformly $S$-Noetherian rings

abstract: In this note, we give the Cohen type theorem for uniformly $S$-Noetherian modules and the Eakin-Nagata type theorem for uniformly $S$-Noetherian rings. We also solve an open question proposed by Kim and Lim [5,Question 4.10].


title: Subsidizing agricultural inputs in Senegal: Comparative analysis of three modes of intervention using a farm household model

abstract: This report presents the results of an ex-ante impact assessment of several scenarios related to the farmer targeting of the input subsidy programme currently implemented in Senegal. This study has been achieved with the agricultural household model FSSIM-Dev, calibrated on a sample of 2 278 farm households from the ESPS-2 survey. The impacts on crop mix, fertilizer application, farm income and on the government cost are presented and discussed.


title: Improving Fairness in Adaptive Social Exergames via Shapley Bandits

abstract: Algorithmic fairness is an essential requirement as AI becomes integrated in society. In the case of social applications where AI distributes resources, algorithms often must make decisions that will benefit a subset of users, sometimes repeatedly or exclusively, while attempting to maximize specific outcomes. How should we design such systems to serve users more fairly? This paper explores this question in the case where a group of users works toward a shared goal in a social exergame called Step Heroes. We identify adverse outcomes in traditional multi-armed bandits (MABs) and formalize the Greedy Bandit Problem. We then propose a solution based on a new type of fairness-aware multi-armed bandit, Shapley Bandits. It uses the Shapley Value for increasing overall player participation and intervention adherence rather than the maximization of total group output, which is traditionally achieved by favoring only high-performing participants. We evaluate our approach via a user study (n=46). Our results indicate that our Shapley Bandits effectively mediates the Greedy Bandit Problem and achieves better user retention and motivation across the participants.


title: LIGHT-SABRE hyperpolarizes 1-^{13}C-pyruvate continuously, without magnetic field cycling

abstract: Nuclear spin hyperpolarization enables real-time observation of metabolism and intermolecular interactions in vivo. 1-13C-Pyruvate is the leading hyperpolarized tracer currently under evaluation in several clinical trials as a promising molecular imaging agent. Still, the quest for a simple, fast, and efficient hyperpolarization technique is ongoing. Here, we describe that continuous, weak irradiation in the audio-frequency range of the 13C spin at 121 {\mu}T magnetic field (\sim twiceEarth\apos s field) enables spin order transfer from parahydrogen to 13C magnetization of 1-13C-pyruvate. These so-called LIGHT-SABRE pulses couple nuclear spin states of parahydrogen and pyruvate via the J-coupling network of reversibly exchanging Ir-complexes. Using \sim 100% parahydrogen at ambient pressure, we polarized 51 mM of 1-13C-pyruvate in the presence of 5.1 mM Ir-complex continuously and repeatedly to a polarization of 1.1% averaged over free and catalyst-bound pyruvate. The experiments were conducted at -8{\deg}C), where almost exclusively bound pyruvate was observed, corresponding to an estimated 11% polarization on bound pyruvate. The obtained hyperpolarization levels closely match those obtained via SABRE-SHEATH under otherwise identical conditions. The creation of three different types of spin orders was observed: transverse 13C magnetization along the applied magnetic field, 13C z-magnetization along the main field B_0, and 13C-1H zz-spin-order. With a superconducting quantum interference device (SQUID) for detection, we found that the generated spin orders result from tiny 1H-13C J-coupling interactions, which are not visible even with our narrow linewidth below 0.3 Hz.


title: Search-Engine-augmented Dialogue Response Generation with Cheaply Supervised Query Production

abstract: Knowledge-aided dialogue response generation aims at augmenting chatbots with relevant external knowledge in the hope of generating more informative responses. The majority of previous work assumes that the relevant knowledge is given as input or retrieved from a static pool of knowledge. However, this assumption violates the real-world situation, where knowledge is continually updated and a chatbot has to dynamically retrieve useful knowledge. We propose a dialogue model that can access the vast and dynamic information from any search engine for response generation. As the core module, a query producer is used to generate queries from a dialogue context to interact with a search engine. We design a training algorithm using cheap noisy supervision for the query producer, where the signals are obtained by comparing retrieved articles with the next dialogue response. As the result, the query producer is adjusted without any human annotation of gold queries, making it easily transferable to other domains and search engines. Experiments show that our query producer can achieve R@1 and R@5 rates of 62.4% and 74.8% for retrieving gold knowledge, and the overall model generates better responses over strong knowledge-aided baselines using BART and other typical systems.


title: Exploring the Representation Manifolds of Stable Diffusion Through the Lens of Intrinsic Dimension

abstract: Prompting has become an important mechanism by which users can more effectively interact with many flavors of foundation model. Indeed, the last several years have shown that well-honed prompts can sometimes unlock emergent capabilities within such models. While there has been a substantial amount of empirical exploration of prompting within the community, relatively few works have studied prompting at a mathematical level. In this work we aim to take a first step towards understanding basic geometric properties induced by prompts in Stable Diffusion, focusing on the intrinsic dimension of internal representations within the model. We find that choice of prompt has a substantial impact on the intrinsic dimension of representations at both layers of the model which we explored, but that the nature of this impact depends on the layer being considered. For example, in certain bottleneck layers of the model, intrinsic dimension of representations is correlated with prompt perplexity (measured using a surrogate model), while this correlation is not apparent in the latent layers. Our evidence suggests that intrinsic dimension could be a useful tool for future studies of the impact of different prompts on text-to-image models.


title: Bridge the Gap between Language models and Tabular Understanding

abstract: Table pretrain-then-finetune paradigm has been proposed and employed at a rapid pace after the success of pre-training in the natural language domain. Despite the promising findings in tabular pre-trained language models (TPLMs), there is an input gap between pre-training and fine-tuning phases. For instance, TPLMs jointly pre-trained with table and text input could be effective for tasks also with table-text joint input like table question answering, but it may fail for tasks with only tables or text as input such as table retrieval. To this end, we propose UTP, an approach that dynamically supports three types of multi-modal inputs: table-text, table, and text. Specifically, UTP is pre-trained with two strategies: (1) We first utilize a universal mask language modeling objective on each kind of input, enforcing the model to adapt various inputs. (2) We then present Cross-Modal Contrastive Regularization (CMCR), which utilizes contrastive learning to encourage the consistency between table-text cross-modality representations via unsupervised instance-wise training signals during pre-training. By these means, the resulting model not only bridges the input gap between pre-training and fine-tuning but also advances in the alignment of table and text. Extensive results show UTP achieves superior results on uni-modal input tasks (e.g., table retrieval) and cross-modal input tasks (e.g., table question answering).


title: Stress Test for BERT and Deep Models: Predicting Words from Italian Poetry

abstract: In this paper we present a set of experiments carried out with BERT on a number of Italian sentences taken from poetry domain. The experiments are organized on the hypothesis of a very high level of difficulty in predictability at the three levels of linguistic complexity that we intend to monitor: lexical, syntactic and semantic level. To test this hypothesis we ran the Italian version of BERT with 80 sentences for a total of 900 tokens mostly extracted from Italian poetry of the first half of last century. Then we alternated canonical and noncanonical versions of the same sentence before processing them with the same DL model. We used then sentences from the newswire domain containing similar syntactic structures. The results show that the DL model is highly sensitive to presence of noncanonical structures. However, DLs are also very sensitive to word frequency and to local non literal meaning compositional effect. This is also apparent by the preference for predicting function vs content words, collocates vs infrequent word phrases. In the paper, we focused our attention on the use of subword units done by BERT for out of vocabulary words.


title: Interpretability in Activation Space Analysis of Transformers: A Focused Survey

abstract: The field of natural language processing has reached breakthroughs with the advent of transformers. They have remained state-of-the-art since then, and there also has been much research in analyzing, interpreting, and evaluating the attention layers and the underlying embedding space. In addition to the self-attention layers, the feed-forward layers in the transformer are a prominent architectural component. From extensive research, we observe that its role is under-explored. We focus on the latent space, known as the Activation Space, that consists of the neuron activations from these feed-forward layers. In this survey paper, we review interpretability methods that examine the learnings that occurred in this activation space. Since there exists only limited research in this direction, we conduct a detailed examination of each work and point out potential future directions of research. We hope our work provides a step towards strengthening activation space analysis.


title: Structure function tensor equations with triple decomposition

abstract: Exact budget equations are derived for the coherent and stochastic contributions to the second-order structure function tensor. They extend the anisotropic generalised Kolmogorov equations (AGKE) by considering the coherent and stochastic parts of the Reynolds stress tensor, and are useful for the statistical description of turbulent flows with periodic or quasi-periodic features, like e.g. the alternate shedding after a bluff body. While the original AGKE describe production, transport, inter-component redistribution and dissipation of the Reynolds stresses in the combined space of scales and positions, the new equations, called $\varphi$AGKE, contain the phase $\varphi$ as an additional independent variable, and describe the interplay among the mean, coherent and stochastic fields at the various phases. The newly derived $\varphi$AGKE are then applied to a case where an exactly periodic external forcing drives the flow: a turbulent plane channel flow modified by harmonic spanwise oscillations of the wall to reduce drag. The phase-by-phase action of the oscillating transversal Stokes layer generated by the forcing on the near-wall turbulent structures is observed, and a detailed description of the scale-space interaction among mean, coherent and stochastic fields is provided thanks to the $\varphi$AGKE.


title: On the stability of two-dimensional modulated electrostatic wavepackets in non-Maxwellian dusty plasma-application in Saturn's magnetosphere

abstract: Motivated by observations of localized electrostatic wavepackets by the Voyager 1 and 2 and Cassini missions in Saturn's magnetosphere, we have investigated the evolution of modulated electrostatic wavepackets in a dusty plasma environment. The well-known dust-ion acoustic (DIA) mode was selected to explore the dynamics of multi-dimensional structures, by means of a Davey-Stewartson (DS) model, by taking into account the presence of a highly energetic (suprathermal, kappa-distributed) electron population in combination with heavy (immobile) dust in the background. The modulational (in)stability profile of DIA wavepackets for both negative as well as positive dust charge is investigated. A set of explicit criteria for modulational instability (MI) to occur is obtained. Wavepacket modulation properties in 3D dusty plasmas are shown to differ from e.g. Maxwellian plasmas in 1D. Stronger negative dust concentration results in a narrower instability window in the $K$ (perturbation wavenumber) domain and a suppressed growth rate. In the opposite manner, the instability growth rate increases for higher positive dust concentrations and the instability window gets larger. In a nutshell, negative dust seems to suppress instability while positive dust appears to favor the amplitude modulation instability mechanism.


title: Vanishing of the second $L^p$-cohomology group for most semisimple groups of rank at least 3

abstract: We show vanishing of the second $L^p$-cohomology group for most semisimple algebraic groups of rank at least 3 over local fields. More precisely, we show this result for $\SL(4)$, for simple groups of rank $\geq 4$ that are not of exceptional type or of type $D_4$ and for all semisimple, non-simple groups of rank $\geq 3$. Our methods work for large values of $p$ in the real case and for all $p>1$ in the non-Archimedean case. This result points towards a positive answer to Gromov's question on vanishing of $L^p$-cohomology of semisimple groups for all $p>1$ in degrees below the rank. The methods consist in using a spectral sequence \`a la Bourdon-R\'emy, adapting a version of Mautner's phenomenon from Cornulier-Tessera and concluding thanks to a combinatorial case-by-case study of classical simple groups.


title: Consistency Tests for Comparing Astrophysical Models and Observations

abstract: In astronomy, there is an opportunity to enhance the practice of validating models through statistical techniques, specifically to account for measurement error uncertainties. While models are commonly used to describe observations, there are instances where there is a lack of agreement between the two. This can occur when models are derived from incomplete theories, when a better-fitting model is not available or when measurement uncertainties are not correctly considered. However, with the application of specific tests that assess the consistency between observations and astrophysical models in a model-independent way, it is possible to address this issue. The consistency tests (ConTESTs) developed in this paper use a combination of non-parametric methods and distance measures to obtain a test statistic that evaluates the closeness of the astrophysical model to the observations. To draw conclusions on the consistency hypothesis, a simulation-based methodology is performed. In particular, we built two tests for density models and two for regression models to be used depending on the case at hand and the power of the test needed. We used ConTEST to examine synthetic examples in order to determine the effectiveness of the tests and provide guidance on using them while building a model. We also applied ConTEST to various astronomy cases, identifying which models were consistent and, if not, identifying the probable causes of rejection.


title: StyleAdv: Meta Style Adversarial Training for Cross-Domain Few-Shot Learning

abstract: Cross-Domain Few-Shot Learning (CD-FSL) is a recently emerging task that tackles few-shot learning across different domains. It aims at transferring prior knowledge learned on the source dataset to novel target datasets. The CD-FSL task is especially challenged by the huge domain gap between different datasets. Critically, such a domain gap actually comes from the changes of visual styles, and wave-SAN empirically shows that spanning the style distribution of the source data helps alleviate this issue. However, wave-SAN simply swaps styles of two images. Such a vanilla operation makes the generated styles ``real'' and ``easy'', which still fall into the original set of the source styles. Thus, inspired by vanilla adversarial learning, a novel model-agnostic meta Style Adversarial training (StyleAdv) method together with a novel style adversarial attack method is proposed for CD-FSL. Particularly, our style attack method synthesizes both ``virtual'' and ``hard'' adversarial styles for model training. This is achieved by perturbing the original style with the signed style gradients. By continually attacking styles and forcing the model to recognize these challenging adversarial styles, our model is gradually robust to the visual styles, thus boosting the generalization ability for novel target datasets. Besides the typical CNN-based backbone, we also employ our StyleAdv method on large-scale pretrained vision transformer. Extensive experiments conducted on eight various target datasets show the effectiveness of our method. Whether built upon ResNet or ViT, we achieve the new state of the art for CD-FSL. Code is available at https://github.com/lovelyqian/StyleAdv-CDFSL.


title: On Handling Catastrophic Forgetting for Incremental Learning of Human Physical Activity on the Edge

abstract: Human activity recognition (HAR) has been a classic research problem. In particular, with recent machine learning (ML) techniques, the recognition task has been largely investigated by companies and integrated into their products for customers. However, most of them apply a predefined activity set and conduct the learning process on the cloud, hindering specific personalizations from end users (i.e., edge devices). Even though recent progress in Incremental Learning allows learning new-class data on the fly, the learning process is generally conducted on the cloud, requiring constant data exchange between cloud and edge devices, thus leading to data privacy issues. In this paper, we propose PILOTE, which pushes the incremental learning process to the extreme edge, while providing reliable data privacy and practical utility, e.g., low processing latency, personalization, etc. In particular, we consider the practical challenge of extremely limited data during the incremental learning process on edge, where catastrophic forgetting is required to be handled in a practical way. We validate PILOTE with extensive experiments on human activity data collected from mobile sensors. The results show PILOTE can work on edge devices with extremely limited resources while providing reliable performance.


title: Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fields

abstract: Temporal interpolation often plays a crucial role to learn meaningful representations in dynamic scenes. In this paper, we propose a novel method to train spatiotemporal neural radiance fields of dynamic scenes based on temporal interpolation of feature vectors. Two feature interpolation methods are suggested depending on underlying representations, neural networks or grids. In the neural representation, we extract features from space-time inputs via multiple neural network modules and interpolate them based on time frames. The proposed multi-level feature interpolation network effectively captures features of both short-term and long-term time ranges. In the grid representation, space-time features are learned via four-dimensional hash grids, which remarkably reduces training time. The grid representation shows more than 100 times faster training speed than the previous neural-net-based methods while maintaining the rendering quality. Concatenating static and dynamic features and adding a simple smoothness term further improve the performance of our proposed models. Despite the simplicity of the model architectures, our method achieved state-of-the-art performance both in rendering quality for the neural representation and in training speed for the grid representation.


title: Urine Dataset having eight particles classes

abstract: Urine sediment examination (USE) is one of the main tests used in the evaluation of diseases such as kidney, urinary, metabolic, and diabetes and to determine the density and number of various cells in the urine. USE's manual microscopy is a labor-intensive and time-consuming, imprecise, subjective process. Recently, automatic analysis of urine sediment has become inevitable in the medical field. In this study, we propose a dataset that can be used by artificial intelligence techniques to automatically identify particles in urine sediment images. The data set consists of 8509 particle images obtained by examining the particles in the urine sediment obtained from 409 patients from the Biochemistry Clinics of Elazig Fethi Sekin Central Hospital. Particle images are collected in 8 classes in total and these are Erythrocyte, Leukocyte, Epithelial, Bacteria, Yeast, Cylinders, Crystals, and others (sperm, etc.).


title: Evolution of ion acoustic solitary waves in pulsar wind

abstract: We have studied the evolution of ion-acoustic solitary waves (IASWs) in pulsar wind. The pulsar wind is modeled by considering a weakly relativistic unmagnetized collisionless plasma comprised of relativistic ions and superthermal electrons and positrons. Through fluid simulations, we have demonstrated that the localized ion density perturbations generated in the polar wind plasma can evolve the relativistic IASW pulses. It is found that the concentration of positrons, relativistic factor, superthermality of electrons, and positrons have a significant influence on the dynamical evolution of IASW pulses. Our results may provide insight to understand the evolution of IASW pulses and their role in astrophysical plasmas, especially in the relativistic pulsar winds with supernova outflow which is responsible for the production of superthermal particles and relativistic ions.


title: Heat equation with singular thermal conductivity

abstract: In this paper, we study the heat equation with an irregular spatially dependent thermal conductivity coefficient. We prove that it has a solution in an appropriate very weak sense. Moreover, the uniqueness result and consistency with the classical solution if the latter exists are shown. Indeed, we allow the coefficient to be a distribution with a toy example of a Delta-function.


title: Differential Aggregation against General Colluding Attackers

abstract: Local Differential Privacy (LDP) is now widely adopted in large-scale systems to collect and analyze sensitive data while preserving users' privacy. However, almost all LDP protocols rely on a semi-trust model where users are curious-but-honest, which rarely holds in real-world scenarios. Recent works show poor estimation accuracy of many LDP protocols under malicious threat models. Although a few works have proposed some countermeasures to address these attacks, they all require prior knowledge of either the attacking pattern or the poison value distribution, which is impractical as they can be easily evaded by the attackers. In this paper, we adopt a general opportunistic-and-colluding threat model and propose a multi-group Differential Aggregation Protocol (DAP) to improve the accuracy of mean estimation under LDP. Different from all existing works that detect poison values on individual basis, DAP mitigates the overall impact of poison values on the estimated mean. It relies on a new probing mechanism EMF (i.e., Expectation-Maximization Filter) to estimate features of the attackers. In addition to EMF, DAP also consists of two EMF post-processing procedures (EMF* and CEMF*), and a group-wise mean aggregation scheme to optimize the final estimated mean to achieve the smallest variance. Extensive experimental results on both synthetic and real-world datasets demonstrate the superior performance of DAP over state-of-the-art solutions.


title: Multi-timescale Trading Strategy for Renewable Power to Ammonia Virtual Power Plant in the Electricity, Hydrogen, and Ammonia Markets

abstract: Renewable power to ammonia (RePtA) is a prominent zero-carbon pathway for decarbonization. Due to the imbalance between renewables and production energy demand, the RePtA system relies on the electricity exchange with the power grid. Participating in the electricity market as a virtual power plant (VPP) may help to reduce energy costs. However, the power profile of local photovoltaics and wind turbines is similar to those in the market, resulting in rising energy costs under the conventional strategy. Hence, we develop a multi-timescale trading strategy for the RePtA VPP in the electricity, hydrogen, and ammonia markets. By utilizing the hydrogen and ammonia buffer systems, the RePtA VPP can optimally coordinate production planning. Moreover, we find it possible to describe the trading of electricity, ammonia, and hydrogen in a unified framework. The two-stage robust optimization model of the electricity market is extended to multiple markets and solved by the column and constraint generation (CC\&G) algorithm. The case is derived from an actual project in the Inner Mongolia Autonomous Region. Sensitivity analysis demonstrates the economic advantages of an RePtA VPP joining multiple markets over conventional strategy and reveals the necessity of the hydrogen and ammonia buffer and reactor's flexibility.


title: Reproducing Random Forest Efficacy in Detecting Port Scanning

abstract: Port scanning is the process of attempting to connect to various network ports on a computing endpoint to determine which ports are open and which services are running on them. It is a common method used by hackers to identify vulnerabilities in a network or system. By determining which ports are open, an attacker can identify which services and applications are running on a device and potentially exploit any known vulnerabilities in those services. Consequently, it is important to detect port scanning because it is often the first step in a cyber attack. By identifying port scanning attempts, cybersecurity professionals can take proactive measures to protect the systems and networks before an attacker has a chance to exploit any vulnerabilities. Against this background, researchers have worked for over a decade to develop robust methods to detect port scanning. One such method revealed by a recent systematic review is the random forest supervised machine learning algorithm. The review revealed six existing studies using random forest since 2021. Unfortunately, those studies each exhibit different results, do not all use the same training and testing dataset, and only two include source code. Accordingly, the goal of this work was to reproduce the six random forest studies while addressing the apparent shortcomings. The outcomes are significant for researchers looking to explore random forest to detect port scanning and for practitioners interested in reliable technology to detect the early stages of cyber attack.


title: Effective Multimodal Reinforcement Learning with Modality Alignment and Importance Enhancement

abstract: Many real-world applications require an agent to make robust and deliberate decisions with multimodal information (e.g., robots with multi-sensory inputs). However, it is very challenging to train the agent via reinforcement learning (RL) due to the heterogeneity and dynamic importance of different modalities. Specifically, we observe that these issues make conventional RL methods difficult to learn a useful state representation in the end-to-end training with multimodal information. To address this, we propose a novel multimodal RL approach that can do multimodal alignment and importance enhancement according to their similarity and importance in terms of RL tasks respectively. By doing so, we are able to learn an effective state representation and consequentially improve the RL training process. We test our approach on several multimodal RL domains, showing that it outperforms state-of-the-art methods in terms of learning speed and policy quality.


title: MAILS -- Meta AI Literacy Scale: Development and Testing of an AI Literacy Questionnaire Based on Well-Founded Competency Models and Psychological Change- and Meta-Competencies

abstract: The goal of the present paper is to develop and validate a questionnaire to assess AI literacy. In particular, the questionnaire should be deeply grounded in the existing literature on AI literacy, should be modular (i.e., including different facets that can be used independently of each other) to be flexibly applicable in professional life depending on the goals and use cases, and should meet psychological requirements and thus includes further psychological competencies in addition to the typical facets of AIL. We derived 60 items to represent different facets of AI Literacy according to Ng and colleagues conceptualisation of AI literacy and additional 12 items to represent psychological competencies such as problem solving, learning, and emotion regulation in regard to AI. For this purpose, data were collected online from 300 German-speaking adults. The items were tested for factorial structure in confirmatory factor analyses. The result is a measurement instrument that measures AI literacy with the facets Use & apply AI, Understand AI, Detect AI, and AI Ethics and the ability to Create AI as a separate construct, and AI Self-efficacy in learning and problem solving and AI Self-management. This study contributes to the research on AI literacy by providing a measurement instrument relying on profound competency models. In addition, higher-order psychological competencies are included that are particularly important in the context of pervasive change through AI systems.


title: Anomaly Detection of UAV State Data Based on Single-class Triangular Global Alignment Kernel Extreme Learning Machine

abstract: Unmanned Aerial Vehicles (UAVs) are widely used and meet many demands in military and civilian fields. With the continuous enrichment and extensive expansion of application scenarios, the safety of UAVs is constantly being challenged. To address this challenge, we propose algorithms to detect anomalous data collected from drones to improve drone safety. We deployed a one-class kernel extreme learning machine (OCKELM) to detect anomalies in drone data. By default, OCKELM uses the radial basis (RBF) kernel function as the kernel function of the model. To improve the performance of OCKELM, we choose a Triangular Global Alignment Kernel (TGAK) instead of an RBF Kernel and introduce the Fast Independent Component Analysis (FastICA) algorithm to reconstruct UAV data. Based on the above improvements, we create a novel anomaly detection strategy FastICA-TGAK-OCELM. The method is finally validated on the UCI dataset and detected on the Aeronautical Laboratory Failures and Anomalies (ALFA) dataset. The experimental results show that compared with other methods, the accuracy of this method is improved by more than 30%, and point anomalies are effectively detected.


title: Implicit Solvent Approach Based on Generalised Born and Transferable Graph Neural Networks for Molecular Dynamics Simulations

abstract: Molecular dynamics (MD) simulations enable the study of the motion of small and large (bio)molecules and the estimation of their conformational ensembles. The description of the environment (solvent) has thereby a large impact. Implicit solvent representations are efficient but in many cases not accurate enough (especially for polar solvents such as water). More accurate but also computationally more expensive is the explicit treatment of the solvent molecules. Recently, machine learning (ML) has been proposed to bridge the gap and simulate in an implicit manner explicit solvation effects. However, the current approaches rely on prior knowledge of the entire conformational space, limiting their application in practice. Here, we introduce a graph neural network (GNN) based implicit solvent that is capable of describing explicit solvent effects for peptides with different composition than contained in the training set.


title: Optimization of Cartesian Tasks with Configuration Selection

abstract: A basic task in the design of an industrial robot application is the relative placement of robot and workpiece. Process points are defined in Cartesian coordinates relative to the workpiece coordinate system, and the workpiece has to be located such that the robot can reach all points. Finding such a location is still an iterative procedure based on the developers' intuition. One difficulty is the choice of one of the several solutions of the backward transform of a typical 6R robot. % combined with the limited range of the axes. We present a novel algorithm that simultaneously optimizes the workpiece location and the robot configuration at all process points using higher order optimization algorithms. A key ingredient is the extension of the robot with a virtual prismatic axis. The practical feasibility of the approach is shown with an example using a commercial industrial robot.


title: Heterogeneous Graph Convolutional Neural Network via Hodge-Laplacian for Brain Functional Data

abstract: This study proposes a novel heterogeneous graph convolutional neural network (HGCNN) to handle complex brain fMRI data at regional and across-region levels. We introduce a generic formulation of spectral filters on heterogeneous graphs by introducing the $k-th$ Hodge-Laplacian (HL) operator. In particular, we propose Laguerre polynomial approximations of HL spectral filters and prove that their spatial localization on graphs is related to the polynomial order. Furthermore, based on the bijection property of boundary operators on simplex graphs, we introduce a generic topological graph pooling (TGPool) method that can be used at any dimensional simplices. This study designs HL-node, HL-edge, and HL-HGCNN neural networks to learn signal representation at a graph node, edge levels, and both, respectively. Our experiments employ fMRI from the Adolescent Brain Cognitive Development (ABCD; n=7693) to predict general intelligence. Our results demonstrate the advantage of the HL-edge network over the HL-node network when functional brain connectivity is considered as features. The HL-HGCNN outperforms the state-of-the-art graph neural networks (GNNs) approaches, such as GAT, BrainGNN, dGCN, BrainNetCNN, and Hypergraph NN. The functional connectivity features learned from the HL-HGCNN are meaningful in interpreting neural circuits related to general intelligence.


title: Optimising Human-Machine Collaboration for Efficient High-Precision Information Extraction from Text Documents

abstract: While humans can extract information from unstructured text with high precision and recall, this is often too time-consuming to be practical. Automated approaches, on the other hand, produce nearly-immediate results, but may not be reliable enough for high-stakes applications where precision is essential. In this work, we consider the benefits and drawbacks of various human-only, human-machine, and machine-only information extraction approaches. We argue for the utility of a human-in-the-loop approach in applications where high precision is required, but purely manual extraction is infeasible. We present a framework and an accompanying tool for information extraction using weak-supervision labelling with human validation. We demonstrate our approach on three criminal justice datasets. We find that the combination of computer speed and human understanding yields precision comparable to manual annotation while requiring only a fraction of time, and significantly outperforms fully automated baselines in terms of precision.


title: MDS Array Codes With (Near) Optimal Repair Bandwidth for All Admissible Repair Degrees

abstract: Abundant high-rate (n, k) minimum storage regenerating (MSR) codes have been reported in the literature. However, most of them require contacting all the surviving nodes during a node repair process, resulting in a repair degree of d=n-1. In practical systems, it may not always be feasible to connect and download data from all surviving nodes, as some nodes may be unavailable. Therefore, there is a need for MSR code constructions with a repair degree of d<n-1. Up to now, only a few (n, k) MSR code constructions with repair degree d<n-1 have been reported, some have a large sub-packetization level, a large finite field, or restrictions on the repair degree d. In this paper, we propose a new (n, k) MSR code construction that works for any repair degree d>k, and has a smaller sub-packetization level or finite field than some existing constructions. Additionally, in conjunction with a previous generic transformation to reduce the sub-packetization level, we obtain an MDS array code with a small sub-packetization level and $(1+\epsilon)$-optimal repair bandwidth (i.e., $(1+\epsilon)$ times the optimal repair bandwidth) for repair degree d=n-1. This code outperforms some existing ones in terms of either the sub-packetization level or the field size.


title: An Adaptive Plug-and-Play Network for Few-Shot Learning

abstract: Few-shot learning (FSL) requires a model to classify new samples after learning from only a few samples. While remarkable results are achieved in existing methods, the performance of embedding and metrics determines the upper limit of classification accuracy in FSL. The bottleneck is that deep networks and complex metrics tend to induce overfitting in FSL, making it difficult to further improve the performance. Towards this, we propose plug-and-play model-adaptive resizer (MAR) and adaptive similarity metric (ASM) without any other losses. MAR retains high-resolution details to alleviate the overfitting problem caused by data scarcity, and ASM decouples the relationship between different metrics and then fuses them into an advanced one. Extensive experiments show that the proposed method could boost existing methods on two standard dataset and a fine-grained datasets, and achieve state-of-the-art results on mini-ImageNet and tiered-ImageNet.


title: Transformadores: Fundamentos teoricos y Aplicaciones

abstract: Transformers are a neural network architecture originally designed for natural language processing that it is now a mainstream tool for solving a wide variety of problems, including natural language processing, sound, image, reinforcement learning, and other problems with heterogeneous input data. Its distinctive feature is its self-attention system, based on attention to one's own sequence, which derives from the previously introduced attention system. This article provides the reader with the necessary context to understand the most recent research articles and presents the mathematical and algorithmic foundations of the elements that make up this type of network. The different components that make up this architecture and the variations that may exist are also studied, as well as some applications of the transformer models. This article is in Spanish to bring this scientific knowledge to the Spanish-speaking community.


title: SSVMR: Saliency-based Self-training for Video-Music Retrieval

abstract: With the rise of short videos, the demand for selecting appropriate background music (BGM) for a video has increased significantly, video-music retrieval (VMR) task gradually draws much attention by research community. As other cross-modal learning tasks, existing VMR approaches usually attempt to measure the similarity between the video and music in the feature space. However, they (1) neglect the inevitable label noise; (2) neglect to enhance the ability to capture critical video clips. In this paper, we propose a novel saliency-based self-training framework, which is termed SSVMR. Specifically, we first explore to fully make use of the information containing in the training dataset by applying a semi-supervised method to suppress the adverse impact of label noise problem, where a self-training approach is adopted. In addition, we propose to capture the saliency of the video by mixing two videos at span level and preserving the locality of the two original videos. Inspired by back translation in NLP, we also conduct back retrieval to obtain more training data. Experimental results on MVD dataset show that our SSVMR achieves the state-of-the-art performance by a large margin, obtaining a relative improvement of 34.8% over the previous best model in terms of R@1.


title: Faithfulness of the 2-Braid Group via Zigzag Algebra in Type B

abstract: We show that certain category of bimodules over a finite dimensional quiver algebra known as type B zigzag algebra is a quotient category of the category of type B Soergel bimodules. This leads to an alternate proof of Rouquier's conjecture on the faithfulness of the 2-braid groups for type B.


title: Practical Flaky Test Prediction using Common Code Evolution and Test History Data

abstract: Non-deterministically behaving test cases cause developers to lose trust in their regression test suites and to eventually ignore failures. Detecting flaky tests is therefore a crucial task in maintaining code quality, as it builds the necessary foundation for any form of systematic response to flakiness, such as test quarantining or automated debugging. Previous research has proposed various methods to detect flakiness, but when trying to deploy these in an industrial context, their reliance on instrumentation, test reruns, or language-specific artifacts was inhibitive. In this paper, we therefore investigate the prediction of flaky tests without such requirements on the underlying programming language, CI, build or test execution framework. Instead, we rely only on the most commonly available artifacts, namely the tests' outcomes and durations, as well as basic information about the code evolution to build predictive models capable of detecting flakiness. Furthermore, our approach does not require additional reruns, since it gathers this data from existing test executions. We trained several established classifiers on the suggested features and evaluated their performance on a large-scale industrial software system, from which we collected a data set of 100 flaky and 100 non-flaky test- and code-histories. The best model was able to achieve an F1-score of 95.5% using only 3 features: the tests' flip rates, the number of changes to source files in the last 54 days, as well as the number of changed files in the most recent pull request.


title: Front-End Adapter: Adapting Front-End Input of Speech based Self-Supervised Learning for Speech Recognition

abstract: Recent years have witnessed a boom in self-supervised learning (SSL) in various areas including speech processing. Speech based SSL models present promising performance in a range of speech related tasks. However, the training of SSL models is computationally expensive and a common practice is to fine-tune a released SSL model on the specific task. It is essential to use consistent front-end input during pre-training and fine-tuning. This consistency may introduce potential issues when the optimal front-end is not the same as that used in pre-training. In this paper, we propose a simple but effective front-end adapter to address this front-end discrepancy. By minimizing the distance between the outputs of different front-ends, the filterbank feature (Fbank) can be compatible with SSL models which are pre-trained with waveform. The experiment results demonstrate the effectiveness of our proposed front-end adapter on several popular SSL models for the speech recognition task.


title: Incipient Fault Detection in Power Distribution System: A Time-Frequency Embedded Deep Learning Based Approach

abstract: Incipient fault detection in power distribution systems is crucial to improve the reliability of the grid. However, the non-stationary nature and the inadequacy of the training dataset due to the self-recovery of the incipient fault signal, make the incipient fault detection in power distribution systems a great challenge. In this paper, we focus on incipient fault detection in power distribution systems and address the above challenges. In particular, we propose an ADaptive Time-Frequency Memory(AD-TFM) cell by embedding wavelet transform into the Long Short-Term Memory (LSTM), to extract features in time and frequency domain from the non-stationary incipient fault signals.We make scale parameters and translation parameters of wavelet transform learnable to adapt to the dynamic input signals. Based on the stacked AD-TFM cells, we design a recurrent neural network with ATtention mechanism, named AD-TFM-AT model, to detect incipient fault with multi-resolution and multi-dimension analysis. In addition, we propose two data augmentation methods, namely phase switching and temporal sliding, to effectively enlarge the training datasets. Experimental results on two open datasets show that our proposed AD-TFM-AT model and data augmentation methods achieve state-of-the-art (SOTA) performance of incipient fault detection in power distribution system. We also disclose one used dataset logged at State Grid Corporation of China to facilitate future research.


title: On the local everywhere bounndedness of the minima of a class of integral functionals of the Calculus of the Variations

abstract: In this paper we study the regularity and the boundedness of the minima of two classes of functionals of the calculus of variations


title: Eco-evolutionary Dynamics of Non-episodic Neuroevolution in Large Multi-agent Environments

abstract: Neuroevolution (NE) has recently proven a competitive alternative to learning by gradient descent in reinforcement learning tasks. However, the majority of NE methods and associated simulation environments differ crucially from biological evolution: the environment is reset to initial conditions at the end of each generation, whereas natural environments are continuously modified by their inhabitants; agents reproduce based on their ability to maximize rewards within a population, while biological organisms reproduce and die based on internal physiological variables that depend on their resource consumption; simulation environments are primarily single-agent while the biological world is inherently multi-agent and evolves alongside the population. In this work we present a method for continuously evolving adaptive agents without any environment or population reset. The environment is a large grid world with complex spatiotemporal resource generation, containing many agents that are each controlled by an evolvable recurrent neural network and locally reproduce based on their internal physiology. The entire system is implemented in JAX, allowing very fast simulation on a GPU. We show that NE can operate in an ecologically-valid non-episodic multi-agent setting, finding sustainable collective foraging strategies in the presence of a complex interplay between ecological and evolutionary dynamics.


title: Knowledge Graph Completion based on Tensor Decomposition for Disease Gene Prediction

abstract: Accurate identification of disease genes has consistently been one of the keys to decoding a disease's molecular mechanism. Most current approaches focus on constructing biological networks and utilizing machine learning, especially, deep learning to identify disease genes, but ignore the complex relations between entities in the biological knowledge graph. In this paper, we construct a biological knowledge graph centered on diseases and genes, and develop an end-to-end Knowledge graph completion model for Disease Gene Prediction using interactional tensor decomposition (called KDGene). KDGene introduces an interaction module between the embeddings of entities and relations to tensor decomposition, which can effectively enhance the information interaction in biological knowledge. Experimental results show that KDGene significantly outperforms state-of-the-art algorithms. Furthermore, the comprehensive biological analysis of the case of diabetes mellitus confirms KDGene's ability for identifying new and accurate candidate genes. This work proposes a scalable knowledge graph completion framework to identify disease candidate genes, from which the results are promising to provide valuable references for further wet experiments.


title: Pulse in collapse: a game dynamics experiment

abstract: The collapse process is a constitutional sub-process in the full finding Nash equilibrium process. We conducted laboratory game experiments with human subjects to study this process. We observed significant pulse signals in the collapse process. The observations from the data support the completeness and the consistency of the game dynamics paradigm.


title: Revealing intrinsic vortex-core states in Fe-based superconductors through machine-learning-driven discovery

abstract: Electronic states within superconducting vortices hold crucial information about paring mechanisms and topology. While scanning tunneling microscopy/spectroscopy(STM/S) can image the vortices, it is difficult to isolate the intrinsic electronic states from extrinsic effects like subsurface defects and disorders. We combine STM/S with unsupervised machine learning to develop a method for screening out the vortices pinned by embedded disorder in Fe-based superconductors. The approach provides an unbiased way to reveal intrinsic vortex-core states and may address puzzles on Majorana zero modes.


title: Resource Allocation for Cell-free Massive MIMO-enabled URLLC Downlink Systems

abstract: Ultra-reliable and low-latency communication (URLLC) is a pivotal technique for enabling the wireless control over industrial Internet-of-Things (IIoT) devices. By deploying distributed access points (APs), cell-free massive multiple-input and multiple-output (CF mMIMO) has great potential to provide URLLC services for IIoT devices. In this paper, we investigate CF mMIMO-enabled URLLC in a smart factory. Lower bounds (LBs) of downlink ergodic data rate under finite channel blocklength (FCBL) with imperfect channel state information (CSI) are derived for maximum-ratio transmission (MRT), full-pilot zero-forcing (FZF), and local zero-forcing (LZF) precoding schemes. Meanwhile, the weighted sum rate is maximized by jointly optimizing the pilot power and transmission power based on the derived LBs. Specifically, we first provide the globally optimal solution of the pilot power, and then introduce some approximations to transform the original problems into a series of subproblems, which can be expressed in a geometric programming (GP) form that can be readily solved. Finally, an iterative algorithm is proposed to optimize the power allocation based on various precoding schemes. Simulation results demonstrate that the proposed algorithm is superior to the existing algorithms, and that the quality of URLLC services will benefit by deploying more APs, except for the FZF precoding scheme.


title: Efficient Exploration via Epistemic-Risk-Seeking Policy Optimization

abstract: Exploration remains a key challenge in deep reinforcement learning (RL). Optimism in the face of uncertainty is a well-known heuristic with theoretical guarantees in the tabular setting, but how best to translate the principle to deep reinforcement learning, which involves online stochastic gradients and deep network function approximators, is not fully understood. In this paper we propose a new, differentiable optimistic objective that when optimized yields a policy that provably explores efficiently, with guarantees even under function approximation. Our new objective is a zero-sum two-player game derived from endowing the agent with an epistemic-risk-seeking utility function, which converts uncertainty into value and encourages the agent to explore uncertain states. We show that the solution to this game minimizes an upper bound on the regret, with the 'players' each attempting to minimize one component of a particular regret decomposition. We derive a new model-free algorithm which we call 'epistemic-risk-seeking actor-critic' (ERSAC), which is simply an application of simultaneous stochastic gradient ascent-descent to the game. Finally, we discuss a recipe for incorporating off-policy data and show that combining the risk-seeking objective with replay data yields a double benefit in terms of statistical efficiency. We conclude with some results showing good performance of a deep RL agent using the technique on the challenging 'DeepSea' environment, showing significant performance improvements even over other efficient exploration techniques, as well as improved performance on the Atari benchmark.


title: Ensemble Ranking Model with Multiple Pretraining Strategies for Web Search

abstract: An effective ranking model usually requires a large amount of training data to learn the relevance between documents and queries. User clicks are often used as training data since they can indicate relevance and are cheap to collect, but they contain substantial bias and noise. There has been some work on mitigating various types of bias in simulated user clicks to train effective learning-to-rank models based on multiple features. However, how to effectively use such methods on large-scale pre-trained models with real-world click data is unknown. To alleviate the data bias in the real world, we incorporate heuristic-based features, refine the ranking objective, add random negatives, and calibrate the propensity calculation in the pre-training stage. Then we fine-tune several pre-trained models and train an ensemble model to aggregate all the predictions from various pre-trained models with human-annotation data in the fine-tuning stage. Our approaches won 3rd place in the "Pre-training for Web Search" task in WSDM Cup 2023 and are 22.6% better than the 4th-ranked team.


title: A Heterogeneous Multiscale Method for Power System Simulation Considering Electromagnetic Transients

abstract: Traditional dynamic security assessment faces challenges as power systems are experiencing a transformation to inverter-based-resource (IBR) dominated systems, for which electromagnetic transient (EMT) dynamics have to be considered. However, EMT simulation is time-consuming especially for a large power grid because the mathematical model based on detailed component modeling is highly stiff and needs to be integrated at tiny time steps due to numerical stability. This paper proposes a heterogeneous multiscale method (HMM) to address the simulation of a power system considering EMT dynamics as a multiscale problem. The method aims to accurately simulate the macroscopic dynamics of the system even when EMT dynamics are dominating. By force estimation using a kernel function, the proposed method automatically generates a macro model on the fly of simulation based on the micro model of EMT dynamics. It can flexibly switch between the micro- and macro-models to capture important EMT dynamics during some time intervals while skipping over other time intervals of less interest to achieve a superior simulation speed. The method is illustrated by a case study on a two-machine EMT model to demonstrate its potential for power system simulation.


title: Semi-Analytical Electromagnetic Transient Simulation Using Differential Transformation

abstract: For electromagnetic transient (EMT) simulation of a power system, a state-space-based approach needs to solve state-space EMT equations by using numerical integration methods, e.g., the Euler method, Runge-Kutta methods, and trapezoidal-rule method, at small time steps. The simulation can be slow on a power system having multiple generators. To speed up state-space-based EMT simulations, this paper proposes a Differential Transformation based semi-analytical method that repeatedly utilizes a high-order semi-analytical solution of the EMT equations at longer time steps. The proposed semi-analytical method is tested on the detailed EMT model of a four-generator two-area system. Simulation results show the significant potential of the proposed method to accelerate EMT simulations of power systems compared with traditional numerical methods.


title: An adaptive exact penalty method for nonsmooth optimal control problems with nonsmooth nonconvex state and control constraints

abstract: A class of exact penalty-type local search methods for optimal control problems with nonsmooth cost functional, nonsmooth (but continuous) dynamics, and nonsmooth state and control constraints is presented, in which the the penalty parameter and several line search parameters are adaptively adjusted during the optimisation process. This class of methods is applicable to problems having a known DC (Difference-of-Convex functions) structure and in its core is based on the classical DCA method, combined with the steering exact penalty rules for updating the penalty parameter and an adaptive nonmonotone line search procedure. Under the assumption that all auxiliary subproblems are solved only approximately (that is, with finite precision), we prove the correctness of the proposed family of methods and present its detailed convergence analysis. The performance of several different versions of the method is illustrated by means of a numerical example, in which the methods are applied to a semi-academic optimal control problem with a nonsmooth nonconvex state constraint.


title: Beyond Distribution Shift: Spurious Features Through the Lens of Training Dynamics

abstract: Deep Neural Networks (DNNs) are prone to learning spurious features that correlate with the label during training but are irrelevant to the learning problem. This hurts model generalization and poses problems when deploying them in safety-critical applications. This paper aims to better understand the effects of spurious features through the lens of the learning dynamics of the internal neurons during the training process. We make the following observations: (1) While previous works highlight the harmful effects of spurious features on the generalization ability of DNNs, we emphasize that not all spurious features are harmful. Spurious features can be "benign" or "harmful" depending on whether they are "harder" or "easier" to learn than the core features for a given model. This definition is model and dataset-dependent. (2) We build upon this premise and use instance difficulty methods (like Prediction Depth (Baldock et al., 2021)) to quantify "easiness" for a given model and to identify this behavior during the training phase. (3) We empirically show that the harmful spurious features can be detected by observing the learning dynamics of the DNN's early layers. In other words, easy features learned by the initial layers of a DNN early during the training can (potentially) hurt model generalization. We verify our claims on medical and vision datasets, both simulated and real, and justify the empirical success of our hypothesis by showing the theoretical connections between Prediction Depth and information-theoretic concepts like V-usable information (Ethayarajh et al., 2021). Lastly, our experiments show that monitoring only accuracy during training (as is common in machine learning pipelines) is insufficient to detect spurious features. We, therefore, highlight the need for monitoring early training dynamics using suitable instance difficulty metrics.


title: Improving the Out-Of-Distribution Generalization Capability of Language Models: Counterfactually-Augmented Data is not Enough

abstract: Counterfactually-Augmented Data (CAD) has the potential to improve language models' Out-Of-Distribution (OOD) generalization capability, as CAD induces language models to exploit causal features and exclude spurious correlations. However, the empirical results of OOD generalization on CAD are not as efficient as expected. In this paper, we attribute the inefficiency to Myopia Phenomenon caused by CAD: language models only focus on causal features that are edited in the augmentation and exclude other non-edited causal features. As a result, the potential of CAD is not fully exploited. Based on the structural properties of CAD, we design two additional constraints to help language models extract more complete causal features contained in CAD, thus improving the OOD generalization capability. We evaluate our method on two tasks: Sentiment Analysis and Natural Language Inference, and the experimental results demonstrate that our method could unlock CAD's potential and improve language models' OOD generalization capability.


title: Redes Generativas Adversarias (GAN) Fundamentos Te\'oricos y Aplicaciones

abstract: Generative adversarial networks (GANs) are a method based on the training of two neural networks, one called generator and the other discriminator, competing with each other to generate new instances that resemble those of the probability distribution of the training data. GANs have a wide range of applications in fields such as computer vision, semantic segmentation, time series synthesis, image editing, natural language processing, and image generation from text, among others. Generative models model the probability distribution of a data set, but instead of providing a probability value, they generate new instances that are close to the original distribution. GANs use a learning scheme that allows the defining attributes of the probability distribution to be encoded in a neural network, allowing instances to be generated that resemble the original probability distribution. This article presents the theoretical foundations of this type of network as well as the basic architecture schemes and some of its applications. This article is in Spanish to facilitate the arrival of this scientific knowledge to the Spanish-speaking community.


title: Closed-Loop Transcription via Convolutional Sparse Coding

abstract: Autoencoding has achieved great empirical success as a framework for learning generative models for natural images. Autoencoders often use generic deep networks as the encoder or decoder, which are difficult to interpret, and the learned representations lack clear structure. In this work, we make the explicit assumption that the image distribution is generated from a multi-stage sparse deconvolution. The corresponding inverse map, which we use as an encoder, is a multi-stage convolution sparse coding (CSC), with each stage obtained from unrolling an optimization algorithm for solving the corresponding (convexified) sparse coding program. To avoid computational difficulties in minimizing distributional distance between the real and generated images, we utilize the recent closed-loop transcription (CTRL) framework that optimizes the rate reduction of the learned sparse representations. Conceptually, our method has high-level connections to score-matching methods such as diffusion models. Empirically, our framework demonstrates competitive performance on large-scale datasets, such as ImageNet-1K, compared to existing autoencoding and generative methods under fair conditions. Even with simpler networks and fewer computational resources, our method demonstrates high visual quality in regenerated images. More surprisingly, the learned autoencoder performs well on unseen datasets. Our method enjoys several side benefits, including more structured and interpretable representations, more stable convergence, and scalability to large datasets. Our method is arguably the first to demonstrate that a concatenation of multiple convolution sparse coding/decoding layers leads to an interpretable and effective autoencoder for modeling the distribution of large-scale natural image datasets.


title: Explicit criterion of uniform LP duality for linear problems of copositive optimization

abstract: An uniform LP duality is an useful property of conic matrix systems. A consistent linear conic optimization problem yields uniform LP duality if for any linear cost function, for which the primal problem has finite optimal value, the corresponding Lagrange dual problem is attainable and the duality gap vanishes. In this paper, we establish new necessary and sufficient conditions guaranteing the uniform LP duality for linear problems of Copositive Programming and formulate these conditions in different equivalent forms. The main results are obtained using an approach developed in previous papers of the authors and based on a concept of immobile indices that permits alternative representations of the set of feasible solutions.


title: New measurement of the elemental fragmentation cross sections of 218 MeV/nucleon 28 Si on a carbon target

abstract: Elemental fragmentation cross sections (EFCSs) of stable and unstable nuclides have been investigated with various projectile-target combinations at a wide range of incident energies. These data are critical to constrain and develop the theoretical reaction models and to study the propagation of galactic cosmic rays (GCR). In this work, we present a new EFCS measurement for $^{28}$Si on carbon at 218~MeV/nucleon performed at the Heavy Ion Research Facility (HIRFL-CSR) complex in Lanzhou. The impact of the target thickness has been well corrected to derive an accurate EFCS. Our present results with charge changes $\Delta Z$ = 1-6 are compared to the previous measurements and to the predictions from the models modified EPAX2, EPAX3, FRACS, ABRABLA07, NUCFRG2, and IQMD coupled with GEMINI (IQMD+GEMINI). All the models fail to describe the odd-even staggering strength in the elemental distribution, with the exception of the IQMD+GEMINI model, which can reproduce the EFCSs with an accuracy of better than 3.5\% for $\Delta Z\leq5$. The IQMD+GEMINI analysis shows that the odd-even staggering in EFCSs occurs in the sequential statistical decay stage rather than in the initial dynamical collision stage. This offers a reasonable approach to understand the underlying mechanism of fragmentation reactions.


title: BERT is not The Count: Learning to Match Mathematical Statements with Proofs

abstract: We introduce a task consisting in matching a proof to a given mathematical statement. The task fits well within current research on Mathematical Information Retrieval and, more generally, mathematical article analysis (Mathematical Sciences, 2014). We present a dataset for the task (the MATcH dataset) consisting of over 180k statement-proof pairs extracted from modern mathematical research articles. We find this dataset highly representative of our task, as it consists of relatively new findings useful to mathematicians. We propose a bilinear similarity model and two decoding methods to match statements to proofs effectively. While the first decoding method matches a proof to a statement without being aware of other statements or proofs, the second method treats the task as a global matching problem. Through a symbol replacement procedure, we analyze the "insights" that pre-trained language models have in such mathematical article analysis and show that while these models perform well on this task with the best performing mean reciprocal rank of 73.7, they follow a relatively shallow symbolic analysis and matching to achieve that performance.


title: High Accuracy Distributed Kalman Filtering for Frequency and Phase Synchronization in Distributed Phased Arrays

abstract: Precise frequency and phase synchronization are among the important aspects in a coherent distributed phased array antenna system, and are among the most challenging to achieve for microwave frequencies and above. We propose a high accuracy distributed Kalman filter (HA-DKF) in which the nodes in the array perform consensus averaging on their locally shared measurements, the innovation noise covariances, and the KF-predicted as well as the KF-updated estimates and error covariances, yielding improved electrical state synchronization compared to other works in the literature. We evaluate the algorithm through simulation and show that it converges in fewer iterations and yields better electrical state synchronization than other algorithms.


title: MaxGNR: A Dynamic Weight Strategy via Maximizing Gradient-to-Noise Ratio for Multi-Task Learning

abstract: When modeling related tasks in computer vision, Multi-Task Learning (MTL) can outperform Single-Task Learning (STL) due to its ability to capture intrinsic relatedness among tasks. However, MTL may encounter the insufficient training problem, i.e., some tasks in MTL may encounter non-optimal situation compared with STL. A series of studies point out that too much gradient noise would lead to performance degradation in STL, however, in the MTL scenario, Inter-Task Gradient Noise (ITGN) is an additional source of gradient noise for each task, which can also affect the optimization process. In this paper, we point out ITGN as a key factor leading to the insufficient training problem. We define the Gradient-to-Noise Ratio (GNR) to measure the relative magnitude of gradient noise and design the MaxGNR algorithm to alleviate the ITGN interference of each task by maximizing the GNR of each task. We carefully evaluate our MaxGNR algorithm on two standard image MTL datasets: NYUv2 and Cityscapes. The results show that our algorithm outperforms the baselines under identical experimental conditions.


title: A Framework for Transmission Design for Active RIS-Aided Communication with Partial CSI

abstract: Active reconfigurable intelligent surfaces (RISs) have recently been proposed to compensate for the severe multiplicative fading effect of conventional passive RIS-aided systems. Each reflecting element of active RISs is assisted by an amplifier such that the incident signal can be reflected and amplified instead of only being reflected as in passive RIS-aided systems. This work addresses the practical challenge that, on the one hand, in active RIS-aided systems the perfect individual CSI of the RIS-aided channels cannot be acquired due to the lack of signal processing power at the active RISs, but, on the other hand, this CSI is required to calculate the expected system data rate and RIS transmit power needed for transceiver design. To address this issue, we first derive closed-form expressions for the average achievable rate and the average RIS transmit power based on partial CSI of the RIS-aided channels. Then, we formulate an average achievable rate maximization problem for jointly optimizing the active beamforming at both the base station (BS) and the RIS. This problem is then tackled using the majorization--minimization (MM) algorithm framework, and, for each iteration, semi-closed-form solutions for the BS and RIS beamforming are derived based on the Karush-Kuhn-Tucker (KKT) conditions. To ensure the quality of service (QoS) of each user, we further formulate a rate outage constrained beamforming problem, which is solved using the Bernstein-Type inequality (BTI) and semidefinite relaxation (SDR) techniques. Numerical results show that the proposed algorithms can efficiently overcome the challenges imposed by imperfect CSI in active RIS-aided wireless systems.


title: From Homological Algebra to Topology via Type B Zigzag Algebra and Heisenberg Algebra

abstract: We construct a faithful categorical action of the type $B$ braid group on the bounded homotopy category of finitely generated projective modules over a finite dimensional algebra which we call the type $B$ zigzag algebra. This categorical action is closely related to the action of the type $B$ braid group on curves on the disc. Thus, our exposition can be seen as a type $B$ analogue of the work of Khovanov-Seidel in arXiv:math/0006056. Moreover, we relate our topological (respectively categorical) action of the type $B$ Artin braid group to their topological (respectively categorical) action of the type $A$ Artin braid group. Then, we prove Rouquier's conjecture, that is Conjecture 3.8 in arXiv:math/0409593 on the faithfulness of Type $B$ $2$-braid group on Soergel category following the strategy used by Jensen's master's thesis with the diagrammatic tools from arXiv:1309.0865. In the final part of the thesis, we produce a graded Fock vector in the Laurent ring $\mathcal{Z}[t,t^{-1}]$ for a crossingless matching using Heisenberg algebra. We conjecture that the span of such vectors forms a Temperley-Lieb representation, and hence, a new presentation of Jones polynomial can be obtained.


title: Residual-based stabilized reduced-order models of the transient convection-diffusion-reaction equation obtained through discrete and continuous projection

abstract: Galerkin and Petrov-Galerkin projection-based reduced-order models (ROMs) of transient partial differential equations are typically obtained by performing a dimension reduction and projection process that is defined at either the spatially continuous or spatially discrete level. In both cases, it is common to add stabilization to the resulting ROM to increase the stability and accuracy of the method; the addition of stabilization is particularly common for advection-dominated systems when the ROM is under-resolved. While these two approaches can be equivalent in certain settings, differing techniques have emerged in both contexts. This work outlines these two approaches within the setting of finite element method (FEM) discretizations (in which case a duality exists between the continuous and discrete levels) of the convection-diffusion-reaction equation, and compares residual-based stabilization techniques that have been developed in both contexts. In the spatially continuous case, we examine the Galerkin, streamline upwind Petrov-Galerkin (SUPG), Galerkin/least-squares (GLS), and adjoint (ADJ) stabilization methods. For the GLS and ADJ methods, we examine formulations constructed from both the "discretize-then-stabilize" technique and the space-time technique. In the spatially discrete case, we examine the Galerkin, least-squares Petrov-Galerkin (LSPG), and adjoint Petrov-Galerkin (APG) methods. We summarize existing analyses for these methods, and provide numerical experiments, which demonstrate that residual-based stabilized methods developed via continuous and discrete processes yield substantial improvements over standard Galerkin methods when the underlying FEM model is under-resolved.


title: On the monotonicity of the Hilbert functions for 4-generated pseudo-symmetric monomial curves

abstract: In this article we solve the conjecture "Hilbert function of the local ring for a 4 generated pseudo-symmetric numerical semigroup $\langle n_1,n_2,n_3,n_4 \rangle$ is always non-decreasing when $ n_1 < n_2 < n_3 < n_4$". We give a complete characterization to the standard bases when the tangent cone is not Cohen-Macaulay by showing that the number of elements in the standard basis depends on some parameters $s_j$ 's we define. Since the tangent cone is not Cohen-Macaulay, non-decreasingness of the Hilbert fuction was not guaranteed, we proved the non-decreasingness from our explicit Hilbert Function computation.


title: Stochastic Online Instrumental Variable Regression: Regrets for Endogeneity and Bandit Feedback

abstract: Endogeneity, i.e. the dependence of noise and covariates, is a common phenomenon in real data due to omitted variables, strategic behaviours, measurement errors etc. In contrast, the existing analyses of stochastic online linear regression with unbounded noise and linear bandits depend heavily on exogeneity, i.e. the independence of noise and covariates. Motivated by this gap, we study the over- and just-identified Instrumental Variable (IV) regression, specifically Two-Stage Least Squares, for stochastic online learning, and propose to use an online variant of Two-Stage Least Squares, namely O2SLS. We show that O2SLS achieves $\mathcal O(d_{x}d_{z}\log^2 T)$ identification and $\widetilde{\mathcal O}(\gamma \sqrt{d_{z} T})$ oracle regret after $T$ interactions, where $d_{x}$ and $d_{z}$ are the dimensions of covariates and IVs, and $\gamma$ is the bias due to endogeneity. For $\gamma=0$, i.e. under exogeneity, O2SLS exhibits $\mathcal O(d_{x}^2 \log^2 T)$ oracle regret, which is of the same order as that of the stochastic online ridge. Then, we leverage O2SLS as an oracle to design OFUL-IV, a stochastic linear bandit algorithm to tackle endogeneity. OFUL-IV yields $\widetilde{\mathcal O}(\sqrt{d_{x}d_{z}T})$ regret that matches the regret lower bound under exogeneity. For different datasets with endogeneity, we experimentally show efficiencies of O2SLS and OFUL-IV.


title: A remarkable class of elliptic surfaces of amplitude 1 in weighted projective space

abstract: Surfaces of amplitude 1 in ordinary projective space are of general type, but this need not be the case in weighted projective spaces. Indeed, there are 4 classes of quasi-smooth weighted hypersurfaces in $\mathbf{P}(1,2,a,b)$ of amplitude 1 with an elliptic pencil cut out by hyperplanes. Their moduli spaces are constructed, the monodromy of their universal families is determined as well as their period maps. These all turn out to be non-injective. We analyse the reason behind this, which for each type is different. For the two classes that give properly elliptic surfaces this leads to a mixed Torelli-type theorem as in the case of the Catanese-Kunev-Todorov surfaces.