title: Forecasting Local Behavior of Self-organizing Many-agent System without Reconstruction

abstract: Large multi-agent systems are often driven by locally defined agent interactions, which is referred to as self-organization. Our primary objective is to determine when the propagation of such local interactions will reach a specific agent of interest. Although conventional approaches that reconstruct all agent states can be used, they may entail unnecessary computational costs. In this paper, we investigate a CNN-LSTM model to forecast the state of a particular agent in a large self-organizing multi-agent system without the reconstruction. The proposed model comprises a CNN encoder to represent the system in a low-dimensional vector, a LSTM module to learn agent dynamics in the vector space, and a MLP decoder to predict the future state of an agent. As an example, we consider a forest fire model where we aim to predict when a particular tree agent will start burning. We compare the proposed model with reconstruction-based approaches such as CNN-LSTM and ConvLSTM. The proposed model exhibits similar or slightly worse AUC but significantly reduces computational costs such as activation than ConvLSTM. Moreover, it achieves higher AUC with less computation than the recontruction-based CNN-LSTM.


title: Image-Plane Self-Calibration in Interferometry

abstract: We develop a new process of image plane self-calibration for interferometric imaging data. The process is based on Shape-Orientation-Size (SOS) conservation for the principal triangle in an image generated from the three fringes made from a triad of receiving elements, in situations where interferometric phase errors can be factorized into element-based terms. The basis of the SOS conservation principle is that, for a 3-element array, the only possible image corruption due to an element-based phase screen is a tilt of the aperture plane, leading to a shift in the image plane. Thus, an image made from any 3-element interferometer represents a true image of the source brightness, modulo an unknown translation. Image plane self-calibration entails deriving the unknown translations for each triad image via cross-correlation of the observed triad image with a model image of the source brightness. After correcting for these independent shifts, and summing the aligned triad images, a good image of the source brightness is generated from the full array, recovering source structure at diffraction-limited resolution. The process is iterative, using improved source models based on previous iterations. We demonstrate the technique in the high signal-to-noise context, and include a configuration based on radio astronomical facilities, and simple models of double sources. We show that the process converges for the simple models considered, although convergence is slower than for aperture-plane self-calibration for large-$N$ arrays. As currently implemented, the process is most relevant for arrays with a small number of elements. More generally, the technique provides geometric insight into closure phase and the self-calibration process. The technique is generalizable to non-astronomical interferometric imaging applications across the electromagnetic spectrum.


title: SIX-Trust for 6G: Towards a Secure and Trustworthy 6G Network

abstract: Recent years have witnessed a digital explosion with the deployment of 5G and proliferation of 5G-enabled innovations. Compared with 5G, 6G is envisioned to achieve much higher performance in terms of latency, data rate, connectivity, energy efficiency, coverage and mobility. To fulfil these expectations, 6G will experience a number of paradigm shifts, such as exploiting new spectrum, applying ubiquitous ML/AI technologies and building a space-air-ground-sea integrated network. However, these paradigm shifts may lead to numerous new security and privacy issues, which traditional security measures may not be able to deal with. To tackle these issues and build a trustworthy 6G network, we introduce a novel trust framework named as SIX-Trust, which composes of 3 layers: sustainable trust (S-Trust), infrastructure trust (I-Trust) and xenogenesis trust (X-Trust). Each layer plays a different role, and the importance of each layer varies for different application scenarios of 6G. For each layer, we briefly introduce its related enabling technologies, and demonstrate how these technologies can be applied to enhance trust and security of the 6G network. In general, SIX-Trust provides a holistic framework for defining and modeling trust of 6G, which can facilitate establishing a trustworthy 6G network.


title: M$^3$Care: Learning with Missing Modalities in Multimodal Healthcare Data

abstract: Multimodal electronic health record (EHR) data are widely used in clinical applications. Conventional methods usually assume that each sample (patient) is associated with the unified observed modalities, and all modalities are available for each sample. However, missing modality caused by various clinical and social reasons is a common issue in real-world clinical scenarios. Existing methods mostly rely on solving a generative model that learns a mapping from the latent space to the original input space, which is an unstable ill-posed inverse problem. To relieve the underdetermined system, we propose a model solving a direct problem, dubbed learning with Missing Modalities in Multimodal healthcare data (M3Care). M3Care is an end-to-end model compensating the missing information of the patients with missing modalities to perform clinical analysis. Instead of generating raw missing data, M3Care imputes the task-related information of the missing modalities in the latent space by the auxiliary information from each patient's similar neighbors, measured by a task-guided modality-adaptive similarity metric, and thence conducts the clinical tasks. The task-guided modality-adaptive similarity metric utilizes the uncensored modalities of the patient and the other patients who also have the same uncensored modalities to find similar patients. Experiments on real-world datasets show that M3Care outperforms the state-of-the-art baselines. Moreover, the findings discovered by M3Care are consistent with experts and medical knowledge, demonstrating the capability and the potential of providing useful insights and explanations.


title: The linearised Einstein equations as a gauge theory

abstract: We linearise the Einstein vacuum equations with a cosmological constant via the Calabi operator from projective differential geometry.


title: In-Flight Energy-Driven Composition of Drone Swarm Services

abstract: We propose a novel framework for swarm-based drone delivery services with in-flight energy recharging. The framework aims to enhance the delivery time of multiple packages by reducing the number of stops and recharging times at intermediate stations. The proposed framework considers various intrinsic and extrinsic delivery constraints. We propose to use support drones whose sole purpose is to recharge other drones in the swarm during their flight. In this respect, we compute the optimal set of optimal support drones to minimize the probability of delivery services and recharging time at the next stations. We also use two settings to position the support drones in a flight formation for comparative purposes. Two novel energy sharing methods are proposed, namely, Priority-based and Fairness-based methods. A re-ordering method of the delivery drones is presented to facilitate the in-flight energy composition process. An enhanced A* algorithm is implemented to compose the optimal services in terms of delivery time. Experimental results prove the efficiency of our proposed approach.


title: Lanthanum Oxyhalide Monolayers: An Exceptional Dielectric Companion to Two-Dimensional Semiconductors

abstract: Two-dimensional (2D) layered dielectrics offers a compelling route towards the design of next-generation ultimately compact nanoelectronics. Motivated by recent high-throughput computational prediction of LaO$X$ ($X$ = Br, Cl) as an exceptional 2D dielectrics that significantly outperforms HfO$_2$ even in the monolyaer limit, we investigate the interface properties between LaOX and the archetypal 2D semiconductors of monolayer transition metal dichacolgenides (TMDCs) $M$S$_2$ ($M$ = Mo, W) using first-principle density functional theory simulations. We show that LaO$X$ monolayers interacts weakly with $M$S$_2$ via van der Waals forces with negligible hybridization and interfacial charge transfer, thus conveniently preserving the electronic properties of 2D TMDCs upon contact formation. The conduction and valance band offsets of the interfaces exhibit a sizable value ranging from 0.7 to 1.4 eV, suggesting the capability of LaO$X$ as a gate dielectric materials. Based on Murphy-Good electron emission model, we demonstrate that LaOCl/MoS$_2$ is a versatile dielectric/semiconductor combinations that are compatible to both NMOS and PMOS applications with leakage current lower than $10^{-7}$ Acm$^{-2}$, while LaO$X$/WS$_2$ is generally compatible with PMOS application. The presence of an interfacial tunneling potential barrier at the van der Waals gap further provide an additional mechanism to suppress the leakage current. Our findings reveal the role LaO$X$ as an excellent dielectric companion to 2D TMDC and shall provide useful insights for leveraging the dielectric strength of LaO$X$ in the design of high-performance 2D nanodevices.


title: Using Contrastive Samples for Identifying and Leveraging Possible Causal Relationships in Reinforcement Learning

abstract: A significant challenge in reinforcement learning is quantifying the complex relationship between actions and long-term rewards. The effects may manifest themselves over a long sequence of state-action pairs, making them hard to pinpoint. In this paper, we propose a method to link transitions with significant deviations in state with unusually large variations in subsequent rewards. Such transitions are marked as possible causal effects, and the corresponding state-action pairs are added to a separate replay buffer. In addition, we include \textit{contrastive} samples corresponding to transitions from a similar state but with differing actions. Including this Contrastive Experience Replay (CER) during training is shown to outperform standard value-based methods on 2D navigation tasks. We believe that CER can be useful for a broad class of learning tasks, including for any off-policy reinforcement learning algorithm.


title: Dynamic modeling of the motions of variable-shape wave energy converters

abstract: In the recently introduced Variable-Shape heaving wave energy converters, the buoy changes its shape actively in response to changing incident waves. In this study, a Lagrangian approach for the dynamic modeling of a spherical Variable-Shape Wave Energy Converter is described. The classical bending theory is used to write the stress-strain equations for the flexible body using Love's approximation. The elastic spherical shell is assumed to have an axisymmetric vibrational behavior. The Rayleigh-Ritz discretization method is adopted to find an approximate solution for the vibration model of the spherical shell. A novel equation of motion is presented that serves as a substitute for Cummins equation for flexible buoys. Also, novel hydrodynamic coefficients that account for the buoy mode shapes are proposed. The developed dynamic model is coupled with the open-source boundary element method software NEMOH. Two-way and one-way Fluid-Structure Interaction simulations are performed using MATLAB to study the effect of using a flexible shape buoy in the wave energy converter on its trajectory and power production. Finally, the variable shape buoy was able to harvest more energy for all the tested wave conditions.


title: A Long-term Dependent and Trustworthy Approach to Reactor Accident Prognosis based on Temporal Fusion Transformer

abstract: Prognosis of the reactor accident is a crucial way to ensure appropriate strategies are adopted to avoid radioactive releases. However, there is very limited research in the field of nuclear industry. In this paper, we propose a method for accident prognosis based on the Temporal Fusion Transformer (TFT) model with multi-headed self-attention and gating mechanisms. The method utilizes multiple covariates to improve prediction accuracy on the one hand, and quantile regression methods for uncertainty assessment on the other. The method proposed in this paper is applied to the prognosis after loss of coolant accidents (LOCAs) in HPR1000 reactor. Extensive experimental results show that the method surpasses novel deep learning-based prediction methods in terms of prediction accuracy and confidence. Furthermore, the interference experiments with different signal-to-noise ratios and the ablation experiments for static covariates further illustrate that the robustness comes from the ability to extract the features of static and historical covariates. In summary, this work for the first time applies the novel composite deep learning model TFT to the prognosis of key parameters after a reactor accident, and makes a positive contribution to the establishment of a more intelligent and staff-light maintenance method for reactor systems.


title: Bayesian Model Selection of Lithium-Ion Battery Models via Bayesian Quadrature

abstract: A wide variety of battery models are available, and it is not always obvious which model `best' describes a dataset. This paper presents a Bayesian model selection approach using Bayesian quadrature. The model evidence is adopted as the selection metric, choosing the simplest model that describes the data, in the spirit of Occam's razor. However, estimating this requires integral computations over parameter space, which is usually prohibitively expensive. Bayesian quadrature offers sample-efficient integration via model-based inference that minimises the number of battery model evaluations. The posterior distribution of model parameters can also be inferred as a byproduct without further computation. Here, the simplest lithium-ion battery models, equivalent circuit models, were used to analyse the sensitivity of the selection criterion to given different datasets and model configurations. We show that popular model selection criteria, such as root-mean-square error and Bayesian information criterion, can fail to select a parsimonious model in the case of a multimodal posterior. The model evidence can spot the optimal model in such cases, simultaneously providing the variance of the evidence inference itself as an indication of confidence. We also show that Bayesian quadrature can compute the evidence faster than popular Monte Carlo based solvers.

categories: stat.ME cs.LG cs.SY eess.SY physics.chem-ph


title: Landau on Chess Tournaments and Google's PageRank

abstract: In his first mathematical paper, published in 1895 when he was 18, Edmund Landau suggested a new way to determine the winner of a chess tournament by not simply adding for each player the fixed number of points they would get for each win or draw, but rather by considering the performance of all players in the tournament relative to each other: each player would get more credit for games won or drawn against stronger players. Landau called this "relative Wertbemessung", which translates to relative score. The basic idea from linear algebra behind this scoring system was rediscovered and reused in many contexts since 1895; in particular, it is a central ingredient in Google's PageRank.


title: Effective Cross-Task Transfer Learning for Explainable Natural Language Inference with T5

abstract: We compare sequential fine-tuning with a model for multi-task learning in the context where we are interested in boosting performance on two tasks, one of which depends on the other. We test these models on the FigLang2022 shared task which requires participants to predict language inference labels on figurative language along with corresponding textual explanations of the inference predictions. Our results show that while sequential multi-task learning can be tuned to be good at the first of two target tasks, it performs less well on the second and additionally struggles with overfitting. Our findings show that simple sequential fine-tuning of text-to-text models is an extraordinarily powerful method for cross-task knowledge transfer while simultaneously predicting multiple interdependent targets. So much so, that our best model achieved the (tied) highest score on the task.


title: Design, Field Evaluation, and Traffic Analysis of a Competitive Autonomous Driving Model in a Congested Environment

abstract: Recently, numerous studies have investigated cooperative traffic systems using the communication among vehicle-to-everything (V2X). Unfortunately, when multiple autonomous vehicles are deployed while exposed to communication failure, there might be a conflict of ideal conditions between various autonomous vehicles leading to adversarial situation on the roads. In South Korea, virtual and real-world urban autonomous multi-vehicle races were held in March and November of 2021, respectively. During the competition, multiple vehicles were involved simultaneously, which required maneuvers such as overtaking low-speed vehicles, negotiating intersections, and obeying traffic laws. In this study, we introduce a fully autonomous driving software stack to deploy a competitive driving model, which enabled us to win the urban autonomous multi-vehicle races. We evaluate module-based systems such as navigation, perception, and planning in real and virtual environments. Additionally, an analysis of traffic is performed after collecting multiple vehicle position data over communication to gain additional insight into a multi-agent autonomous driving scenario. Finally, we propose a method for analyzing traffic in order to compare the spatial distribution of multiple autonomous vehicles. We study the similarity distribution between each team's driving log data to determine the impact of competitive autonomous driving on the traffic environment.


title: Validation of Stochastic Optimal Control Models for Goal-Directed Human Movements on the Example of Human Driving Behavior

abstract: Stochastic Optimal Control models represent the state-of-the-art in modeling goal-directed human movements. The linear-quadratic sensorimotor (LQS) model based on signal-dependent noise processes in state and output equation is the current main representative. With our newly introduced Inverse Stochastic Optimal Control algorithm building upon two bi-level optimizations, we can identify its unknown model parameters, namely cost function matrices and scaling parameters of the noise processes, for the first time. In this paper, we use this algorithm to identify the parameters of a deterministic linear-quadratic, a linear-quadratic Gaussian and a LQS model from human measurement data to compare the models' capability in describing goal-directed human movements. Human steering behavior in a simplified driving task shown to posses similar features as point-ot-point human hand reaching movements serves as our example movement. The results show that the identified LQS model outperforms the others with statistical significance. Particularly, the average human steering behavior is modeled significantly better by the LQS model. This validates the positive impact of signal-dependent noise processes on modeling human average behavior.


title: H2020-SPACE-ORIONAS Miniaturized optical transceivers for high-speed optical inter-satellite links

abstract: The European H2020-SPACE-ORIONAS project targets the development of optical transceiver and amplifier integrated circuits and modules applicable to high-speed and compact laser communication terminals. This paper presents the most recent project achievements in the fabrication of high-speed electronic-photonic modulator and receiver circuits monolithically integrated in the silicon photonics platform and their assembly in bread-board level photonic modules.


title: AccentSpeech: Learning Accent from Crowd-sourced Data for Target Speaker TTS with Accents

abstract: Learning accent from crowd-sourced data is a feasible way to achieve a target speaker TTS system that can synthesize accent speech. To this end, there are two challenging problems to be solved. First, direct use of the poor acoustic quality crowd-sourced data and the target speaker data in accent transfer will apparently lead to synthetic speech with degraded quality. To mitigate this problem, we take a bottleneck feature (BN) based TTS approach, in which TTS is decomposed into a Text-to-BN (T2BN) module to learn accent and a BN-to-Mel (BN2Mel) module to learn speaker timbre, where neural network based BN feature serves as the intermediate representation that are robust to noise interference. Second, direct training T2BN using the crowd-sourced data in the two-stage system will produce accent speech of target speaker with poor prosody. This is because the the crowd-sourced recordings are contributed from the ordinary unprofessional speakers. To tackle this problem, we update the two-stage approach to a novel three-stage approach, where T2BN and BN2Mel are trained using the high-quality target speaker data and a new BN-to-BN module is plugged in between the two modules to perform accent transfer. To train the BN2BN module, the parallel unaccented and accented BN features are obtained by a proposed data augmentation procedure. Finally the proposed three-stage approach manages to produce accent speech for the target speaker with good prosody, as the prosody pattern is inherited from the professional target speaker and accent transfer is achieved by the BN2BN module at the same time. The proposed approach, named as AccentSpeech, is validated in a Mandarin TTS accent transfer task.


title: Singular Riemannian foliations and $\mathcal{I}$-Poisson manifolds

abstract: We recall the notion of a singular foliation (SF) on a manifold $M$, viewed as an appropriate submodule of $\mathfrak{X}(M)$, and adapt it to the presence of a Riemannian metric $g$, yielding a module version of a singular Riemannian foliation (SRF). Following Garmendia-Zambon on Hausdorff Morita equivalence of SFs, we define the Morita equivalence of SRFs (both in the module sense as well as in the more traditional geometric one of Molino) and show that the leaf spaces of Morita equivalent SRFs are isomrophic as pseudo-metric spaces. In a second part, we introduce the category of $\mathcal{I}$-Poisson manifolds. Its objects and morphisms generalize Poisson manifolds and morphisms in the presence of appropriate ideals $\mathcal{I}$ of the smooth functions on the manifold such that two conditions are satisfied: $(i)$ The category of Poisson manifolds becomes a full subcategory when choosing $\mathcal{I}=0$ and $(ii)$ there is a reduction functor from this new category to the category of Poisson algebras, which generalizes coistropic reduction to the singular setting. Every SF on $M$ gives rise to an $\mathcal{I}$-Poisson manifold on $T^*M$ and $g$ enhances this to an SRF if and only if the induced Hamiltonian lies in the normalizer of $\mathcal{I}$. This perspective provides, on the one hand, a simple proof of the fact that every module SRF is a geometric SRF and, on the other hand, a construction of an algebraic invariant of singular foliations: Hausdorff Morita equivalent SFs have isomorphic reduced Poisson algebras.


title: Properties of action-minimizing sets and weak KAM solutions via Mather's averaging functions

abstract: We study properties of action-minimizing invariant sets for Tonelli Lagrangian and Hamiltonian systems and weak KAM solutions to the Hamilton-Jacobi equation in terms of Mather's averaging functions. Our principal discovery is that exposed points and extreme points of Mather's alpha function are closely related to disjoint properties and graph properties of the action-minimizing invariant sets, which is also related to $C^0$ integrability of the systems and the existence of smooth weak KAM solutions to the Hamilton-Jacobi equation.


title: Bosonic Dark Matter in Light of the NICER Precise Mass-Radius Measurements

abstract: We explore the presence of self-interacting bosonic dark matter (DM) within neutron stars (NSs) in light of the latest multi-messenger observations of the Neutron Star Interior Composition Explorer (NICER) and LIGO/Virgo detectors. The bosonic DM is distributed as a core inside the NS or as a halo around it leading to formation of a DM admixed NS. We focus on the variation of the visible and dark radius of the mixed object due to DM model parameters and fractions. It is shown that DM core formation reduces the visible radius and the total mass pushing them below observational limits while halo formation is in favor of the latest mass-radius observations. Moreover, we scan over the parameter space of the bosonic DM model considering two nuclear matter equation of states by applying the radius, maximum mass and tidal deformability constraints. Our investigation allows for the exclusion of a range of DM fractions, self-coupling constant and sub-GeV boson masses, which limits the amount of accumulated DM to relatively low values to be consistent with astrophysical bounds. In this paper, we introduce main features of the pulse profile corresponding to the DM admixed NS as a novel observable quantity. We find that the depth of minimum fluxes in the pulse profiles crucially depends on the amount of DM around NS and its compactness. The current/future astrophysics missions may test the possibility of the existence of DM within NSs and break the degeneracies between different scenarios via multiple observations.


title: Spontaneous emergence of groups and signaling diversity in dynamic networks

abstract: We study the coevolution of network structure and signaling behavior. We model agents who can preferentially associate with others in a dynamic network while they also learn to play a simple sender-receiver game. We have four major findings. First, signaling interactions in dynamic networks are sufficient to cause the endogenous formation of distinct signaling groups, even in an initially homogeneous population. Second, dynamic networks allow the emergence of novel {\em hybrid} signaling groups that do not converge on a single common signaling system but are instead composed of different yet complementary signaling strategies. We show that the presence of these hybrid groups promotes stable diversity in signaling among other groups in the population. Third, we find important distinctions in information processing capacity of different groups: hybrid groups diffuse information more quickly initially but at the cost of taking longer to reach all group members. Fourth, our findings pertain to all common interest signaling games, are robust across many parameters, and mitigate known problems of inefficient communication.

categories: cs.SI econ.TH physics.soc-ph q-bio.MN q-bio.PE


title: Convolution-Based Channel-Frequency Attention for Text-Independent Speaker Verification

abstract: Deep convolutional neural networks (CNNs) have been applied to extracting speaker embeddings with significant success in speaker verification. Incorporating the attention mechanism has shown to be effective in improving the model performance. This paper presents an efficient two-dimensional convolution-based attention module, namely C2D-Att. The interaction between the convolution channel and frequency is involved in the attention calculation by lightweight convolution layers. This requires only a small number of parameters. Fine-grained attention weights are produced to represent channel and frequency-specific information. The weights are imposed on the input features to improve the representation ability for speaker modeling. The C2D-Att is integrated into a modified version of ResNet for speaker embedding extraction. Experiments are conducted on VoxCeleb datasets. The results show that C2DAtt is effective in generating discriminative attention maps and outperforms other attention methods. The proposed model shows robust performance with different scales of model size and achieves state-of-the-art results.


title: Shared Manifold Learning Using a Triplet Network for Multiple Sensor Translation and Fusion with Missing Data

abstract: Heterogeneous data fusion can enhance the robustness and accuracy of an algorithm on a given task. However, due to the difference in various modalities, aligning the sensors and embedding their information into discriminative and compact representations is challenging. In this paper, we propose a Contrastive learning based MultiModal Alignment Network (CoMMANet) to align data from different sensors into a shared and discriminative manifold where class information is preserved. The proposed architecture uses a multimodal triplet autoencoder to cluster the latent space in such a way that samples of the same classes from each heterogeneous modality are mapped close to each other. Since all the modalities exist in a shared manifold, a unified classification framework is proposed. The resulting latent space representations are fused to perform more robust and accurate classification. In a missing sensor scenario, the latent space of one sensor is easily and efficiently predicted using another sensor's latent space, thereby allowing sensor translation. We conducted extensive experiments on a manually labeled multimodal dataset containing hyperspectral data from AVIRIS-NG and NEON, and LiDAR (light detection and ranging) data from NEON. Lastly, the model is validated on two benchmark datasets: Berlin Dataset (hyperspectral and synthetic aperture radar) and MUUFL Gulfport Dataset (hyperspectral and LiDAR). A comparison made with other methods demonstrates the superiority of this method. We achieved a mean overall accuracy of 94.3% on the MUUFL dataset and the best overall accuracy of 71.26% on the Berlin dataset, which is better than other state-of-the-art approaches.


title: Neural network-based CUSUM for online change-point detection

abstract: Change-point detection, detecting an abrupt change in the data distribution from sequential data, is a fundamental problem in statistics and machine learning. CUSUM is a popular statistical method for online change-point detection due to its efficiency from recursive computation and constant memory requirement, and it enjoys statistical optimality. CUSUM requires knowing the precise pre- and post-change distribution. However, post-change distribution is usually unknown a priori since it represents anomaly and novelty. Classic CUSUM can perform poorly when there is a model mismatch with actual data. While likelihood ratio-based methods encounter challenges facing high dimensional data, neural networks have become an emerging tool for change-point detection with computational efficiency and scalability. In this paper, we introduce a neural network CUSUM (NN-CUSUM) for online change-point detection. We also present a general theoretical condition when the trained neural networks can perform change-point detection and what losses can achieve our goal. We further extend our analysis by combining it with the Neural Tangent Kernel theory to establish learning guarantees for the standard performance metrics, including the average run length (ARL) and expected detection delay (EDD). The strong performance of NN-CUSUM is demonstrated in detecting change-point in high-dimensional data using both synthetic and real-world data.


title: DiscreteCommunication and ControlUpdating in Event-Triggered Consensus

abstract: This paper studies the consensus control problem faced with three essential demands, namely, discrete control updating for each agent, discrete-time communications among neighboring agents, and the fully distributed fashion of the controller implementation without requiring any global information of the whole network topology. Noting that the existing related results only meeting one or two demands at most are essentially not applicable, in this paper we establish a novel framework to solve the problem of fully distributed consensus with discrete communication and control. The first key point in this framework is the design of controllers that are only updated at discrete event instants and do not depend on global information by introducing time-varying gains inspired by the adaptive control technique. Another key point is the invention of novel dynamic triggering functions that are independent of relative information among neighboring agents. Under the established framework, we propose fully distributed state-feedback event-triggered protocols for undirected graphs and also further study the more complexed cases of output-feedback control and directed graphs. Finally, numerical examples are provided to verify the effectiveness of the proposed event-triggered protocols.


title: A deep scalable neural architecture for soil properties estimation from spectral information

abstract: In this paper we propose an adaptive deep neural architecture for the prediction of multiple soil characteristics from the analysis of hyperspectral signatures. The proposed method overcomes the limitations of previous methods in the state of art: (i) it allows to predict multiple soil variables at once; (ii) it permits to backtrace the spectral bands that most contribute to the estimation of a given variable; (iii) it is based on a flexible neural architecture capable of automatically adapting to the spectral library under analysis. The proposed architecture is experimented on LUCAS, a large laboratory dataset and on a dataset achieved by simulating PRISMA hyperspectral sensor. 'Results, compared with other state-of-the-art methods confirm the effectiveness of the proposed solution.


title: Real-Time Calibration of Disaggregated Traffic Demand

abstract: This paper presents a simulation-based optimization framework for city-scale real-time estimation and calibration of dynamic demand models by focusing on disaggregated microsimulation in congested networks. The calibration approach is based on sequential optimization demand estimation for short time frames and uses a stream of traffic count data from IoT sensors on selected roads. The proposed method builds upon the standard bi-level optimization formulation. The upper-level optimization problem is presented as a bounded variable quadratic programming in each time frame, making it computationally tractable. For every time frame, the probabilistic parameters of the route choice model are obtained through several rounds of feedback loop between the OD optimization problem (at the upper level) and parallel samplings and simulations for DTA (at the lower level). At the end of each time frame, the microsimulation state of the network is transferred to the next time frame to ensure the temporal dependency and continuity of the estimations during the time. In addition, the algorithm's convergence is accelerated by applying the fixed-point method to road-segment travel times. The proposed sequential calibration model presents a drastic computational advantage over available methods by splitting the computations into short time frames and under the assumption that the demand in each time frame only depends on current and previous time frames. The model does not depend on reliable prior demand information. Moreover, with receiving the field measurements as a stream and the efficient time complexity of the algorithm in each time frame, the method successfully presents a solution for high-dimensional real-time and online applications. We validated the method with synthetic data and for a real-world case study in Tartu city, Estonia. The results show high accuracy under a tight computational budget.


title: There is more than one kind of robustness: Fooling Whisper with adversarial examples

abstract: Whisper is a recent Automatic Speech Recognition (ASR) model displaying impressive robustness to both out-of-distribution inputs and random noise. In this work, we show that this robustness does not carry over to adversarial noise. We show that we can degrade Whisper performance dramatically, or even transcribe a target sentence of our choice, by generating very small input perturbations with Signal Noise Ratio of 35-45dB. We also show that by fooling the Whisper language detector we can very easily degrade the performance of multilingual models. These vulnerabilities of a widely popular open-source model have practical security implications and emphasize the need for adversarially robust ASR.


title: A short note on the buoyant force in nonuniform gravitational fields

abstract: Lima and Monteiro [1] derived the buoyant force in a nonuniform gravitational field by applying a gradient version of the divergence theorem to the surface integral of the pressure forces [2]. Here it is outlined an alternate approach in the framework of fluid mechanics, based on the energy formulations of the equations of state for compressible fluids.


title: Quasi-stellar objects and galaxy mass density profiles derived using the submillimetre galaxies magnification bias

abstract: In this work, we want to exploit the magnification bias of the SMGs using two different foreground samples, quasi-stellar objects (QSOs) and galaxies. Our aim is to study and compare their mass density profiles and estimate their masses and concentrations. The background SMG sample consists of objects observed by \textit{Herschel} with 1.2<z<4.0. The foreground samples are QSOs and massive galaxies with spectroscopic redshifts between 0.2 and 1.0. The cross-correlation measurements are estimated with the Davis-Peebles estimator by stacking the SMG-QSO and SMG-galaxy pairs for the two analysed cases, respectively. This approach allows us to study the mass density profile from $\sim2$ to $\sim250$ arcsec. Moreover, the analysis is carried out by combining two of the most common theoretical mass density profiles in order to fit the cross-correlation measurements. The measurements are correctly fitted after splitting the available angular scales into an inner and an outer part using independent mass density profiles for each region. For the QSOs, we obtain masses and concentrations of $\log_{10}(M/M_{\odot})=13.51\pm0.04; C=6.85\pm0.34$ for the inner part and $\log_{10}(M/M_{\odot})=13.44\pm0.17; C=0.36\pm0.18$ for outer parts. For the galaxy sample are $\log_{10}(M/M_{\odot})=13.32\pm0.08; C=8.23\pm0.77$ and $\log_{10}(M/M_{\odot})=12.78\pm0.21; C=1.21\pm1.01$ for the inner and outer parts, respectively. In both samples, the inner part has an excess in the mass density profile and much higher concentration with respect to the outer part. We obtain similar values for the central mass with both samples, in agreement with those of galaxy clusters results. However, the estimated masses for the outer region and the concentrations of the inner region both vary with lens sample. This could be related to the probability of galactic interactions and/or the different evolutionary stages.


title: Physics-Informed CNNs for Super-Resolution of Sparse Observations on Dynamical Systems

abstract: In the absence of high-resolution samples, super-resolution of sparse observations on dynamical systems is a challenging problem with wide-reaching applications in experimental settings. We showcase the application of physics-informed convolutional neural networks for super-resolution of sparse observations on grids. Results are shown for the chaotic-turbulent Kolmogorov flow, demonstrating the potential of this method for resolving finer scales of turbulence when compared with classic interpolation methods, and thus effectively reconstructing missing physics.


title: The Kochawave curve, a variant of the Koch curve

abstract: This paper presents the construction and some properties of the Kochawave curve, a simple and asymmetrical variant of the Koch curve.


title: Dominator Coloring and CD Coloring in Almost Cluster Graphs

abstract: In this paper, we study two popular variants of Graph Coloring -- Dominator Coloring and CD Coloring. In both problems, we are given a graph $G$ and a natural number $\ell$ as input and the goal is to properly color the vertices with at most $\ell$ colors with specific constraints. In Dominator Coloring, we require for each $v \in V(G)$, a color $c$ such that $v$ dominates all vertices colored $c$. In CD Coloring, we require for each color $c$, a $v \in V(G)$ which dominates all vertices colored $c$. These problems, defined due to their applications in social and genetic networks, have been studied extensively in the last 15 years. While it is known that both problems are fixed-parameter tractable (FPT) when parameterized by $(t,\ell)$ where $t$ is the treewidth of $G$, we consider strictly structural parameterizations which naturally arise out of the problems' applications. We prove that Dominator Coloring is FPT when parameterized by the size of a graph's cluster vertex deletion (CVD) set and that CD Coloring is FPT parameterized by CVD set size plus the number of remaining cliques. En route, we design a simpler and faster FPT algorithms when the problems are parameterized by the size of a graph's twin cover, a special CVD set. When the parameter is the size of a graph's clique modulator, we design a randomized single-exponential time algorithm for the problems. These algorithms use an inclusion-exclusion based polynomial sieving technique and add to the growing number of applications using this powerful algebraic technique.


title: Generative Negative Text Replay for Continual Vision-Language Pretraining

abstract: Vision-language pre-training (VLP) has attracted increasing attention recently. With a large amount of image-text pairs, VLP models trained with contrastive loss have achieved impressive performance in various tasks, especially the zero-shot generalization on downstream datasets. In practical applications, however, massive data are usually collected in a streaming fashion, requiring VLP models to continuously integrate novel knowledge from incoming data and retain learned knowledge. In this work, we focus on learning a VLP model with sequential chunks of image-text pair data. To tackle the catastrophic forgetting issue in this multi-modal continual learning setting, we first introduce pseudo text replay that generates hard negative texts conditioned on the training images in memory, which not only better preserves learned knowledge but also improves the diversity of negative samples in the contrastive loss. Moreover, we propose multi-modal knowledge distillation between images and texts to align the instance-wise prediction between old and new models. We incrementally pre-train our model on both the instance and class incremental splits of the Conceptual Caption dataset, and evaluate the model on zero-shot image classification and image-text retrieval tasks. Our method consistently outperforms the existing baselines with a large margin, which demonstrates its superiority. Notably, we realize an average performance boost of $4.60\%$ on image-classification downstream datasets for the class incremental split.


title: GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

abstract: Generative Pre-trained Transformer models, known as GPT or OPT, set themselves apart through breakthrough performance across complex language modelling tasks, but also by their extremely high computational and storage costs. Specifically, due to their massive size, even inference for large, highly-accurate GPT models may require multiple performant GPUs, which limits the usability of such models. While there is emerging work on relieving this pressure via model compression, the applicability and performance of existing compression techniques is limited by the scale and complexity of GPT models. In this paper, we address this challenge, and propose GPTQ, a new one-shot weight quantization method based on approximate second-order information, that is both highly-accurate and highly-efficient. Specifically, GPTQ can quantize GPT models with 175 billion parameters in approximately four GPU hours, reducing the bitwidth down to 3 or 4 bits per weight, with negligible accuracy degradation relative to the uncompressed baseline. Our method more than doubles the compression gains relative to previously-proposed one-shot quantization methods, preserving accuracy, allowing us for the first time to execute an 175 billion-parameter model inside a single GPU for generative inference. Moreover, we also show that our method can still provide reasonable accuracy in the extreme quantization regime, in which weights are quantized to 2-bit or even ternary quantization levels. We show experimentally that these improvements can be leveraged for end-to-end inference speedups over FP16, of around 3.25x when using high-end GPUs (NVIDIA A100) and 4.5x when using more cost-effective ones (NVIDIA A6000). The implementation is available at https://github.com/IST-DASLab/gptq.


title: Classification of rank one 5d $\mathcal{N}=1$ and 6d $(1,0)$ SCFTs

abstract: This paper gives a classification of rank one 5d $\mathcal{N}=1$ and 6d $(1,0)$ SCFTs. The idea is to compactify 5d theory on $S^1$ and 6d theory on $T^2$ to get effective 4d $\mathcal{N}=2$ theory. These compactified theories all have a 4d $\mathcal{N}=2$ Coulomb branch whose solution can be described by mixed Hodge module (MHM). In the rank one case every Coulomb branch solution is related to rational elliptic surface with a section, whose classification is complete. So the classification is then reduced to pick up a subset from the data base of rational elliptic surface by imposing various physical constraints. The crucial new input is that the singular fiber at infinity determines which dimension the UV theory lives. Various physical properties such as flavor symmetry, one form symmetry, BPS quiver and BPS spectrum, and RG flow are studied. D7 brane configurations for those theories are found which are very useful in studying them. The generalizations to higher rank theories will also be highlighted.


title: Real-time Mapping of Physical Scene Properties with an Autonomous Robot Experimenter

abstract: Neural fields can be trained from scratch to represent the shape and appearance of 3D scenes efficiently. It has also been shown that they can densely map correlated properties such as semantics, via sparse interactions from a human labeller. In this work, we show that a robot can densely annotate a scene with arbitrary discrete or continuous physical properties via its own fully-autonomous experimental interactions, as it simultaneously scans and maps it with an RGB-D camera. A variety of scene interactions are possible, including poking with force sensing to determine rigidity, measuring local material type with single-pixel spectroscopy or predicting force distributions by pushing. Sparse experimental interactions are guided by entropy to enable high efficiency, with tabletop scene properties densely mapped from scratch in a few minutes from a few tens of interactions.


title: Model Compression for DNN-based Speaker Verification Using Weight Quantization

abstract: DNN-based speaker verification (SV) models demonstrate significant performance at relatively high computation costs. Model compression can be applied to reduce the model size for lower resource consumption. The present study exploits weight quantization to compress two widely-used SV models, namely ECAPA-TDNN and ResNet. Experimental results on VoxCeleb show that weight quantization is effective for compressing SV models. The model size can be reduced multiple times without noticeable degradation in performance. Compression of ResNet shows more robust results than ECAPA-TDNN with lower-bitwidth quantization. Analysis of the layer weights suggests that the smooth weight distribution of ResNet may be related to its better robustness. The generalization ability of the quantized model is validated via a language-mismatched SV task. Furthermore, analysis by information probing reveals that the quantized models can retain most of the speaker-relevant knowledge learned by the original models.


title: Diffusion-based Generative Speech Source Separation

abstract: We propose DiffSep, a new single channel source separation method based on score-matching of a stochastic differential equation (SDE). We craft a tailored continuous time diffusion-mixing process starting from the separated sources and converging to a Gaussian distribution centered on their mixture. This formulation lets us apply the machinery of score-based generative modelling. First, we train a neural network to approximate the score function of the marginal probabilities or the diffusion-mixing process. Then, we use it to solve the reverse time SDE that progressively separates the sources starting from their mixture. We propose a modified training strategy to handle model mismatch and source permutation ambiguity. Experiments on the WSJ0 2mix dataset demonstrate the potential of the method. Furthermore, the method is also suitable for speech enhancement and shows performance competitive with prior work on the VoiceBank-DEMAND dataset.


title: The phase structure of cosmic ray driven outflows in stream fed disc galaxies

abstract: Feeding with gas in streams is predicted to be an important galaxy growth mechanism. Using an idealised setup, we study the impact of stream feeding (with 10$^7$ M$_{\odot}$ Myr$^{-1}$ rate) on the star formation and outflows of disc galaxies with $\sim$10$^{11}$ M$_{\odot}$ baryonic mass. The magneto-hydrodynamical simulations are carried out with the PIERNIK code and include star formation, feedback from supernova, and cosmic ray advection and diffusion. We find that stream accretion enhances galactic star formation. Lower angular momentum streams result in more compact discs, higher star formation rates and stronger outflows. In agreement with previous studies, models including cosmic rays launch stronger outflows travelling much further into the galactic halo. Cosmic ray supported outflows are also cooler than supernova only driven outflows. With cosmic rays, the star formation is suppressed and the thermal pressure is reduced. We find evidence for two distinct outflow phases. The warm outflows have high angular momentum and stay close to the galactic disc, while the hot outflow phase has low angular momentum and escapes from the centre deep into the halo. Cosmic rays can therefore have a strong impact on galaxy evolution by removing low angular momentum, possibly metal enriched gas from the disc and injecting it into the circumgalactic medium.


title: Uncertainty quantification for random domains using periodic random variables

abstract: We consider uncertainty quantification for the Poisson problem subject to domain uncertainty. For the stochastic parameterization of the random domain, we use the model recently introduced by Kaarnioja, Kuo, and Sloan (SIAM J. Numer. Anal., 2020) in which a countably infinite number of independent random variables enter the random field as periodic functions. We develop lattice quasi-Monte Carlo (QMC) cubature rules for computing the expected value of the solution to the Poisson problem subject to domain uncertainty. These QMC rules can be shown to exhibit higher order cubature convergence rates permitted by the periodic setting independently of the stochastic dimension of the problem. In addition, we present a complete error analysis for the problem by taking into account the approximation errors incurred by truncating the input random field to a finite number of terms and discretizing the spatial domain using finite elements. The paper concludes with numerical experiments demonstrating the theoretical error estimates.


title: Flexible categorization for auditing using formal concept analysis and Dempster-Shafer theory

abstract: Categorization of business processes is an important part of auditing. Large amounts of transnational data in auditing can be represented as transactions between financial accounts using weighted bipartite graphs. We view such bipartite graphs as many-valued formal contexts, which we use to obtain explainable categorization of these business processes in terms of financial accounts involved in a business process by using methods in formal concept analysis. The specific explainability feature of the methodology introduced in the present paper provides several advantages over e.g.~non-explainable machine learning techniques, and in fact, it can be taken as a basis for the development of algorithms which perform the task of clustering on transparent and accountable principles. Here, we focus on obtaining and studying different ways to categorize according to different extents of interest in different financial accounts, or interrogative agendas, of various agents or sub-tasks in audit. We use Dempster-Shafer mass functions to represent agendas showing different interest in different set of financial accounts. We propose two new methods to obtain categorizations from these agendas. We also model some possible deliberation scenarios between agents with different interrogative agendas to reach an aggregated agenda and categorization. The framework developed in this paper provides a formal ground to obtain and study explainable categorizations from the data represented as bipartite graphs according to the agendas of different agents in an organization (e.g.~an audit firm), and interaction between these through deliberation.


title: Trends in Energy Estimates for Computing in AI/Machine Learning Accelerators, Supercomputers, and Compute-Intensive Applications

abstract: We examine the computational energy requirements of different systems driven by the geometrical scaling law, and increasing use of Artificial Intelligence or Machine Learning (AI-ML) over the last decade. With more scientific and technology applications based on data-driven discovery, machine learning methods, especially deep neural networks, have become widely used. In order to enable such applications, both hardware accelerators and advanced AI-ML methods have led to the introduction of new architectures, system designs, algorithms, and software. Our analysis of energy trends indicates three important observations: 1) Energy efficiency due to geometrical scaling is slowing down; 2) The energy efficiency at the bit-level does not translate into efficiency at the instruction-level, or at the system-level for a variety of systems, especially for large-scale AI-ML accelerators or supercomputers; 3) At the application level, general-purpose AI-ML methods can be computationally energy intensive, off-setting the gains in energy from geometrical scaling and special purpose accelerators. Further, our analysis provides specific pointers for integrating energy efficiency with performance analysis for enabling high-performance and sustainable computing in the future.


title: Teacher-Student Architecture for Knowledge Learning: A Survey

abstract: Although Deep Neural Networks (DNNs) have shown a strong capacity to solve large-scale problems in many areas, such DNNs with voluminous parameters are hard to be deployed in a real-time system. To tackle this issue, Teacher-Student architectures were first utilized in knowledge distillation, where simple student networks can achieve comparable performance to deep teacher networks. Recently, Teacher-Student architectures have been effectively and widely embraced on various knowledge learning objectives, including knowledge distillation, knowledge expansion, knowledge adaption, and multi-task learning. With the help of Teacher-Student architectures, current studies are able to achieve multiple knowledge-learning objectives through lightweight and effective student networks. Different from the existing knowledge distillation surveys, this survey detailedly discusses Teacher-Student architectures with multiple knowledge learning objectives. In addition, we systematically introduce the knowledge construction and optimization process during the knowledge learning and then analyze various Teacher-Student architectures and effective learning schemes that have been leveraged to learn representative and robust knowledge. This paper also summarizes the latest applications of Teacher-Student architectures based on different purposes (i.e., classification, recognition, and generation). Finally, the potential research directions of knowledge learning are investigated on the Teacher-Student architecture design, the quality of knowledge, and the theoretical studies of regression-based learning, respectively. With this comprehensive survey, both industry practitioners and the academic community can learn insightful guidelines about Teacher-Student architectures on multiple knowledge learning objectives.


title: Effective inseparability and some applications in meta-mathematics

abstract: Effectively inseparable pairs and their properties play an important role in the meta-mathematics of arithmetic and incompleteness. Different notions are introduced and shown in the literature to be equivalent to effective inseparability. We give a much simpler proof of these equivalences using the strong double recursion theorem. Then we prove some results about the application of effective inseparability in meta-mathematics.


title: COSMOS2020: Identification of High-z Protocluster Candidates in COSMOS

abstract: We conduct a systematic search for protocluster candidates at $z \geq 6$ in the COSMOS field using the recently released COSMOS2020 source catalog. We select galaxies using a number of selection criteria to obtain a sample of galaxies that have a high probability of being inside a given redshift bin. We then apply overdensity analysis to the bins using two density estimators, a Weighted Adaptive Kernel Estimator and a Weighted Voronoi Tessellation Estimator. We have found 15 significant ($>4\sigma$) candidate galaxy overdensities across the redshift range $6\le z\le7.7$. The majority of the galaxies appear to be on the galaxy main sequence at their respective epochs. We use multiple stellar-mass-to-halo-mass conversion methods to obtain a range of dark matter halo mass estimates for the overdensities in the range of $\sim10^{11-13}\,M_{\rm \odot}$, at the respective redshifts of the overdensities. The number and the masses of the halos associated with our protocluster candidates are consistent with what is expected from the area of a COSMOS-like survey in a standard $\Lambda$CDM cosmology. Through comparison with simulation, we expect that all the overdensities at $z\simeq6$ will evolve into a Virgo-/Coma-like clusters at present (i.e., with masses $\sim 10^{14}-10^{15}\,M_{\rm \odot}$). Compared to other overdensities identified at $z \geq 6$ via narrow-band selection techniques, the overdensities presented appear to have $\sim10\times$ higher stellar masses and star-formation rates. We compare the evolution in the total star-formation rate and stellar mass content of the protocluster candidates across the redshift range $6\le z\le7.7$ and find agreement with the total average star-formation rate from simulations.


title: Polymorphic Typestate for Session Types

abstract: Session types provide a principled approach to typed communication protocols that guarantee type safety and protocol fidelity. Formalizations of session-typed communication are typically based on process calculi, concurrent lambda calculi, or linear logic. An alternative model based on context-sensitive typing and typestate has not received much attention due to its apparent restrictions. However, this model is attractive because it does not force programmers into particular patterns like continuation-passing style or channel-passing style, but rather enables them to treat communication channels like mutable variables. Polymorphic typestate is the key that enables a full treatment of session-typed communication. Previous work in this direction was hampered by its setting in a simply-typed lambda calculus. We show that higher-order polymorphism and existential types enable us to lift the restrictions imposed by the previous work, thus bringing the expressivity of the typestate-based approach on par with the competition. On this basis, we define PolyVGR, the system of polymorphic typestate for session types, establish its basic metatheory, type preservation and progress, and present a prototype implementation.


title: Lagrangian model for passive scalar gradients in turbulence

abstract: The equation for the fluid velocity gradient along a Lagrangian trajectory immediately follows from the Navier-Stokes equation. However, such an equation involves two terms that cannot be determined from the velocity gradient along the chosen Lagrangian path: the pressure Hessian and the viscous Laplacian. A recent model handles these unclosed terms using a multi-level version of the recent deformation of Gaussian fields (RDGF) closure (Johnson \& Meneveau, Phys.~Rev.~Fluids, 2017). This model is in remarkable agreement with DNS data and works for arbitrary Taylor Reynolds numbers $\Rey_\lambda$. Inspired by this, we develop a Lagrangian model for passive scalar gradients in isotropic turbulence. The equation for passive scalar gradients also involves an unclosed term in the Lagrangian frame, namely the scalar gradient diffusion term, which we model using the RDGF approach. However, comparisons of the statistics obtained from this model with direct numerical simulation (DNS) data reveal substantial errors due to erroneously large fluctuations generated by the model. We address this defect by incorporating into the closure approximation information regarding the scalar gradient production along the local trajectory history of the particle. This modified model makes predictions for the scalar gradients, their production rates, and alignments with the strain-rate eigenvectors that are in very good agreement with DNS data. However, while the model yields valid predictions up to around $\Rey_\lambda\approx 500$, beyond this, the model breaks down.


title: Cancellation of projective modules in polynomial rings of prime characteristic

abstract: Let $A$ be a commutative Noetherian ring of characteristic $p>0$, such that $\dim(A)=d$. Let $P$ be a projective $A[T_1,...,T_n]$-module of rank $d$. We show that $P$ is cancellative if and only if $P/<T_1,...,T_n>P$ is cancellative. We deduce some applications. In one of the interesting consequences, we show that the Bass-Quillen conjecture has an affirmative answer in dimension three, when $2$ is invertible.


title: VoicePrivacy 2022 System Description: Speaker Anonymization with Feature-matched F0 Trajectories

abstract: We introduce a novel method to improve the performance of the VoicePrivacy Challenge 2022 baseline B1 variants. Among the known deficiencies of x-vector-based anonymization systems is the insufficient disentangling of the input features. In particular, the fundamental frequency (F0) trajectories, which are used for voice synthesis without any modifications. Especially in cross-gender conversion, this situation causes unnatural sounding voices, increases word error rates (WERs), and personal information leakage. Our submission overcomes this problem by synthesizing an F0 trajectory, which better harmonizes with the anonymized x-vector. We utilized a low-complexity deep neural network to estimate an appropriate F0 value per frame, using the linguistic content from the bottleneck features (BN) and the anonymized x-vector. Our approach results in a significantly improved anonymization system and increased naturalness of the synthesized voice. Consequently, our results suggest that F0 extraction is not required for voice anonymization.


title: Testing Heteroskedasticity in High-Dimensional Linear Regression

abstract: We propose a new testing procedure of heteroskedasticity in high-dimensional linear regression, where the number of covariates can be larger than the sample size. Our testing procedure is based on residuals of the Lasso. We demonstrate that our test statistic has asymptotic normality under the null hypothesis of homoskedasticity. Simulation results show that the proposed testing procedure obtains accurate empirical sizes and powers. We also present results of real economic data applications.


title: MatKG: The Largest Knowledge Graph in Materials Science -- Entities, Relations, and Link Prediction through Graph Representation Learning

abstract: This paper introduces MatKG, a novel graph database of key concepts in material science spanning the traditional material-structure-property-processing paradigm. MatKG is autonomously generated through transformer-based, large language models and generates pseudo ontological schema through statistical co-occurrence mapping. At present, MatKG contains over 2 million unique relationship triples derived from 80,000 entities. This allows the curated analysis, querying, and visualization of materials knowledge at unique resolution and scale. Further, Knowledge Graph Embedding models are used to learn embedding representations of nodes in the graph which are used for downstream tasks such as link prediction and entity disambiguation. MatKG allows the rapid dissemination and assimilation of data when used as a knowledge base, while enabling the discovery of new relations when trained as an embedding model.


title: HARRIS: Hybrid Ranking and Regression Forests for Algorithm Selection

abstract: It is well known that different algorithms perform differently well on an instance of an algorithmic problem, motivating algorithm selection (AS): Given an instance of an algorithmic problem, which is the most suitable algorithm to solve it? As such, the AS problem has received considerable attention resulting in various approaches - many of which either solve a regression or ranking problem under the hood. Although both of these formulations yield very natural ways to tackle AS, they have considerable weaknesses. On the one hand, correctly predicting the performance of an algorithm on an instance is a sufficient, but not a necessary condition to produce a correct ranking over algorithms and in particular ranking the best algorithm first. On the other hand, classical ranking approaches often do not account for concrete performance values available in the training data, but only leverage rankings composed from such data. We propose HARRIS- Hybrid rAnking and RegRessIon foreSts - a new algorithm selector leveraging special forests, combining the strengths of both approaches while alleviating their weaknesses. HARRIS' decisions are based on a forest model, whose trees are created based on splits optimized on a hybrid ranking and regression loss function. As our preliminary experimental study on ASLib shows, HARRIS improves over standard algorithm selection approaches on some scenarios showing that combining ranking and regression in trees is indeed promising for AS.


title: Detecting an Intermittent Change of Unknown Duration

abstract: Oftentimes in practice, the observed process changes statistical properties at an unknown point in time and the duration of a change is substantially finite, in which case one says that the change is intermittent or transient. We provide an overview of existing approaches for intermittent change detection and advocate in favor of a particular setting driven by the intermittent nature of the change. We propose a novel optimization criterion that is more appropriate for many applied areas such as the detection of threats in physical-computer systems, near-Earth space informatics, epidemiology, pharmacokinetics, etc. We argue that controlling the local conditional probability of a false alarm, rather than the familiar average run length to a false alarm, and maximizing the local conditional probability of detection is a more reasonable approach versus a traditional quickest change detection approach that requires minimizing the expected delay to detection. We adopt the maximum likelihood (ML) approach with respect to the change duration and show that several commonly used detection rules (CUSUM, window-limited CUSUM, and FMA) are equivalent to the ML-based stopping times. We discuss how to choose design parameters for these rules and provide a comprehensive simulation study to corroborate intuitive expectations.


title: The trigonal structure as a reference to access the spontaneous polarization of wurtzite crystals

abstract: The spontaneous polarization of wurtzite III-V nitrides XN (X=Al, Ga, In) and II-VI oxides YO (Y=Be, Zn) is investigated via first-principles computational methods. The modern treatment defines this quantity as the polarization difference between the investigated system and an appropriate reference state. We demonstrate that the trigonal structure can be used as a reference to determine the spontaneous polarization of wurtzite materials. We compare the current values with the widely-known zincblende results reported in the literature and find a very good agreement. It is shown that the electronic contribution of polarization is greater than the ionic one. Furthermore, we reproduce the experimental value of the spontaneous polarization of wurtzite GaN reported in a previous study. In order to do so, we calculate the spontaneous polarization for each type of stacking faults using periodic supercells and the Berry-phase method. This theoretical analysis leads to a value nearly identical to the experimental measurement.


title: gCoRF: Generative Compositional Radiance Fields

abstract: 3D generative models of objects enable photorealistic image synthesis with 3D control. Existing methods model the scene as a global scene representation, ignoring the compositional aspect of the scene. Compositional reasoning can enable a wide variety of editing applications, in addition to enabling generalizable 3D reasoning. In this paper, we present a compositional generative model, where each semantic part of the object is represented as an independent 3D representation learned from only in-the-wild 2D data. We start with a global generative model (GAN) and learn to decompose it into different semantic parts using supervision from 2D segmentation masks. We then learn to composite independently sampled parts in order to create coherent global scenes. Different parts can be independently sampled while keeping the rest of the object fixed. We evaluate our method on a wide variety of objects and parts and demonstrate editing applications.


title: Inclusive production of $J/\psi$, $\psi(2S)$, and $\Upsilon$ states in pNRQCD

abstract: Under some assumptions on the hierarchy of relevant energy scales, we compute the nonrelativistic QCD (NRQCD) long-distance matrix elements (LDMEs) for inclusive production of $J/\psi$, $\psi(2S)$, and $\Upsilon$ states based on the potential NRQCD (pNRQCD) effective field theory. Based on the pNRQCD formalism, we obtain expressions for the LDMEs in terms of the quarkonium wavefunctions at the origin and universal gluonic correlators, which do not depend on the heavy quark flavor or the radial excitation. This greatly reduces the number of nonperturbative unknowns and substantially enhances the predictive power of the nonrelativistic effective field theory formalism. We obtain improved determinations of the LDMEs for $J/\psi$, $\psi(2S)$, and $\Upsilon$ states thanks to the universality of the gluonic correlators, and obtain phenomenological results for cross sections and polarizations at large transverse momentum that agree well with measurements at the LHC.


title: From Nano to Macro: Overview of the IEEE Bio Image and Signal Processing Technical Committee

abstract: The Bio Image and Signal Processing (BISP) Technical Committee (TC) of the IEEE Signal Processing Society (SPS) promotes activities within the broad technical field of biomedical image and signal processing. Areas of interest include medical and biological imaging, digital pathology, molecular imaging, microscopy, and associated computational imaging, image analysis, and image-guided treatment, alongside physiological signal processing, computational biology, and bioinformatics. BISP has 40 members and covers a wide range of EDICS, including CIS-MI: Medical Imaging, BIO-MIA: Medical Image Analysis, BIO-BI: Biological Imaging, BIO: Biomedical Signal Processing, BIO-BCI: Brain/Human-Computer Interfaces, and BIO-INFR: Bioinformatics. BISP plays a central role in the organization of the IEEE International Symposium on Biomedical Imaging (ISBI) and contributes to the technical sessions at the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), and the IEEE International Conference on Image Processing (ICIP). In this paper, we provide a brief history of the TC, review the technological and methodological contributions its community delivered, and highlight promising new directions we anticipate.


title: Optimal Control for Wind Turbine Wake Mixing on Floating Platforms

abstract: Dynamic induction control is a wind farm flow control strategy that utilises wind turbine thrust variations to accelerate breakdown of the aerodynamic wake and improve downstream turbine performance. However, when floating wind turbines are considered, additional dynamics and challenges appear that make optimal control difficult. In this work, we propose an adjoint optimisation framework for non-linear economic model-predictive control, which utilises a novel coupling of an existing aerodynamic wake model to floating platform hydrodynamics. Analysis of the frequency response for the coupled model shows that it is possible to achieve wind turbine thrust variations without inducing large motion of the rotor. Using economic model-predictive control, we find dynamic induction results that lead to an improvement of 7% over static induction control, where the dynamic controller stimulates wake breakdown with only small variations in rotor displacement. This novel model formulation provides a starting point for the adaptation of dynamic wind farm flow control strategies for floating wind turbines.


title: Laboratory and astronomical discovery of magnesium dicarbide, MgC$_2$

abstract: We report the detection of magnesium dicarbide, MgC$_2$, in the laboratory at centimeter wavelengths and assign $^{24}$MgC$_2$, $^{25}$MgC$_2$, and $^{26}$MgC$_2$ to 14 unidentified lines in the radio spectrum of the circumstellar envelope of the evolved carbon star IRC+10216. The structure of MgC$_2$ is found to be T-shaped with a highly ionic bond between the metal atom and the C$_2$ unit, analogous to other dicarbides containing electropositive elements. A two-temperature excitation model of the MgC$_2$ emission lines observed in IRC+10216 yields a very low rotational temperature of $6\pm1$ K, a kinetic temperature of $22\pm13$ K, and a column density of $(1.0 \pm 0.3) \times 10^{12}$ cm$^{-2}$. The abundance of MgC$_2$ relative to the magnesium-carbon chains MgCCH, MgC$_4$H, and MgC$_6$H is $1{:}2{:}22{:}20$ and provides a new constraint on the sequential radiative association-dissociative recombination mechanisms implicated in the production of metal-bearing molecules in circumstellar environments.

categories: astro-ph.SR astro-ph.GA physics.atm-clus physics.chem-ph


title: Robust MelGAN: A robust universal neural vocoder for high-fidelity TTS

abstract: In current two-stage neural text-to-speech (TTS) paradigm, it is ideal to have a universal neural vocoder, once trained, which is robust to imperfect mel-spectrogram predicted from the acoustic model. To this end, we propose Robust MelGAN vocoder by solving the original multi-band MelGAN's metallic sound problem and increasing its generalization ability. Specifically, we introduce a fine-grained network dropout strategy to the generator. With a specifically designed over-smooth handler which separates speech signal intro periodic and aperiodic components, we only perform network dropout to the aperodic components, which alleviates metallic sounding and maintains good speaker similarity. To further improve generalization ability, we introduce several data augmentation methods to augment fake data in the discriminator, including harmonic shift, harmonic noise and phase noise. Experiments show that Robust MelGAN can be used as a universal vocoder, significantly improving sound quality in TTS systems built on various types of data.


title: Higher dimensional versions of theorems of Euler and Fuss

abstract: We present higher dimensional versions of the classical results of Euler and Fuss, both of which are special cases of the celebrated Poncelet porism. Our results concern polytopes, specifically simplices, parallelotopes and cross polytopes, inscribed in a given ellipsoid and circumscribed to another. The statements and proofs use the language of linear algebra. Without loss, one of the ellipsoids is the unit sphere and the other one is also centered at the origin. Let $A$ be the positive symmetric matrix taking the outer ellipsoid to the inner one. If $trace A = 1$, there exists a bijection between the orthogonal group $O(n)$ and the set of such labeled simplices. Similarly, if $trace A^2 = 1$, there are families of parallelotopes and of cross polytopes, also indexed by $O(n)$.


title: Bayesian jackknife tests with a small number of subsets: Application to HERA 21cm power spectrum upper limits

abstract: We present a Bayesian jackknife test for assessing the probability that a data set contains biased subsets, and, if so, which of the subsets are likely to be biased. The test can be used to assess the presence and likely source of statistical tension between different measurements of the same quantities in an automated manner. Under certain broadly applicable assumptions, the test is analytically tractable. We also provide an open source code, CHIBORG, that performs both analytic and numerical computations of the test on general Gaussian-distributed data. After exploring the information theoretical aspects of the test and its performance with an array of simulations, we apply it to data from the Hydrogen Epoch of Reionization Array (HERA) to assess whether different sub-seasons of observing can justifiably be combined to produce a deeper 21cm power spectrum upper limit. We find that, with a handful of exceptions, the HERA data in question are statistically consistent and this decision is justified. We conclude by pointing out the wide applicability of this test, including to CMB experiments and the $H_0$ tension.


title: Sphere bundles over $4$-manifolds are trivial after looping

abstract: We show that except two special cases, the sphere bundle of a vector bundle over a simply connected $4$-manifold splits after looping. In particular, this implies that though there are infinitely many inequivalent sphere bundles of a given rank over a $4$-manifold, the loop spaces of their total manifolds are all homotopy equivalent.


title: Data-Adaptive Symmetric CUSUM for Sequential Change Detection

abstract: Detecting change points sequentially in a streaming setting, especially when both the mean and the variance of the signal can change, is often a challenging task. A key difficulty in this context often involves setting an appropriate detection threshold, which for many standard change statistics may need to be tuned depending on the pre-change and post-change distributions. This presents a challenge in a sequential change detection setting when a signal switches between multiple distributions. For example, consider a signal where change points are indicated by increases/decreases in the mean and variance of the signal. In this context, we would like to be able to compare our change statistic to a fixed threshold that will be symmetric to either increases or decreases in the mean and variance. Unfortunately, change point detection schemes that use the log-likelihood ratio, such as CUSUM and GLR, are quick to react to changes but are not symmetric when both the mean and the variance of the signal change. This makes it difficult to set a single threshold to detect multiple change points sequentially in a streaming setting. We propose a modified version of CUSUM that we call Data-Adaptive Symmetric CUSUM (DAS-CUSUM). The DAS-CUSUM change point detection procedure is symmetric for changes between distributions, making it suitable to set a single threshold to detect multiple change points sequentially in a streaming setting. We provide results that relate to the expected detection delay and average run length for our proposed procedure. Extensive simulations are used to validate these results. Experiments on real-world data further show the utility of using DAS-CUSUM over both CUSUM and GLR.


title: Turbulence and added drag over acoustic liners

abstract: We present pore-resolved direction numerical simulations (DNS) of turbulent flows grazing over perforated plates, that closely resemble the acoustic liners found on aircraft engines. Our DNS explore a large parameter space including the effects of porosity, thickness, and viscous-scaled diameter of the perforated plates, at friction Reynolds numbers $Re_\tau = 500$-$2000$, which allows us to develop a robust theory for estimating the added drag induced by acoustic liners. We find that acoustic liners can be regarded as porous surfaces with a wall-normal permeability and that the relevant length scale characterizing their added drag is the inverse of the wall-normal Forchheimer coefficient. Unlike other types of porous surfaces featuring Darcian velocities inside the pores, the flow inside the orifices of acoustic liners is fully turbulent, with a magnitude of the wall-normal velocity fluctuations comparable to the peak in the near wall cycle. We provide clear evidence a fully rough regime for acoustic liners, also confirmed by the increasing relevance of pressure drag. Once the fully rough asymptote is reached, canonical acoustic liners provide an added drag comparable to sand-grain roughness with viscous-scaled height matching the inverse of the viscous-scaled Forchheimer permeability of the plate.


title: OFDM-Based Massive Connectivity for LEO Satellite Internet of Things

abstract: Low earth orbit (LEO) satellite has been considered as a potential supplement for the terrestrial Internet of Things (IoT). In this paper, we consider grant-free non-orthogonal random access (GF-NORA) in orthogonal frequency division multiplexing (OFDM) system to increase access capacity and reduce access latency for LEO satellite-IoT. We focus on the joint device activity detection (DAD) and channel estimation (CE) problem at the satellite access point. The delay and the Doppler effect of the LEO satellite channel are assumed to be partially compensated. We propose an OFDM-symbol repetition technique to better distinguish the residual Doppler frequency shifts, and present a grid-based parametric probability model to characterize channel sparsity in the delay-Doppler-user domain, as well as to characterize the relationship between the channel states and the device activity. Based on that, we develop a robust Bayesian message passing algorithm named modified variance state propagation (MVSP) for joint DAD and CE. Moreover, to tackle the mismatch between the real channel and its on-grid representation, an expectation-maximization (EM) framework is proposed to learn the grid parameters. Simulation results demonstrate that our proposed algorithms significantly outperform the existing approaches in both activity detection probability and channel estimation accuracy.


title: IoT System Case Study: Personal Office Energy Monitor (POEM)

abstract: This paper describes the design, implementation, and user evaluation of an IoT project focused on monitoring and management of user comfort and energy usage in office buildings. The objective is to depict an instructive use case and to illustrate experiences with all major phases of designing and running a fairly complex IoT system. The design part includes motivation and outline of the problem statement, the resulting definition of data to be collected, system implementation, and subsequent changes resulting from the additional insights that it provided. The user experience part describes quantitative findings as well as key results of the extensive human factors study with over 70 office users participating in two major pilots in France and Japan. The original idea for this project came out from a diverse group of companies exploring challenges of designing and operating smart buildings with net-positive energy balance. Members included companies involved in the design and construction of smart buildings, building-management and automation systems, computer design, energy systems, and office furniture and space design. One of the early insights was that maximum energy efficiency in office buildings cannot be achieved and sustained without the awareness and active participation of building occupants. The resulting project explored and evaluated several ways to engage and empower users in ways that benefit them and makes them the willing and active participants.


title: L-GreCo: Layerwise-Adaptive Gradient Compression for Efficient and Accurate Deep Learning

abstract: Data-parallel distributed training of deep neural networks (DNN) has gained very widespread adoption, but can still experience communication bottlenecks. To address this issue, entire families of compression mechanisms have been developed, including quantization, sparsification, and low-rank approximation, some of which are seeing significant practical adoption. Despite this progress, almost all known compression schemes apply compression uniformly across DNN layers, although layers are heterogeneous in terms of parameter count and their impact on model accuracy. In this work, we provide a general framework for adapting the degree of compression across the model's layers dynamically during training, improving the overall compression, while leading to substantial speedups, without sacrificing accuracy. Our framework, called L-GreCo, is based on an adaptive algorithm, which automatically picks the optimal compression parameters for model layers guaranteeing the best compression ratio while satisfying an error constraint. Extensive experiments over image classification and language modeling tasks shows that L-GreCo is effective across all existing families of compression methods, and achieves up to 2.5$\times$ training speedup and up to 5$\times$ compression improvement over efficient implementations of existing approaches, while recovering full accuracy. Moreover, L-GreCo is complementary to existing adaptive algorithms, improving their compression ratio by 50% and practical throughput by 66%.


title: A Faster Sampler for Discrete Determinantal Point Processes

abstract: Discrete Determinantal Point Processes (DPPs) have a wide array of potential applications for subsampling datasets. They are however held back in some cases by the high cost of sampling. In the worst-case scenario, the sampling cost scales as O(n^3) where n is the number of elements of the ground set. A popular workaround to this prohibitive cost is to sample DPPs defined by low-rank kernels. In such cases, the cost of standard sampling algorithms scales as O(np^2 + nm^2) where m is the (average) number of samples of the DPP (usually m << n) and p the rank of the kernel used to define the DPP (m \leq p \leq n). The first term, O(np^2), comes from a SVD-like step. We focus here on the second term of this cost, O(nm^2), and show that it can be brought down to O(nm + m^3 log m) without loss on the sampling's exactness. In practice, we observe very substantial speedups compared to the classical algorithm as soon as n > 1000. The algorithm described here is a close variant of the standard algorithm for sampling continuous DPPs, and uses rejection sampling. In the specific case of projection DPPs, we also show that any additional sample can be drawn in time O(m^3 log m). Finally, an interesting by-product of the analysis is that a realisation from a DPP is typically contained in a subset of size O(m log m) formed using leverage score i.i.d. sampling.


title: Turbulence and Anomalous Resistivity inside Near-Earth Magnetic Clouds

abstract: We use in-situ data from the Wind spacecraft to survey the amplitude of turbulent fluctuations in the proton density and total magnetic field inside a large sample of near-Earth magnetic clouds (MCs) associated with coronal mass ejections (CMEs) from the Sun. We find that the most probable value of the modulation index for proton density fluctuations ($\delta n_{p}/n_{p}$) inside MCs ranges from 0.13 to 0.16, while the most probable values for the modulation index of the total magnetic field fluctuations ($\delta B/B$) range from 0.04 to 0.05. We also find that the most probable value of the Mach number fluctuations ($\delta M$) inside MCs is $\approx 0.1$. The anomalous resistivity inside near-Earth MCs arising from electron scattering due to turbulent magnetic field fluctuations exceeds the (commonly used) Spitzer resistivity by a factor of $\approx 500-1000$. The enhanced Joule heating arising from this anomalous resistivity could impact our understanding of the energetics of CME propagation.


title: Explainable Deep Learning to Profile Mitochondrial Disease Using High Dimensional Protein Expression Data

abstract: Mitochondrial diseases are currently untreatable due to our limited understanding of their pathology. We study the expression of various mitochondrial proteins in skeletal myofibres (SM) in order to discover processes involved in mitochondrial pathology using Imaging Mass Cytometry (IMC). IMC produces high dimensional multichannel pseudo-images representing spatial variation in the expression of a panel of proteins within a tissue, including subcellular variation. Statistical analysis of these images requires semi-automated annotation of thousands of SMs in IMC images of patient muscle biopsies. In this paper we investigate the use of deep learning (DL) on raw IMC data to analyse it without any manual pre-processing steps, statistical summaries or statistical models. For this we first train state-of-art computer vision DL models on all available image channels, both combined and individually. We observed better than expected accuracy for many of these models. We then apply state-of-the-art explainable techniques relevant to computer vision DL to find the basis of the predictions of these models. Some of the resulting visual explainable maps highlight features in the images that appear consistent with the latest hypotheses about mitochondrial disease progression within myofibres.


title: Characterizations of Griffiths Positivity, Pluriharmonicity and Flatness

abstract: Deng-Ning-Wang-Zhou showed that a Hermitian holomorphic vector bundle is Griffiths semi-positive if it satisfies the optimal $L^2$-extension condition. As a generalization, we present a quantitative characterization of Griffiths positivity in terms of certain $L^2$-extension conditions. We also show that a $\mathbb{R}$-valued measurable function is pluriharmonic if and only if it satisfies the equality part of the optimal $L^p$-extension condition. This answers a conjecture of Inayama affirmatively. Moreover, the flatness of a possibly singular Hermitian metric is also equivalent to the equality part of the optimal $L^p$-extension condition.


title: A centimeter-scale achromatic hybrid metalens with polarization-insensitivity in the visible

abstract: Metalenses, featuring ultra-compactness and CMOS compatibility, are limited by the compromise between the diameter, numerical aperture, and working waveband. To address this problem, we propose and numerically demonstrate a centimeter-scale metasurface-refractive hybrid metalens working in the band of 440 - 700 nm. Revisiting the general Snell law, we present the phase profile of a chromatic aberration correction metasurface that can apply to a plano-convex refractive lens of an arbitrary surface type. Simulated by our semi-vector method, the designed achromatic hybrid metalens achieves 81% chromatic aberration suppression and polarization insensitivity. Broadband imaging results of the hybrid metalens are further provided, verifying the achromatism of the designed hybrid metalens. It can find applications in camera lenses and other optical systems that need compact, high-performance lenses.


title: Sub-stellar engulfment by a main sequence star: where is the lithium?

abstract: In this work, we study whether the engulfment of a brown dwarf (BD) by a solar-like main-sequence (MS) star can significantly alter the structure of the star and the Li content on its surface. We perform 3D Smoothed Particle Hydrodynamics simulations of the engulfment of a BD with masses 0.01 and 0.019 Msun, onto an MS star of 1 Msun and solar composition, in three different scenarios: a head-on collision, a grazing collision, and a merger. We study the dynamics of the interaction in detail, and the relevance of the type of interaction and the mass of the BD on the final fate of the sub-stellar object and the host star in terms of mass loss of the system, angular momentum transfer, and changes in the Li abundance in the surface of the host star. We found that most of the BD mass is diluted in the denser region of the MS star. Only in the merger scenario a significant fraction (40%) of the BD material would remain in the outer layers. We find a clear increase in the surface rotational velocity of the host star after the interaction, ranging between 25 km/s (grazing collision) to 50 km/s (merger). We also find a significant mass loss from the system (1e-4 - 1e-3 Msun) due to the engulfment, which in the case of the merger, may form a circumstellar disk-like structure. Assuming that neither the depth of the convective envelope of the host star nor its mass content are modified during the interaction, a small change in the surface Li abundance in the head-on and grazing collisions is found. However, in the merger we find large Li enhancements, by factors 20-30, depending on the BD mass. Some of these features could be detected observationally in the host star provide they remain long enough time.


title: Characters and transfer maps via categorified traces

abstract: We develop a theory of generalized characters of local systems in $\infty$-categories, which extends classical character theory for group representations and, in particular, the induced character formula. A key aspect of our approach is that we utilize the interaction between traces and their categorifications. We apply this theory to reprove and refine various results on the composability of Becker-Gottlieb transfers, the Hochschild homology of Thom spectra, and the additivity of traces in stable $\infty$-categories.


title: In search of Majorana

abstract: Majorana particles are the same as their antiparticle, and their analogues in condensed matter may be a platform for quantum computing. We describe the search for these modes in semiconductor heterostructures and how disorder is a limiting factor.


title: Guided Conditional Diffusion for Controllable Traffic Simulation

abstract: Controllable and realistic traffic simulation is critical for developing and verifying autonomous vehicles. Typical heuristic-based traffic models offer flexible control to make vehicles follow specific trajectories and traffic rules. On the other hand, data-driven approaches generate realistic and human-like behaviors, improving transfer from simulated to real-world traffic. However, to the best of our knowledge, no traffic model offers both controllability and realism. In this work, we develop a conditional diffusion model for controllable traffic generation (CTG) that allows users to control desired properties of trajectories at test time (e.g., reach a goal or follow a speed limit) while maintaining realism and physical feasibility through enforced dynamics. The key technical idea is to leverage recent advances from diffusion modeling and differentiable logic to guide generated trajectories to meet rules defined using signal temporal logic (STL). We further extend guidance to multi-agent settings and enable interaction-based rules like collision avoidance. CTG is extensively evaluated on the nuScenes dataset for diverse and composite rules, demonstrating improvement over strong baselines in terms of the controllability-realism tradeoff.


title: Analysis and Detection of Singing Techniques in Repertoires of J-POP Solo Singers

abstract: In this paper, we focus on singing techniques within the scope of music information retrieval research. We investigate how singers use singing techniques using real-world recordings of famous solo singers in Japanese popular music songs (J-POP). First, we built a new dataset of singing techniques. The dataset consists of 168 commercial J-POP songs, and each song is annotated using various singing techniques with timestamps and vocal pitch contours. We also present descriptive statistics of singing techniques on the dataset to clarify what and how often singing techniques appear. We further explored the difficulty of the automatic detection of singing techniques using previously proposed machine learning techniques. In the detection, we also investigate the effectiveness of auxiliary information (i.e., pitch and distribution of label duration), not only providing the baseline. The best result achieves 40.4% at macro-average F-measure on nine-way multi-class detection. We provide the annotation of the dataset and its detail on the appendix website 0 .


title: Teacher-student curriculum learning for reinforcement learning

abstract: Reinforcement learning (rl) is a popular paradigm for sequential decision making problems. The past decade's advances in rl have led to breakthroughs in many challenging domains such as video games, board games, robotics, and chip design. The sample inefficiency of deep reinforcement learning methods is a significant obstacle when applying rl to real-world problems. Transfer learning has been applied to reinforcement learning such that the knowledge gained in one task can be applied when training in a new task. Curriculum learning is concerned with sequencing tasks or data samples such that knowledge can be transferred between those tasks to learn a target task that would otherwise be too difficult to solve. Designing a curriculum that improves sample efficiency is a complex problem. In this thesis, we propose a teacher-student curriculum learning setting where we simultaneously train a teacher that selects tasks for the student while the student learns how to solve the selected task. Our method is independent of human domain knowledge and manual curriculum design. We evaluated our methods on two reinforcement learning benchmarks: grid world and the challenging Google Football environment. With our method, we can improve the sample efficiency and generality of the student compared to tabula-rasa reinforcement learning.