title: Extension theorem for $bmo$ in a domain

abstract: The $bmo$ space, also known as the local $BMO$ space, is the $BMO$ space which is uniformly locally $L^1$ in addition. In this article, we establish an extension theorem for the $bmo$ space defined in an arbitrary uniformly $C^2$ domain. This extension theorem results in a product estimate for $bmo$ functions defined in an arbitrary uniformly $C^2$ domain.


title: Towards Generalized Multi-stage Clustering: Multi-view Self-distillation

abstract: Existing multi-stage clustering methods independently learn the salient features from multiple views and then perform the clustering task. Particularly, multi-view clustering (MVC) has attracted a lot of attention in multi-view or multi-modal scenarios. MVC aims at exploring common semantics and pseudo-labels from multiple views and clustering in a self-supervised manner. However, limited by noisy data and inadequate feature learning, such a clustering paradigm generates overconfident pseudo-labels that mis-guide the model to produce inaccurate predictions. Therefore, it is desirable to have a method that can correct this pseudo-label mistraction in multi-stage clustering to avoid the bias accumulation. To alleviate the effect of overconfident pseudo-labels and improve the generalization ability of the model, this paper proposes a novel multi-stage deep MVC framework where multi-view self-distillation (DistilMVC) is introduced to distill dark knowledge of label distribution. Specifically, in the feature subspace at different hierarchies, we explore the common semantics of multiple views through contrastive learning and obtain pseudo-labels by maximizing the mutual information between views. Additionally, a teacher network is responsible for distilling pseudo-labels into dark knowledge, supervising the student network and improving its predictive capabilities to enhance the robustness. Extensive experiments on real-world multi-view datasets show that our method has better clustering performance than state-of-the-art methods.


title: Social Interaction-Aware Dynamical Models and Decision Making for Autonomous Vehicles

abstract: Interaction-aware Autonomous Driving (IAAD) is a rapidly growing field of research that focuses on the development of autonomous vehicles (AVs) that are capable of interacting safely and efficiently with human road users. This is a challenging task, as it requires the autonomous vehicle to be able to understand and predict the behaviour of human road users. In this literature review, the current state of IAAD research is surveyed in this work. Commencing with an examination of terminology, attention is drawn to challenges and existing models employed for modelling the behaviour of drivers and pedestrians. Next, a comprehensive review is conducted on various techniques proposed for interaction modelling, encompassing cognitive methods, machine learning approaches, and game-theoretic methods. The conclusion is reached through a discussion of potential advantages and risks associated with IAAD, along with the illumination of pivotal research inquiries necessitating future exploration.


title: Macroscopic emulation of microscopic magnetic particle systems

abstract: In this work we show that macroscopic experiments can be used to investigate microscopic systems. Such macroscopic experiments enable testing the assumptions and results obtained by theoretical considerations or simulations that can not be obtained under microscope (e.g., the orientation of a spherical particle). To emulate the dynamics of a single hematite cube immersed in water and subjected to a rotating magnetic field, a cubic magnet is firmly positioned in a 3D printed superball shell. The dimensionless parameters of the microscopic and macroscopic systems can be equalized by using a glycerol-water mixture instead of water as well as by the material and infill of the 3D printed shell. The pose of the superball is tracked using ArUco stickers which act as fiducial markers. It was found that there is a qualitative agreement between the macroscopic experiments and theoretical predictions. However, the reduced thermal effects in the macroscopic experiments lead to an increase in friction between the superball and the surface, thus shifting the critical frequency of the system. Since the shell is 3D printed, the given method can be extended to any shape and magnetization orientation.


title: Ever Evolving Evaluator (EV3): Towards Flexible and Reliable Meta-Optimization for Knowledge Distillation

abstract: We introduce EV3, a novel meta-optimization framework designed to efficiently train scalable machine learning models through an intuitive explore-assess-adapt protocol. In each iteration of EV3, we explore various model parameter updates, assess them using pertinent evaluation methods, and then adapt the model based on the optimal updates and previous progress history. EV3 offers substantial flexibility without imposing stringent constraints like differentiability on the key objectives relevant to the tasks of interest, allowing for exploratory updates with intentionally-biased gradients and through a diversity of losses and optimizers. Additionally, the assessment phase provides reliable safety controls to ensure robust generalization, and can dynamically prioritize tasks in scenarios with multiple objectives. With inspiration drawn from evolutionary algorithms, meta-learning, and neural architecture search, we investigate an application of EV3 to knowledge distillation. Our experimental results illustrate EV3's capability to safely explore the modeling landscape, while hinting at its potential applicability across numerous domains due to its inherent flexibility and adaptability. Finally, we provide a JAX implementation of EV3, along with source code for experiments, available at: https://github.com/google-research/google-research/tree/master/ev3.


title: Emergence of Shape Bias in Convolutional Neural Networks through Activation Sparsity

abstract: Current deep-learning models for object recognition are known to be heavily biased toward texture. In contrast, human visual systems are known to be biased toward shape and structure. What could be the design principles in human visual systems that led to this difference? How could we introduce more shape bias into the deep learning models? In this paper, we report that sparse coding, a ubiquitous principle in the brain, can in itself introduce shape bias into the network. We found that enforcing the sparse coding constraint using a non-differential Top-K operation can lead to the emergence of structural encoding in neurons in convolutional neural networks, resulting in a smooth decomposition of objects into parts and subparts and endowing the networks with shape bias. We demonstrated this emergence of shape bias and its functional benefits for different network structures with various datasets. For object recognition convolutional neural networks, the shape bias leads to greater robustness against style and pattern change distraction. For the image synthesis generative adversary networks, the emerged shape bias leads to more coherent and decomposable structures in the synthesized images. Ablation studies suggest that sparse codes tend to encode structures, whereas the more distributed codes tend to favor texture. Our code is host at the github repository: \url{https://github.com/Crazy-Jack/nips2023_shape_vs_texture}


title: Optimizing Task-Specific Timeliness With Edge-Assisted Scheduling for Status Update

abstract: Intelligent real-time applications, such as video surveillance, demand intensive computation to extract status information from raw sensing data. This poses a substantial challenge in orchestrating computation and communication resources to provide fresh status information. In this paper, we consider a scenario where multiple energy-constrained devices served by an edge server. To extract status information, each device can either do the computation locally or offload it to the edge server. A scheduling policy is needed to determine when and where to compute for each device, taking into account communication and computation capabilities, as well as task-specific timeliness requirements. To that end, we first model the timeliness requirements as general penalty functions of Age of Information (AoI). A convex optimization problem is formulated to provide a lower bound of the minimum AoI penalty given system parameters. Using KKT conditions, we proposed a novel scheduling policy which evaluates status update priorities based on communication and computation delays and task-specific timeliness requirements. The proposed policy is applied to an object tracking application and carried out on a large video dataset. Simulation results show that our policy improves tracking accuracy compared with scheduling policies based on video content information.


title: Pictorial $SU(3)_f$ approach for two-body $\Omega_c$ weak decays

abstract: We explore two-body non-leptonic weak decays of $\Omega_c^0$ into final states ${\bf B}^{(*)}M$ and ${\bf B}^{(*)}V$, where ${\bf B}^{(*)}$ denotes an octet (a decuplet) baryon, and $M(V)$ represents a pseudoscalar (vector) meson. Based on the $SU(3)$ flavor $[SU(3)_f]$ symmetry, we depict and parameterize the $W$-emission and $W$-exchange processes using the topological diagram approach, establishing strict $SU(3)_f$ relations for possible decay channels. We identify dominant topological parameters, determined by available data, allowing us to explain the experimental ratios ${\cal B}(\Omega_c^0\to\Xi^{*0}\bar K^{*0})/{\cal B}(\Omega_c^0\to\Omega^-\rho^+)=0.28\pm 0.11$, ${\cal B}(\Omega_c^0\to\Xi^-\pi^+)/{\cal B}(\Omega_c^0\to\Xi^{0}\bar K^{0})=0.10\pm 0.02$, and ${\cal B}(\Omega_c^0 \to \Omega^- K^+)/{\cal B}(\Omega_c^0 \to \Omega^- \pi^+)=0.06\pm 0.01$. We also calculate the branching fractions of the Cabibbo-allowed decays, such as ${\cal B}(\Omega_c^0 \to \Xi^{* 0} \bar{K}^{0})=(9.8\pm1.3)\times 10^{-4}$. In particular, we establish approximate isospin relations: ${\cal B}(\Omega_c^0 \to \Xi^{(*)-} \pi^+)\simeq 2{\cal B}(\Omega_c^0 \to \Xi^{(*)0} \pi^0)$ and ${\cal B}(\Omega_c^0 \to \Xi^{(*)-} \rho^+)\simeq 2{\cal B}(\Omega_c^0 \to \Xi^{(*)0} \rho^0)$, where ${\cal B}(\Omega_c^0 \to \Xi^0 \pi^0)=(2.3\pm0.2)\times 10^{-4}$ is accessible to the Belle and LHCb experiments.


title: Enhancing Low-Order Discontinuous Galerkin Methods with Neural Ordinary Differential Equations for Compressible Navier--Stokes Equations

abstract: The growing computing power over the years has enabled simulations to become more complex and accurate. While immensely valuable for scientific discovery and problem-solving, however, high-fidelity simulations come with significant computational demands. As a result, it is common to run a low-fidelity model with a subgrid-scale model to reduce the computational cost, but selecting the appropriate subgrid-scale models and tuning them are challenging. We propose a novel method for learning the subgrid-scale model effects when simulating partial differential equations augmented by neural ordinary differential operators in the context of discontinuous Galerkin (DG) spatial discretization. Our approach learns the missing scales of the low-order DG solver at a continuous level and hence improves the accuracy of the low-order DG approximations as well as accelerates the filtered high-order DG simulations with a certain degree of precision. We demonstrate the performance of our approach through multidimensional Taylor-Green vortex examples at different Reynolds numbers and times, which cover laminar, transitional, and turbulent regimes. The proposed method not only reconstructs the subgrid-scale from the low-order (1st-order) approximation but also speeds up the filtered high-order DG (6th-order) simulation by two orders of magnitude.


title: Global-Local Shrinkage Priors for Asymptotic Point and Interval Estimation of Normal Means under Sparsity

abstract: The paper addresses asymptotic estimation of normal means under sparsity. The primary focus is estimation of multivariate normal means where we obtain exact asymptotic minimax error under global-local shrinkage prior. This extends the corresponding univariate work of Ghosh and Chakrabarti (2017). In addition, we obtain similar results for the Dirichlet-Laplace prior as considered in Bhattacharya, Pati, Pillai, and Dunson (2015). Also, following van der Pas, Szabo, and van der Vaart (2017), we have been able to derive credible sets for multivariate normal means under global-local priors.


title: Multi-task deep learning for large-scale building detail extraction from high-resolution satellite imagery

abstract: Understanding urban dynamics and promoting sustainable development requires comprehensive insights about buildings. While geospatial artificial intelligence has advanced the extraction of such details from Earth observational data, existing methods often suffer from computational inefficiencies and inconsistencies when compiling unified building-related datasets for practical applications. To bridge this gap, we introduce the Multi-task Building Refiner (MT-BR), an adaptable neural network tailored for simultaneous extraction of spatial and attributional building details from high-resolution satellite imagery, exemplified by building rooftops, urban functional types, and roof architectural types. Notably, MT-BR can be fine-tuned to incorporate additional building details, extending its applicability. For large-scale applications, we devise a novel spatial sampling scheme that strategically selects limited but representative image samples. This process optimizes both the spatial distribution of samples and the urban environmental characteristics they contain, thus enhancing extraction effectiveness while curtailing data preparation expenditures. We further enhance MT-BR's predictive performance and generalization capabilities through the integration of advanced augmentation techniques. Our quantitative results highlight the efficacy of the proposed methods. Specifically, networks trained with datasets curated via our sampling method demonstrate improved predictive accuracy relative to those using alternative sampling approaches, with no alterations to network architecture. Moreover, MT-BR consistently outperforms other state-of-the-art methods in extracting building details across various metrics. The real-world practicality is also demonstrated in an application across Shanghai, generating a unified dataset that encompasses both the spatial and attributional details of buildings.


title: Quantum algorithms for linear and non-linear fractional reaction-diffusion equations

abstract: High-dimensional fractional reaction-diffusion equations have numerous applications in the fields of biology, chemistry, and physics, and exhibit a range of rich phenomena. While classical algorithms have an exponential complexity in the spatial dimension, a quantum computer can produce a quantum state that encodes the solution with only polynomial complexity, provided that suitable input access is available. In this work, we investigate efficient quantum algorithms for linear and nonlinear fractional reaction-diffusion equations with periodic boundary conditions. For linear equations, we analyze and compare the complexity of various methods, including the second-order Trotter formula, time-marching method, and truncated Dyson series method. We also present a novel algorithm that combines the linear combination of Hamiltonian simulation technique with the interaction picture formalism, resulting in optimal scaling in the spatial dimension. For nonlinear equations, we employ the Carleman linearization method and propose a block-encoding version that is appropriate for the dense matrices that arise from the spatial discretization of fractional reaction-diffusion equations.


title: An efficient modeling workflow for high-performance nanowire single-photon avalanche detector

abstract: Single-photon detector (SPD), an essential building block of the quantum communication system, plays a fundamental role in developing next-generation quantum technologies. In this work, we propose an efficient modeling workflow of nanowire SPDs utilizing avalanche breakdown at reverse-biased conditions. The proposed workflow is explored to maximize computational efficiency and balance time-consuming drift-diffusion simulation with fast script-based post-processing. Without excessive computational effort, we could predict a suite of key device performance metrics, including breakdown voltage, dark/light avalanche built-up time, photon detection efficiency, dark count rate, and the deterministic part of timing jitter due to device structures. Implementing the proposed workflow onto a single InP nanowire and comparing it to the extensively studied planar devices and superconducting nanowire SPDs, we showed the great potential of nanowire avalanche SPD to outperform their planar counterparts and obtain as superior performance as superconducting nanowires, i.e., achieve a high photon detection efficiency of 70% with a dark count rate less than 20 Hz at non-cryogenic temperature. The proposed workflow is not limited to single-nanowire or nanowire-based device modeling and can be readily extended to more complicated two-/three dimensional structures.


title: NetPanorama: A Declarative Grammar for Network Construction, Transformation, and Visualization

abstract: This paper introduces NetPanorama, a domain-specific language and declarative grammar for interactive network visualizations. Exploring complex networks with multivariate, geographical, or temporal information often require bespoke visualization designs, such as adjacency matrices, arc-diagrams, small multiples, timelines, or geographic map visualizations. However, creating these requires implementing data loading, data transformations, visualization, and interactivity, which is time-consuming and slows down the iterative exploration of this huge design space. With NetPanorama, a developer specifies a network visualization design as a pipeline of parameterizable steps. Our specification and reference implementation aims to facilitate visualization development and reuse; allow for easy design exploration and iteration; and make data transformation and visual mapping decisions transparent. Documentation, source code, examples, and an interactive online editor can be found online: https://netpanorama.netlify.app/


title: Visibility graph analysis of crude oil futures markets: Insights from the COVID-19 pandemic and Russia-Ukraine conflict

abstract: Drawing inspiration from the significant impact of the ongoing Russia-Ukraine conflict and the recent COVID-19 pandemic on global financial markets, this study conducts a thorough analysis of three key crude oil futures markets: WTI, Brent, and Shanghai (SC). Employing the visibility graph (VG) methodology, we examine both static and dynamic characteristics using daily and high-frequency data. We identified a clear power-law decay in most VG degree distributions and highlighted the pronounced clustering tendencies within crude oil futures VGs. Our results also confirm an inverse correlation between clustering coefficient and node degree and further reveal that all VGs not only adhere to the small-world property but also exhibit intricate assortative mixing. Through the time-varying characteristics of VGs, we found that WTI and Brent demonstrate aligned behavior, while the SC market, with its unique trading mechanics, deviates. The 5-minute VGs' assortativity coefficient provides a deeper understanding of these markets' reactions to the pandemic and geopolitical events. Furthermore, the differential responses during the COVID-19 and Russia-Ukraine conflict underline the unique sensitivities of each market to global disruptions. Overall, this research offers profound insights into the structure, dynamics, and adaptability of these essential commodities markets in the face of worldwide challenges.


title: Identifiable Contrastive Learning with Automatic Feature Importance Discovery

abstract: Existing contrastive learning methods rely on pairwise sample contrast $z_x^\top z_{x'}$ to learn data representations, but the learned features often lack clear interpretability from a human perspective. Theoretically, it lacks feature identifiability and different initialization may lead to totally different features. In this paper, we study a new method named tri-factor contrastive learning (triCL) that involves a 3-factor contrast in the form of $z_x^\top S z_{x'}$, where $S=\text{diag}(s_1,\dots,s_k)$ is a learnable diagonal matrix that automatically captures the importance of each feature. We show that by this simple extension, triCL can not only obtain identifiable features that eliminate randomness but also obtain more interpretable features that are ordered according to the importance matrix $S$. We show that features with high importance have nice interpretability by capturing common classwise features, and obtain superior performance when evaluated for image retrieval using a few features. The proposed triCL objective is general and can be applied to different contrastive learning methods like SimCLR and CLIP. We believe that it is a better alternative to existing 2-factor contrastive learning by improving its identifiability and interpretability with minimal overhead. Code is available at https://github.com/PKU-ML/Tri-factor-Contrastive-Learning.


title: Incorporating nonparametric methods for estimating causal excursion effects in mobile health with zero-inflated count outcomes

abstract: In mobile health, tailoring interventions for real-time delivery is of paramount importance. Micro-randomized trials have emerged as the "gold-standard" methodology for developing such interventions. Analyzing data from these trials provides insights into the efficacy of interventions and the potential moderation by specific covariates. The "causal excursion effect", a novel class of causal estimand, addresses these inquiries. Yet, existing research mainly focuses on continuous or binary data, leaving count data largely unexplored. The current work is motivated by the Drink Less micro-randomized trial from the UK, which focuses on a zero-inflated proximal outcome, i.e., the number of screen views in the subsequent hour following the intervention decision point. To be specific, we revisit the concept of causal excursion effect, specifically for zero-inflated count outcomes, and introduce novel estimation approaches that incorporate nonparametric techniques. Bidirectional asymptotics are established for the proposed estimators. Simulation studies are conducted to evaluate the performance of the proposed methods. As an illustration, we also implement these methods to the Drink Less trial data.


title: Stacking the Odds: Transformer-Based Ensemble for AI-Generated Text Detection

abstract: This paper reports our submission under the team name `SynthDetectives' to the ALTA 2023 Shared Task. We use a stacking ensemble of Transformers for the task of AI-generated text detection. Our approach is novel in terms of its choice of models in that we use accessible and lightweight models in the ensemble. We show that ensembling the models results in an improved accuracy in comparison with using them individually. Our approach achieves an accuracy score of 0.9555 on the official test data provided by the shared task organisers.


title: Topological, or Non-topological? A Deep Learning Based Prediction

abstract: Prediction and discovery of new materials with desired properties are at the forefront of quantum science and technology research. A major bottleneck in this field is the computational resources and time complexity related to finding new materials from ab initio calculations. In this work, an effective and robust deep learning-based model is proposed by incorporating persistent homology and graph neural network which offers an accuracy of 91.4% and an F1 score of 88.5% in classifying topological vs. non-topological materials, outperforming the other state-of-the-art classifier models. The incorporation of the graph neural network encodes the underlying relation between the atoms into the model based on their own crystalline structures and thus proved to be an effective method to represent and process non-euclidean data like molecules with a relatively shallow network. The persistent homology pipeline in the suggested neural network is capable of integrating the atom-specific topological information into the deep learning model, increasing robustness, and gain in performance. It is believed that the presented work will be an efficacious tool for predicting the topological class and therefore enable the high-throughput search for novel materials in this field.


title: Estimating the Rate-Distortion Function by Wasserstein Gradient Descent

abstract: In the theory of lossy compression, the rate-distortion (R-D) function $R(D)$ describes how much a data source can be compressed (in bit-rate) at any given level of fidelity (distortion). Obtaining $R(D)$ for a given data source establishes the fundamental performance limit for all compression algorithms. We propose a new method to estimate $R(D)$ from the perspective of optimal transport. Unlike the classic Blahut--Arimoto algorithm which fixes the support of the reproduction distribution in advance, our Wasserstein gradient descent algorithm learns the support of the optimal reproduction distribution by moving particles. We prove its local convergence and analyze the sample complexity of our R-D estimator based on a connection to entropic optimal transport. Experimentally, we obtain comparable or tighter bounds than state-of-the-art neural network methods on low-rate sources while requiring considerably less tuning and computation effort. We also highlight a connection to maximum-likelihood deconvolution and introduce a new class of sources that can be used as test cases with known solutions to the R-D problem.


title: Impact of Medium Anisotropy on Quarkonium Dissociation and Regeneration

abstract: Quarkonium production in ultra-relativistic collisions plays a crucial role in probing the existence of hot QCD matter. This study explores quarkonia states dissociation and regeneration in the hot QCD medium while considering momentum anisotropy. The net quarkonia decay width ($\Gamma_{D}$) arises from two essential processes: collisional damping and gluonic dissociation. The quarkonia regeneration includes the transition from octet to singlet states within the anisotropic medium. Our study utilizes a medium-modified potential that incorporates anisotropy via particle distribution functions. This modified potential gives rise to collisional damping for quarkonia due to the surrounding medium, as well as the transition of quarkonia from singlet to octet states due to interactions with gluons. Furthermore, we employ the detailed balance approach to investigate the regeneration of quarkonia within this medium. Our comprehensive analysis spans various temperature settings, transverse momentum values, and anisotropic strengths. Notably, we find that, in addition to medium temperatures and heavy quark transverse momentum, anisotropy significantly influences the dissociation and regeneration of various quarkonia states.


title: InstanT: Semi-supervised Learning with Instance-dependent Thresholds

abstract: Semi-supervised learning (SSL) has been a fundamental challenge in machine learning for decades. The primary family of SSL algorithms, known as pseudo-labeling, involves assigning pseudo-labels to confident unlabeled instances and incorporating them into the training set. Therefore, the selection criteria of confident instances are crucial to the success of SSL. Recently, there has been growing interest in the development of SSL methods that use dynamic or adaptive thresholds. Yet, these methods typically apply the same threshold to all samples, or use class-dependent thresholds for instances belonging to a certain class, while neglecting instance-level information. In this paper, we propose the study of instance-dependent thresholds, which has the highest degree of freedom compared with existing methods. Specifically, we devise a novel instance-dependent threshold function for all unlabeled instances by utilizing their instance-level ambiguity and the instance-dependent error rates of pseudo-labels, so instances that are more likely to have incorrect pseudo-labels will have higher thresholds. Furthermore, we demonstrate that our instance-dependent threshold function provides a bounded probabilistic guarantee for the correctness of the pseudo-labels it assigns.


title: Uncovering Gender Bias within Journalist-Politician Interaction in Indian Twitter

abstract: Gender bias in political discourse is a significant problem on today's social media. Previous studies found that the gender of politicians indeed influences the content directed towards them by the general public. However, these works are particularly focused on the global north, which represents individualistic culture. Furthermore, they did not address whether there is gender bias even within the interaction between popular journalists and politicians in the global south. These understudied journalist-politician interactions are important (more so in collectivistic cultures like the global south) as they can significantly affect public sentiment and help set gender-biased social norms. In this work, using large-scale data from Indian Twitter we address this research gap. We curated a gender-balanced set of 100 most-followed Indian journalists on Twitter and 100 most-followed politicians. Then we collected 21,188 unique tweets posted by these journalists that mentioned these politicians. Our analysis revealed that there is a significant gender bias -- the frequency with which journalists mention male politicians vs. how frequently they mention female politicians is statistically significantly different ($p<<0.05$). In fact, median tweets from female journalists mentioning female politicians received ten times fewer likes than median tweets from female journalists mentioning male politicians. However, when we analyzed tweet content, our emotion score analysis and topic modeling analysis did not reveal any significant gender-based difference within the journalists' tweets towards politicians. Finally, we found a potential reason for the significant gender bias: the number of popular male Indian politicians is almost twice as large as the number of popular female Indian politicians, which might have resulted in the observed bias. We conclude by discussing the implications of this work.


title: Sentence Bag Graph Formulation for Biomedical Distant Supervision Relation Extraction

abstract: We introduce a novel graph-based framework for alleviating key challenges in distantly-supervised relation extraction and demonstrate its effectiveness in the challenging and important domain of biomedical data. Specifically, we propose a graph view of sentence bags referring to an entity pair, which enables message-passing based aggregation of information related to the entity pair over the sentence bag. The proposed framework alleviates the common problem of noisy labeling in distantly supervised relation extraction and also effectively incorporates inter-dependencies between sentences within a bag. Extensive experiments on two large-scale biomedical relation datasets and the widely utilized NYT dataset demonstrate that our proposed framework significantly outperforms the state-of-the-art methods for biomedical distant supervision relation extraction while also providing excellent performance for relation extraction in the general text mining domain.


title: Debiasing Algorithm through Model Adaptation

abstract: Large language models are becoming the go-to solution for the ever-growing number of tasks. However, with growing capacity, models are prone to rely on spurious correlations stemming from biases and stereotypes present in the training data. This work proposes a novel method for detecting and mitigating gender bias in language models. We perform causal analysis to identify problematic model components and discover that mid-upper feed-forward layers are most prone to convey bias. Based on the analysis results, we intervene in the model by applying a linear projection to the weight matrices of these layers. Our titular method, DAMA, significantly decreases bias as measured by diverse metrics while maintaining the model's performance on downstream tasks. We release code for our method and models, which retrain LLaMA's state-of-the-art performance while being significantly less biased.


title: Zygmund regularity of even singular integral operators on domains

abstract: Given a bounded Lipschitz domain $D\subset \mathbb{R}^d,$ a convolution Calder\'{o}n-Zygmund operator $T$ and a growth function $\omega(x)$ of type $n$, we study what conditions on the boundary of the domain are sufficient for boundedness of the restricted even operator $T_D$ on the generalized Zygmund space $C^{\omega}_*(D)$. Based on a recent T(P) theorem, we prove that this holds if the smoothness of the boundary of a domain $D$ is by one point, in a sense, greater than the smoothness of the corresponding Zygmund space $C^{\omega}_*(D)$. The main argument of the proof are the higher order gradient estimates of the transform $T_D\chi_D$ of the characteristic function of a domain with the polynomial boundary.


title: Multi/Single-stage structured zero-gradient-sum approach for prescribed-time optimization

abstract: Prescribed-time convergence mechanism has become a prominent research focus in the current field of optimization and control due to its ability to precisely control the target completion time. The recently arisen prescribed-time algorithms for distributed optimization, currently necessitate multi-stage structures to achieve global convergence. This paper introduces two modified zero-gradient-sum algorithms, each based on a multi-stage and a single-stage structural frameworks established in this work. These algorithms are designed to achieve prescribed-time convergence and relax two common yet stringent conditions. This work also bridges the gap in current research on single-stage structured PTDO algorithm. The excellent convergence performance of the proposed algorithms is validated through a case study.


title: Efficient parallel solver for rarefied gas flow using GSIS

abstract: Recently, the general synthetic iterative scheme (GSIS) has been proposed to find the steady-state solution of the Boltzmann equation in the whole range of gas rarefaction, where its fast-converging and asymptotic-preserving properties lead to the significant reduction of iteration numbers and spatial cells in the near-continuum flow regime. However, the efficiency and accuracy of GSIS has only been demonstrated in two-dimensional problems with small numbers of spatial cells and discrete velocities. Here, a large-scale parallel computing strategy is designed to extend the GSIS to three-dimensional flow problems, including the supersonic flows which are usually difficult to solve by the discrete velocity method. Since the GSIS involves the calculation of the mesoscopic kinetic equation which is defined in six-dimensional phase-space, and the macroscopic high-temperature Navier-Stokes-Fourier equations in three-dimensional physical space, the proper partition of the spatial and velocity spaces, and the allocation of CPU cores to the mesoscopic and macroscopic solvers, are the keys to improving the overall computational efficiency. These factors are systematically tested to achieve optimal performance, up to 100 billion spatial and velocity grids. For hypersonic flows around the Apollo reentry capsule, the X38-like vehicle, and the space station, our parallel solver can obtain the converged solution within one hour.


title: TivNe-SLAM: Dynamic Mapping and Tracking via Time-Varying Neural Radiance Fields

abstract: Previous attempts to integrate Neural Radiance Fields (NeRF) into the Simultaneous Localization and Mapping (SLAM) framework either rely on the assumption of static scenes or require the ground truth camera poses, which impedes their application in real-world scenarios. In this paper, we propose a time-varying representation to track and reconstruct the dynamic scenes. Firstly, two processes, tracking process and mapping process, are simultaneously maintained in our framework. For the tracking process, all input images are uniformly sampled, then progressively trained in a self-supervised paradigm. For the mapping process, we leverage motion masks to distinguish dynamic objects from static background, and sample more pixels from dynamic areas. Secondly, the parameter optimization for both processes consists of two stages: the first stage associates time with 3D positions to convert the deformation field to the canonical field. And the second stage associates time with the embeddings of canonical field to obtain colors and Signed Distance Function (SDF). Lastly, we propose a novel keyframe selection strategy based on the overlapping rate. We evaluate our approach on two synthetic datasets and one real-world dataset. And the experiments validate that our method achieves competitive results in both tracking and mapping when compared to existing state-of-the-art NeRF-based methods.


title: Hyperbolic Graph Neural Networks at Scale: A Meta Learning Approach

abstract: The progress in hyperbolic neural networks (HNNs) research is hindered by their absence of inductive bias mechanisms, which are essential for generalizing to new tasks and facilitating scalable learning over large datasets. In this paper, we aim to alleviate these issues by learning generalizable inductive biases from the nodes' local subgraph and transfer them for faster learning over new subgraphs with a disjoint set of nodes, edges, and labels in a few-shot setting. We introduce a novel method, Hyperbolic GRAph Meta Learner (H-GRAM), that, for the tasks of node classification and link prediction, learns transferable information from a set of support local subgraphs in the form of hyperbolic meta gradients and label hyperbolic protonets to enable faster learning over a query set of new tasks dealing with disjoint subgraphs. Furthermore, we show that an extension of our meta-learning framework also mitigates the scalability challenges seen in HNNs faced by existing approaches. Our comparative analysis shows that H-GRAM effectively learns and transfers information in multiple challenging few-shot settings compared to other state-of-the-art baselines. Additionally, we demonstrate that, unlike standard HNNs, our approach is able to scale over large graph datasets and improve performance over its Euclidean counterparts.


title: Posterior Sampling with Delayed Feedback for Reinforcement Learning with Linear Function Approximation

abstract: Recent studies in reinforcement learning (RL) have made significant progress by leveraging function approximation to alleviate the sample complexity hurdle for better performance. Despite the success, existing provably efficient algorithms typically rely on the accessibility of immediate feedback upon taking actions. The failure to account for the impact of delay in observations can significantly degrade the performance of real-world systems due to the regret blow-up. In this work, we tackle the challenge of delayed feedback in RL with linear function approximation by employing posterior sampling, which has been shown to empirically outperform the popular UCB algorithms in a wide range of regimes. We first introduce Delayed-PSVI, an optimistic value-based algorithm that effectively explores the value function space via noise perturbation with posterior sampling. We provide the first analysis for posterior sampling algorithms with delayed feedback in RL and show our algorithm achieves $\widetilde{O}(\sqrt{d^3H^3 T} + d^2H^2 E[\tau])$ worst-case regret in the presence of unknown stochastic delays. Here $E[\tau]$ is the expected delay. To further improve its computational efficiency and to expand its applicability in high-dimensional RL problems, we incorporate a gradient-based approximate sampling scheme via Langevin dynamics for Delayed-LPSVI, which maintains the same order-optimal regret guarantee with $\widetilde{O}(dHK)$ computational cost. Empirical evaluations are performed to demonstrate the statistical and computational efficacy of our algorithms.


title: Improving Multi-Person Pose Tracking with A Confidence Network

abstract: Human pose estimation and tracking are fundamental tasks for understanding human behaviors in videos. Existing top-down framework-based methods usually perform three-stage tasks: human detection, pose estimation and tracking. Although promising results have been achieved, these methods rely heavily on high-performance detectors and may fail to track persons who are occluded or miss-detected. To overcome these problems, in this paper, we develop a novel keypoint confidence network and a tracking pipeline to improve human detection and pose estimation in top-down approaches. Specifically, the keypoint confidence network is designed to determine whether each keypoint is occluded, and it is incorporated into the pose estimation module. In the tracking pipeline, we propose the Bbox-revision module to reduce missing detection and the ID-retrieve module to correct lost trajectories, improving the performance of the detection stage. Experimental results show that our approach is universal in human detection and pose estimation, achieving state-of-the-art performance on both PoseTrack 2017 and 2018 datasets.


title: QWID: Quantized Weed Identification Deep neural network

abstract: In this paper, we present an efficient solution for weed classification in agriculture. We focus on optimizing model performance at inference while respecting the constraints of the agricultural domain. We propose a Quantized Deep Neural Network model that classifies a dataset of 9 weed classes using 8-bit integer (int8) quantization, a departure from standard 32-bit floating point (fp32) models. Recognizing the hardware resource limitations in agriculture, our model balances model size, inference time, and accuracy, aligning with practical requirements. We evaluate the approach on ResNet-50 and InceptionV3 architectures, comparing their performance against their int8 quantized versions. Transfer learning and fine-tuning are applied using the DeepWeeds dataset. The results show staggering model size and inference time reductions while maintaining accuracy in real-world production scenarios like Desktop, Mobile and Raspberry Pi. Our work sheds light on a promising direction for efficient AI in agriculture, holding potential for broader applications. Code: https://github.com/parikshit14/QNN-for-weed


title: Band Structure of Topological Insulator BiSbTe1.25Se1.75

abstract: We present our angle resolved photoelectron spectroscopy (ARPES) and density functional theory results on quaternary topological insulator (TI) BiSbTe1.25Se1.75 (BSTS) confirming the non-trivial topology of the surface state bands (SSBs) in this compound. We find that the SSBs, which are are sensitive to the atomic composition of the terminating surface have a partial 3D character. Our detailed study of the band bending (BB) effects shows that in BSTS the Dirac point (DP) shifts by more than two times compared to that in Bi2Se3 to reach the saturation. The stronger BB in BSTS could be due to the difference in screening of the surface charges. From momentum density curves (MDCs) of the ARPES data we obtained an energy dispersion relation showing the warping strength of the Fermi surface in BSTS to be intermediate between those found in Bi2Se3 and Bi2Te3 and also to be tunable by controlling the ratio of chalcogen/pnictogen atoms. Our experiments also reveal that the nature of the BB effects are highly sensitive to the exposure of the fresh surface to various gas species. These findings have important implications in the tuning of DP in TIs for technological applications.


title: Random generation of subgroups of the modular group with a fixed isomorphism type

abstract: We show how to efficiently count and generate uniformly at random finitely generated subgroups of the modular group $\textsf{PSL}(2,\mathbb{Z})$ of a given isomorphism type. The method to achieve these results relies on a natural map of independent interest, which associates with any finitely generated subgroup of $\textsf{PSL}(2,\mathbb{Z})$ a graph which we call its silhouette, and which can be interpreted as a conjugacy class of free finite index subgroups of $\textsf{PSL}(2,\mathbb{Z})$.


title: Remaining useful life prediction of Lithium-ion batteries using spatio-temporal multimodal attention networks

abstract: Lithium-ion batteries are widely used in various applications, including electric vehicles and renewable energy storage. The prediction of the remaining useful life (RUL) of batteries is crucial for ensuring reliable and efficient operation, as well as reducing maintenance costs. However, determining the life cycle of batteries in real-world scenarios is challenging, and existing methods have limitations in predicting the number of cycles iteratively. In addition, existing works often oversimplify the datasets, neglecting important features of the batteries such as temperature, internal resistance, and material type. To address these limitations, this paper proposes a two-stage RUL prediction scheme for Lithium-ion batteries using a spatio-temporal multimodal attention network (ST-MAN). The proposed ST-MAN is to capture the complex spatio-temporal dependencies in the battery data, including the features that are often neglected in existing works. Despite operating without prior knowledge of end-of-life (EOL) events, our method consistently achieves lower error rates, boasting mean absolute error (MAE) and mean square error (MSE) of 0.0275 and 0.0014, respectively, compared to existing convolutional neural networks (CNN) and long short-term memory (LSTM)-based methods. The proposed method has the potential to improve the reliability and efficiency of battery operations and is applicable in various industries.


title: Total positivity for matroid Schubert varieties

abstract: We define the totally nonnegative matroid Schubert variety $\mathcal Y_V$ of a linear subspace $V \subset \mathbb R^n$. We show that $\mathcal Y_V$ is a regular CW complex homeomorphic to a closed ball, with strata indexed by pairs of acyclic flats of the oriented matroid of $V$. This closely resembles the regularity theorem for totally nonnegative generalized flag varieties. As a corollary, we obtain a regular CW structure on the real matroid Schubert variety of $V$.


title: CHAIN: Exploring Global-Local Spatio-Temporal Information for Improved Self-Supervised Video Hashing

abstract: Compressing videos into binary codes can improve retrieval speed and reduce storage overhead. However, learning accurate hash codes for video retrieval can be challenging due to high local redundancy and complex global dependencies between video frames, especially in the absence of labels. Existing self-supervised video hashing methods have been effective in designing expressive temporal encoders, but have not fully utilized the temporal dynamics and spatial appearance of videos due to less challenging and unreliable learning tasks. To address these challenges, we begin by utilizing the contrastive learning task to capture global spatio-temporal information of videos for hashing. With the aid of our designed augmentation strategies, which focus on spatial and temporal variations to create positive pairs, the learning framework can generate hash codes that are invariant to motion, scale, and viewpoint. Furthermore, we incorporate two collaborative learning tasks, i.e., frame order verification and scene change regularization, to capture local spatio-temporal details within video frames, thereby enhancing the perception of temporal structure and the modeling of spatio-temporal relationships. Our proposed Contrastive Hashing with Global-Local Spatio-temporal Information (CHAIN) outperforms state-of-the-art self-supervised video hashing methods on four video benchmark datasets. Our codes will be released.


title: The physical basis of teleological evolutions

abstract: It is easily seen that the mere existence of an optimal quantum computational speedup logically implies the mutually exclusive or of well-defined causal loops. In each of them, it is as if the problem-solver knew in advance one of the possible halves of the information about the solution she will produce and measure in the future and used this knowledge to produce the solution with correspondingly fewer computation steps. Involving only the measurements of commuting observables, quantum algorithms are submitted to the same (classical) logic and should therefore host the quantum superposition of the causal loops in question. However, being causal in character, their ordinary quantum description cannot describe causal loops. We argue that it must therefore be incomplete and show that it is completed by time-symmetrizing it. This leaves the ordinary quantum description mathematically unaltered but replaces its single causal process by the quantum superposition of causal loops in question. In their completed quantum description, quantum algorithms respond to the pre-scientific notion of teleological evolution, that is, an evolution toward a goal (the solution) with an attractor in the goal it will produce in the future (the solution again). Once applied to the evolutions of the living, this notion was dismissed with the advent of modern science for the alleged absence of a physical basis. We show that, under a quantum cosmological interpretation of the Anthropic Principle, the same quantum superposition of causal loops underlying the teleological character of quantum algorithms becomes the missing physical basis of the teleological character of natural evolutions.


title: A transfer learning approach with convolutional neural network for Face Mask Detection

abstract: Due to the epidemic of the coronavirus (Covid-19) and its rapid spread around the world, the world has faced an enormous crisis. To prevent the spread of the coronavirus, the World Health Organization (WHO) has introduced the use of masks and keeping social distance as the best preventive method. So, developing an automatic monitoring system for detecting facemasks in some crowded places is essential. To do this, we propose a mask recognition system based on transfer learning and Inception v3 architecture. In the proposed method, two datasets are used simultaneously for training including the Simulated Mask Face Dataset (SMFD) and MaskedFace-Net (MFN) This paper tries to increase the accuracy of the proposed system by optimally setting hyper-parameters and accurately designing the fully connected layers. The main advantage of the proposed method is that in addition to masked and unmasked faces, it can also detect cases of incorrect use of mask. Therefore, the proposed method classifies the input face images into three categories. Experimental results show the high accuracy and efficiency of the proposed method; so, this method has achieved an accuracy of 99.47% and 99.33% in training and test data respectively


title: An Ontological Model of User Preferences

abstract: The notion of preferences plays an important role in many disciplines including service robotics which is concerned with scenarios in which robots interact with humans. These interactions can be favored by robots taking human preferences into account. This raises the issue of how preferences should be represented to support such preference-aware decision making. Several formal accounts for a notion of preferences exist. However, these approaches fall short on defining the nature and structure of the options that a robot has in a given situation. In this work, we thus investigate a formal model of preferences where options are non-atomic entities that are defined by the complex situations they bring about.


title: Retrofitting Light-weight Language Models for Emotions using Supervised Contrastive Learning

abstract: We present a novel retrofitting method to induce emotion aspects into pre-trained language models (PLMs) such as BERT and RoBERTa. Our method updates pre-trained network weights using contrastive learning so that the text fragments exhibiting similar emotions are encoded nearby in the representation space, and the fragments with different emotion content are pushed apart. While doing so, it also ensures that the linguistic knowledge already present in PLMs is not inadvertently perturbed. The language models retrofitted by our method, i.e., BERTEmo and RoBERTaEmo, produce emotion-aware text representations, as evaluated through different clustering and retrieval metrics. For the downstream tasks on sentiment analysis and sarcasm detection, they perform better than their pre-trained counterparts (about 1% improvement in F1-score) and other existing approaches. Additionally, a more significant boost in performance is observed for the retrofitted models over pre-trained ones in few-shot learning setting.


title: Equilibria decomposition-based comparison of reaction networks of Wnt signaling

abstract: The Wnt signaling pathway plays a critical role in various biochemical processes, including embryonic development, tissue homeostasis, and cancer progression. In this paper, we conduct a comparative analysis of $\beta$-catenin-dependent Wnt signaling reaction networks, which we refer to as the Feinberg, Schmitz, and MacLean models, based on the previous study by MacLean et al. (PNAS USA 2015). Our analysis is based on the (unique) finest independent decomposition (FID) of each reaction network and our comparative techniques include equilibria parametrizations (EP) and the newly developed methods of Common Reactions Equilibria (CORE) analysis and Concordance Profile (CP) analysis. Our investigation yields three interesting results concerning the equilibria sets of these models. Firstly, we explore the concept of absolute concentration robustness (ACR), wherein a system exhibits ACR in a specific species if the equilibrium value for that species is the same for any positive equilibrium. Through ACR analysis employing FID and EP, we observe that both the Schmitz and MacLean models lack ACR, whereas the Feinberg model demonstrates ACR in a single species. Second, our analyses using FID and CORE reveal important relationships within the equilibria sets of the augmented Schmitz and MacLean models. Furthermore, FID and CORE identify the lack of a substantial relationship between the equilibria sets of the Feinberg and MacLean models. Hence, these methods detect subtle differences between the Feinberg and MacLean models and also between the Schmitz and MacLean models, which are not evident in the standard reaction network analysis. Finally, based on the concordance levels, CP analysis indicates that the MacLean and Schmitz models are more similar than the MacLean and Feinberg models.


title: Self Attention with Temporal Prior: Can We Learn More from Arrow of Time?

abstract: Many diverse phenomena in nature often inherently encode both short- and long-term temporal dependencies, which especially result from the direction of the flow of time. In this respect, we discovered experimental evidence suggesting that interrelations of these events are higher for closer time stamps. However, to be able for attention-based models to learn these regularities in short-term dependencies, it requires large amounts of data, which are often infeasible. This is because, while they are good at learning piece-wise temporal dependencies, attention-based models lack structures that encode biases in time series. As a resolution, we propose a simple and efficient method that enables attention layers to better encode the short-term temporal bias of these data sets by applying learnable, adaptive kernels directly to the attention matrices. We chose various prediction tasks for the experiments using Electronic Health Records (EHR) data sets since they are great examples with underlying long- and short-term temporal dependencies. Our experiments show exceptional classification results compared to best-performing models on most tasks and data sets.


title: Label Poisoning is All You Need

abstract: In a backdoor attack, an adversary injects corrupted data into a model's training dataset in order to gain control over its predictions on images with a specific attacker-defined trigger. A typical corrupted training example requires altering both the image, by applying the trigger, and the label. Models trained on clean images, therefore, were considered safe from backdoor attacks. However, in some common machine learning scenarios, the training labels are provided by potentially malicious third-parties. This includes crowd-sourced annotation and knowledge distillation. We, hence, investigate a fundamental question: can we launch a successful backdoor attack by only corrupting labels? We introduce a novel approach to design label-only backdoor attacks, which we call FLIP, and demonstrate its strengths on three datasets (CIFAR-10, CIFAR-100, and Tiny-ImageNet) and four architectures (ResNet-32, ResNet-18, VGG-19, and Vision Transformer). With only 2% of CIFAR-10 labels corrupted, FLIP achieves a near-perfect attack success rate of 99.4% while suffering only a 1.8% drop in the clean test accuracy. Our approach builds upon the recent advances in trajectory matching, originally introduced for dataset distillation.


title: On the spectral variety for rank two Higgs bundles

abstract: In this article, we study the Hitchin morphism over a smooth projective variety $X$. The Hitchin morphism is a map from the moduli space of Higgs bundles to the Hitchin base, which in general not surjective when the dimension of X is greater than one. Chen-Ng\^{o} introduced the spectral base, which is a closed subvariety of the Hitchin base. They conjectured that the Hitchin morphism is surjective to the spectral base and also proved that the surjectivity is equivalent to the existence of finite Cohen-Macaulayfications of the spectral varieties. For rank two Higgs bundles over a projective manifold $X$, we explicitly construct a finite Cohen-Macaulayfication of the spectral variety as a double branched covering of $X$, thereby confirming Chen-Ng\^{o}'s conjecture in this case. Moreover, using this Cohen-Macaulayfication, we can construct the Hitchin section for rank two Higgs bundles, which allows us to study the rigidity problem of the character variety and also to explore a generalization of the Milnor-Wood type inequality.


title: Implicit Bias of Gradient Descent for Two-layer ReLU and Leaky ReLU Networks on Nearly-orthogonal Data

abstract: The implicit bias towards solutions with favorable properties is believed to be a key reason why neural networks trained by gradient-based optimization can generalize well. While the implicit bias of gradient flow has been widely studied for homogeneous neural networks (including ReLU and leaky ReLU networks), the implicit bias of gradient descent is currently only understood for smooth neural networks. Therefore, implicit bias in non-smooth neural networks trained by gradient descent remains an open question. In this paper, we aim to answer this question by studying the implicit bias of gradient descent for training two-layer fully connected (leaky) ReLU neural networks. We showed that when the training data are nearly-orthogonal, for leaky ReLU activation function, gradient descent will find a network with a stable rank that converges to $1$, whereas for ReLU activation function, gradient descent will find a neural network with a stable rank that is upper bounded by a constant. Additionally, we show that gradient descent will find a neural network such that all the training data points have the same normalized margin asymptotically. Experiments on both synthetic and real data backup our theoretical findings.


title: Adversarial Examples Are Not Real Features

abstract: The existence of adversarial examples has been a mystery for years and attracted much interest. A well-known theory by \citet{ilyas2019adversarial} explains adversarial vulnerability from a data perspective by showing that one can extract non-robust features from adversarial examples and these features alone are useful for classification. However, the explanation remains quite counter-intuitive since non-robust features are mostly noise features to humans. In this paper, we re-examine the theory from a larger context by incorporating multiple learning paradigms. Notably, we find that contrary to their good usefulness under supervised learning, non-robust features attain poor usefulness when transferred to other self-supervised learning paradigms, such as contrastive learning, masked image modeling, and diffusion models. It reveals that non-robust features are not really as useful as robust or natural features that enjoy good transferability between these paradigms. Meanwhile, for robustness, we also show that naturally trained encoders from robust features are largely non-robust under AutoAttack. Our cross-paradigm examination suggests that the non-robust features are not really useful but more like paradigm-wise shortcuts, and robust features alone might be insufficient to attain reliable model robustness. Code is available at \url{https://github.com/PKU-ML/AdvNotRealFeatures}.


title: The Utility of "Even if..." Semifactual Explanation to Optimise Positive Outcomes

abstract: When users receive either a positive or negative outcome from an automated system, Explainable AI (XAI) has almost exclusively focused on how to mutate negative outcomes into positive ones by crossing a decision boundary using counterfactuals (e.g., \textit{"If you earn 2k more, we will accept your loan application"}). Here, we instead focus on \textit{positive} outcomes, and take the novel step of using XAI to optimise them (e.g., \textit{"Even if you wish to half your down-payment, we will still accept your loan application"}). Explanations such as these that employ "even if..." reasoning, and do not cross a decision boundary, are known as semifactuals. To instantiate semifactuals in this context, we introduce the concept of \textit{Gain} (i.e., how much a user stands to benefit from the explanation), and consider the first causal formalisation of semifactuals. Tests on benchmark datasets show our algorithms are better at maximising gain compared to prior work, and that causality is important in the process. Most importantly however, a user study supports our main hypothesis by showing people find semifactual explanations more useful than counterfactuals when they receive the positive outcome of a loan acceptance.


title: Machine Learning Algorithms to Predict Chess960 Result and Develop Opening Themes

abstract: This work focuses on the analysis of Chess 960, also known as Fischer Random Chess, a variant of traditional chess where the starting positions of the pieces are randomized. The study aims to predict the game outcome using machine learning techniques and develop an opening theme for each starting position. The first part of the analysis utilizes machine learning models to predict the game result based on certain moves in each position. The methodology involves segregating raw data from .pgn files into usable formats and creating datasets comprising approximately 500 games for each starting position. Three machine learning algorithms -- KNN Clustering, Random Forest, and Gradient Boosted Trees -- have been used to predict the game outcome. To establish an opening theme, the board is divided into five regions: center, white kingside, white queenside, black kingside, and black queenside. The data from games played by top engines in all 960 positions is used to track the movement of pieces in the opening. By analysing the change in the number of pieces in each region at specific moves, the report predicts the region towards which the game is developing. These models provide valuable insights into predicting game outcomes and understanding the opening theme in Chess 960.


title: More on $r$-cross $t$-intersecting families for vector spaces

abstract: Let $V$ be a finite dimensional vector space over a finite field. Suppose that $\mathscr{F}_1$, $\mathscr{F}_2$, $\dots$, $\mathscr{F}_r$ are $r$-cross $t$-intersecting families of $k$-subspaces of $V$. In this paper, we determine the extremal structure when $\prod_{i=1}^r|\mathscr{F}_i|$ is maximum under the condition that $\dim(\bigcap_{F\in\mathscr{F}_i}F)<t$ for each $i$.


title: Language Agents with Reinforcement Learning for Strategic Play in the Werewolf Game

abstract: Agents built with large language models (LLMs) have shown great potential across a wide range of domains. However, in complex decision-making tasks, pure LLM-based agents tend to exhibit intrinsic bias in their choice of actions, which is inherited from the model's training data and results in suboptimal performance. To develop strategic language agents, i.e., agents that generate flexible language actions and possess strong decision-making abilities, we propose a novel framework that powers LLM-based agents with reinforcement learning (RL). We consider Werewolf, a popular social deduction game, as a challenging testbed that emphasizes versatile communication and strategic gameplay. To mitigate the intrinsic bias in language actions, our agents use an LLM to perform deductive reasoning and generate a diverse set of action candidates. Then an RL policy trained to optimize the decision-making ability chooses an action from the candidates to play in the game. Extensive experiments show that our agents overcome the intrinsic bias and outperform existing LLM-based agents in the Werewolf game. We also conduct human-agent experiments and find that our agents achieve human-level performance and demonstrate strong strategic play.


title: The intrinsic geometry determined by the Cauchy problems of the Camassa-Holm equation

abstract: Pseudospherical surfaces determined by Cauchy problems involving the Camassa-Holm equation are considered herein. We study how global solutions influence the corresponding surface, as well as we investigate two sorts of singularities of the metric: the first one is just when the co-frame of dual form is not linearly independent. The second sort of singularity is that arising from solutions blowing up. In particular, it is shown that the metric blows up if and only if the solution breaks in finite time.


title: The rotation effect on the thermodynamics of the QCD matter

abstract: In this study, we investigate the impact of rotation on the thermodynamic characteristics of QCD matter using the three-flavor NJL model. We examine the temperature, quark chemical potential, and angular velocity dependencies of key thermodynamic quantities, such as the trace anomaly, specific heat, speed of sound, angular momentum, and moment of inertia. As the main finding of our analysis, we observe that the speed of sound exhibits a nonmonotonic behavior as the angular velocity changes.


title: Dyanmics of falling raindrops

abstract: Studying water droplets is a rich lesson in fields of fluid dynamics, nonlinear systems, and differential equations. Understanding various physical aspects of raindrops can help us in understanding drop dynamics, rainfall density estimation, size distributions which can be grant insights in the fields of meteorology, hydrology, and climate science. This work identifies the real world significance in developing more accurate atmospheric attenuation correction algorithms that could potentially overcome the scattering effect of rain on radio and micro wave communication. This works presents and aims to compile some historical work which focuses on the influence of surface tension in the droplet nucleation and formation, raindrop oscillation, burst cycles, and transformation into parachute-like shapes before fragmentation. The interplay between surface tension and air resistance in raindrop dynamics is also explored.


title: S2F-NER: Exploring Sequence-to-Forest Generation for Complex Entity Recognition

abstract: Named Entity Recognition (NER) remains challenging due to the complex entities, like nested, overlapping, and discontinuous entities. Existing approaches, such as sequence-to-sequence (Seq2Seq) generation and span-based classification, have shown impressive performance on various NER subtasks, but they are difficult to scale to datasets with longer input text because of either exposure bias issue or inefficient computation. In this paper, we propose a novel Sequence-to-Forest generation paradigm, S2F-NER, which can directly extract entities in sentence via a Forest decoder that decode multiple entities in parallel rather than sequentially. Specifically, our model generate each path of each tree in forest autoregressively, where the maximum depth of each tree is three (which is the shortest feasible length for complex NER and is far smaller than the decoding length of Seq2Seq). Based on this novel paradigm, our model can elegantly mitigates the exposure bias problem and keep the simplicity of Seq2Seq. Experimental results show that our model significantly outperforms the baselines on three discontinuous NER datasets and on two nested NER datasets, especially for discontinuous entity recognition.


title: The Frobenius semiradical, generic stabilisers, and Poisson centre for nilradicals

abstract: Let $\mathfrak g$ be a complex simple Lie algebra and $\mathfrak n$ the nilradical of a parabolic subalgebra of $\mathfrak g$. We consider some properties of the coadjoint representation of $\mathfrak n$ and related algebras of invariants. This includes (i) the problem of existence of generic stabilisers, (ii) a description of the Frobenius semiradical of $\mathfrak n$ and the Poisson centre $Z(\mathfrak n)$ of the symmetric algebra $S(\mathfrak n)$, (iii) the structure of $S(\mathfrak n)$ as $Z(\mathfrak n)$-module, and (iv) the description of square integrable (= quasi-reductive) nilradicals. Our main technical tools are the Kostant cascade in the set of positive roots of $\mathfrak g$ and the notion of optimisation of $\mathfrak n$.


title: Video Frame Interpolation with Many-to-many Splatting and Spatial Selective Refinement

abstract: In this work, we first propose a fully differentiable Many-to-Many (M2M) splatting framework to interpolate frames efficiently. Given a frame pair, we estimate multiple bidirectional flows to directly forward warp the pixels to the desired time step before fusing overlapping pixels. In doing so, each source pixel renders multiple target pixels and each target pixel can be synthesized from a larger area of visual context, establishing a many-to-many splatting scheme with robustness to undesirable artifacts. For each input frame pair, M2M has a minuscule computational overhead when interpolating an arbitrary number of in-between frames, hence achieving fast multi-frame interpolation. However, directly warping and fusing pixels in the intensity domain is sensitive to the quality of motion estimation and may suffer from less effective representation capacity. To improve interpolation accuracy, we further extend an M2M++ framework by introducing a flexible Spatial Selective Refinement (SSR) component, which allows for trading computational efficiency for interpolation quality and vice versa. Instead of refining the entire interpolated frame, SSR only processes difficult regions selected under the guidance of an estimated error map, thereby avoiding redundant computation. Evaluation on multiple benchmark datasets shows that our method is able to improve the efficiency while maintaining competitive video interpolation quality, and it can be adjusted to use more or less compute as needed.


title: Double-loop hysteresis of multisite dilute Sr(Y$_{1-x}$Dy$_x$)$_2$O$_4$ single crystal Kramers paramagnets: electron-phonon interaction, quantum tunneling and cross-relaxation

abstract: Experimental and theoretical studies of the dynamic magnetization in swept magnetic fields of the orthorhombic SrY$_2$O$_4$ single-crystals doped with the Dy$^{3+}$ Kramers ions (0.01 and 0.5 at.%) with natural abundances of even and odd Dy isotopes are presented. Impurity ions substitute for Y$^{3+}$ ions at two nonequivalent crystallographic sites with the same local $C_s$ symmetry but strongly different crystal fields. Well pronounced double-loop hysteresis is observed at temperatures 2, 4, 5 and 6 K for sweeping rates of 5 and 1 mT/s. The microscopic model of spectral, magnetic and kinetic properties of Dy$^{3+}$ ions is developed based on the results of EPR, site selective optical spectra and magnetic relaxation measurements. The derived approach to the dynamic magnetization in the sweeping field based on the numerical solution of generalized master equations with time-dependent transition probabilities induced by the electron-phonon interaction, quantum tunneling and cross-relaxation allowed us to reproduce successfully the evolution of the hysteresis loop shape with temperature, sweeping rate and concentration of paramagnetic ions.


title: Probabilistic Feature Augmentation for AIS-Based Multi-Path Long-Term Vessel Trajectory Forecasting

abstract: Maritime transportation is paramount in achieving global economic growth, entailing concurrent ecological obligations in sustainability and safeguarding endangered marine species, most notably preserving large whale populations. In this regard, the Automatic Identification System (AIS) data plays a significant role by offering real-time streaming data on vessel movement, allowing enhanced traffic monitoring. This study explores using AIS data to prevent vessel-to-whale collisions by forecasting long-term vessel trajectories from engineered AIS data sequences. For such a task, we have developed an encoder-decoder model architecture using Bidirectional Long Short-Term Memory Networks (Bi-LSTM) to predict the next 12 hours of vessel trajectories using 1 to 3 hours of AIS data as input. We feed the model with probabilistic features engineered from historical AIS data that refer to each trajectory's potential route and destination. The model then predicts the vessel's trajectory, considering these additional features by leveraging convolutional layers for spatial feature learning and a position-aware attention mechanism that increases the importance of recent timesteps of a sequence during temporal feature learning. The probabilistic features have an F1 Score of approximately 85% and 75% for each feature type, respectively, demonstrating their effectiveness in augmenting information to the neural network. We test our model on the Gulf of St. Lawrence, a region known to be the habitat of North Atlantic Right Whales (NARW). Our model achieved a high R2 score of over 98% using various techniques and features. It stands out among other approaches as it can make complex decisions during turnings and path selection. Our study highlights the potential of data engineering and trajectory forecasting models for marine life species preservation.


title: Customize StyleGAN with One Hand Sketch

abstract: Generating images from human sketches typically requires dedicated networks trained from scratch. In contrast, the emergence of the pre-trained Vision-Language models (e.g., CLIP) has propelled generative applications based on controlling the output imagery of existing StyleGAN models with text inputs or reference images. Parallelly, our work proposes a framework to control StyleGAN imagery with a single user sketch. In particular, we learn a conditional distribution in the latent space of a pre-trained StyleGAN model via energy-based learning and propose two novel energy functions leveraging CLIP for cross-domain semantic supervision. Once trained, our model can generate multi-modal images semantically aligned with the input sketch. Quantitative evaluations on synthesized datasets have shown that our approach improves significantly from previous methods in the one-shot regime. The superiority of our method is further underscored when experimenting with a wide range of human sketches of diverse styles and poses. Surprisingly, our models outperform the previous baseline regarding both the range of sketch inputs and image qualities despite operating with a stricter setting: with no extra training data and single sketch input.


title: A guide to Penrose tilings

abstract: The aim of this book is to provide an elementary introduction, complete with detailed proofs, to the celebrated tilings of the plane discovered by Sir Roger Penrose in the `70s. The book covers many aspects of Penrose tilings, including the study of the space parameterizing Penrose tilings from the point of view of Connes' Noncommutative Geometry.


title: A Multimodal Ecological Civilization Pattern Recommendation Method Based on Large Language Models and Knowledge Graph

abstract: The Ecological Civilization Pattern Recommendation System (ECPRS) aims to recommend suitable ecological civilization patterns for target regions, promoting sustainable development and reducing regional disparities. However, the current representative recommendation methods are not suitable for recommending ecological civilization patterns in a geographical context. There are two reasons for this. Firstly, regions have spatial heterogeneity, and the (ECPRS)needs to consider factors like climate, topography, vegetation, etc., to recommend civilization patterns adapted to specific ecological environments, ensuring the feasibility and practicality of the recommendations. Secondly, the abstract features of the ecological civilization patterns in the real world have not been fully utilized., resulting in poor richness in their embedding representations and consequently, lower performance of the recommendation system. Considering these limitations, we propose the ECPR-MML method. Initially, based on the novel method UGPIG, we construct a knowledge graph to extract regional representations incorporating spatial heterogeneity features. Following that, inspired by the significant progress made by Large Language Models (LLMs) in the field of Natural Language Processing (NLP), we employ Large LLMs to generate multimodal features for ecological civilization patterns in the form of text and images. We extract and integrate these multimodal features to obtain semantically rich representations of ecological civilization. Through extensive experiments, we validate the performance of our ECPR-MML model. Our results show that F1@5 is 2.11% higher compared to state-of-the-art models, 2.02% higher than NGCF, and 1.16% higher than UGPIG. Furthermore, multimodal data can indeed enhance recommendation performance. However, the data generated by LLM is not as effective as real data to a certain extent.


title: Exploring the phase diagrams of multidimensional Kuramoto models

abstract: The multidimensional Kuramoto model describes the synchronization dynamics of particles moving on the surface of D-dimensional spheres, generalizing the original model where particles were characterized by a single phase. In this setup, particles are more easily represented by $D$-dimensional unit vectors than by $D-1$ spherical angles, allowing for the coupling constant to be extended to a coupling matrix acting on the vectors. As in the original Kuramoto model, each particle has a set of $D(D-1)/2$ natural frequencies, drawn from a distribution. The system has a large number of independent parameters, given by the average natural frequencies, the characteristic widths of their distributions plus $D^2$ constants of the coupling matrix. General phase diagrams, indicating regions in parameter space where the system exhibits different behaviors, are hard to derive analytically. Here we obtain the complete phase diagram for $D=2$ and Lorentzian distributions of natural frequencies using the Ott-Antonsen ansatz. We also explore the diagrams numerically for different distributions and some specific choices of parameters for $D=2$, $D=3$ and $D=4$. In all cases the system exhibits at most four different phases: disordered, static synchrony, rotation and active synchrony. Existence of specific phases and boundaries between them depend strongly on the dimension $D$, the coupling matrix and the distribution of natural frequencies.


title: TIC-TAC: A Framework for Improved Covariance Estimation in Deep Heteroscedastic Regression

abstract: Deep heteroscedastic regression involves jointly optimizing the mean and covariance of the predicted distribution using the negative log-likelihood. However, recent works show that this may result in sub-optimal convergence due to the challenges associated with covariance estimation. While the literature addresses this by proposing alternate formulations to mitigate the impact of the predicted covariance, we focus on improving the predicted covariance itself. We study two questions: (1) Does the predicted covariance truly capture the randomness of the predicted mean? (2) In the absence of supervision, how can we quantify the accuracy of covariance estimation? We address (1) with a Taylor Induced Covariance (TIC), which captures the randomness of the predicted mean by incorporating its gradient and curvature through the second order Taylor polynomial. Furthermore, we tackle (2) by introducing a Task Agnostic Correlations (TAC) metric, which combines the notion of correlations and absolute error to evaluate the covariance. We evaluate TIC-TAC across multiple experiments spanning synthetic and real-world datasets. Our results show that not only does TIC accurately learn the covariance, it additionally facilitates an improved convergence of the negative log-likelihood. Our code is available at https://github.com/vita-epfl/TIC-TAC


title: Mask Propagation for Efficient Video Semantic Segmentation

abstract: Video Semantic Segmentation (VSS) involves assigning a semantic label to each pixel in a video sequence. Prior work in this field has demonstrated promising results by extending image semantic segmentation models to exploit temporal relationships across video frames; however, these approaches often incur significant computational costs. In this paper, we propose an efficient mask propagation framework for VSS, called MPVSS. Our approach first employs a strong query-based image segmentor on sparse key frames to generate accurate binary masks and class predictions. We then design a flow estimation module utilizing the learned queries to generate a set of segment-aware flow maps, each associated with a mask prediction from the key frame. Finally, the mask-flow pairs are warped to serve as the mask predictions for the non-key frames. By reusing predictions from key frames, we circumvent the need to process a large volume of video frames individually with resource-intensive segmentors, alleviating temporal redundancy and significantly reducing computational costs. Extensive experiments on VSPW and Cityscapes demonstrate that our mask propagation framework achieves SOTA accuracy and efficiency trade-offs. For instance, our best model with Swin-L backbone outperforms the SOTA MRCFA using MiT-B5 by 4.0% mIoU, requiring only 26% FLOPs on the VSPW dataset. Moreover, our framework reduces up to 4x FLOPs compared to the per-frame Mask2Former baseline with only up to 2% mIoU degradation on the Cityscapes validation set. Code is available at https://github.com/ziplab/MPVSS.


title: Optimal Algorithms for Online Convex Optimization with Adversarial Constraints

abstract: A well-studied generalization of the standard online convex optimization (OCO) is constrained online convex optimization (COCO). In COCO, on every round, a convex cost function and a convex constraint function are revealed to the learner after the action for that round is chosen. The objective is to design an online policy that simultaneously achieves a small regret while ensuring a small cumulative constraint violation (CCV) against an adaptive adversary interacting over a horizon of length $T$. A long-standing open question in COCO is whether an online policy can simultaneously achieve $O(\sqrt{T})$ regret and $O(\sqrt{T})$ CCV without any restrictive assumptions. For the first time, we answer this in the affirmative and show that an online policy can simultaneously achieve $O(\sqrt{T})$ regret and $\tilde{O}(\sqrt{T})$ CCV. Furthermore, in the case of strongly convex cost and convex constraint functions, the regret guarantee can be improved to $O(\log T)$ while keeping the CCV bound the same as above. We establish these results by effectively combining the adaptive regret bound of the AdaGrad algorithm with Lyapunov optimization - a classic tool from control theory. Surprisingly, the analysis is short and elegant.


title: End-to-End Autoregressive Retrieval via Bootstrapping for Smart Reply Systems

abstract: Reply suggestion systems represent a staple component of many instant messaging and email systems. However, the requirement to produce sets of replies, rather than individual replies, makes the task poorly suited for out-of-the-box retrieval architectures, which only consider individual message-reply similarity. As a result, these system often rely on additional post-processing modules to diversify the outputs. However, these approaches are ultimately bottlenecked by the performance of the initial retriever, which in practice struggles to present a sufficiently diverse range of options to the downstream diversification module, leading to the suggestions being less relevant to the user. In this paper, we consider a novel approach that radically simplifies this pipeline through an autoregressive text-to-text retrieval model, that learns the smart reply task end-to-end from a dataset of (message, reply set) pairs obtained via bootstrapping. Empirical results show this method consistently outperforms a range of state-of-the-art baselines across three datasets, corresponding to a 5.1%-17.9% improvement in relevance, and a 0.5%-63.1% improvement in diversity compared to the best baseline approach. We make our code publicly available.


title: Weighted frames, weighted lower semi frames and unconditionally convergent multipliers

abstract: In this paper we ask when it is possible to transform a given sequence into a frame or a lower semi frame by multiplying the elements by numbers. In other words, we ask when a given sequence is a weighted frame or a weighted lower semi frame and for each case we formulate a conjecture. We determine several conditions under which these conjectures are true. Finally, we prove an equivalence between two older conjectures, the first one being that any unconditionally convergent multiplier can be written as a multiplier of Bessel sequences by shifting of weights, and the second one that every unconditionally convergent multiplier which is invertible can be written as a multiplier of frames by shifting of weights. We also show that these conjectures are also related to one of the newly posed conjectures.


title: On units with Galois complex conjugates of equal absolute value

abstract: We prove, using a theorem of Northcott, that if a number field K with s real embeddings and 2t complex ones has a group of units U such that all elements in U have all its complex conjugates of same absolute value, then one necessarly has t = 1. This fact has an interesting implication in complex hermitian geometry, namely it describes all Oeljeklaus-Toma manifolds carrying locally conformally Kahler structures.


title: Wavelet-based Ramsey magnetometry enhancement of a single NV center in diamond

abstract: Nitrogen-vacancy (NV) centers in diamond constitute a solid-state nanosensing paradigm. Specifically for high-precision magnetometry, the so-called Ramsey interferometry is the prevalent choice where the sensing signal is extracted from time-resolved spin-state-dependent photoluminescence (PL) data. Its sensitivity is ultimately limited by the photon shot noise, which cannot be sufficiently removed by averaging or frequency filtering. Here, we propose Ramsey DC magnetometry of a single NV center enhanced by a wavelet-denoising scheme specifically tailored to suppress photon shot noise. It simply operates as a classical post-processing applied on a collected PL time series. Our implementation is based on a method that we named template margin thresholding which enables not only frequency but also time-dependent denoising. We computationally benchmark its DC magnetic field sensing signal-to-noise-ratio improvement over the raw PL data around an order of magnitude.


title: Same average in every direction

abstract: Given a polytope $P\subset R^3$ and a non-zero vector $z \in R^3$, the plane $\{x\in R^3:zx=t\}$ intersects $P$ in convex polygon $P(z,t)$ for $t \in [t^-,t^+]$ where $t^-=\min \{zx: x \in P\}$ and $t^+=\max \{zx: x\in P\}$, $zx$ is the scalar product of $z,x \in R^3$. Let $A(P,z)$ denote the average number of vertices of $P(z,t)$ on the interval $[t^-,t^+]$. For what polytopes is $A(P,z)$ a constant independent of $z$?


title: AnomalyCLIP: Object-agnostic Prompt Learning for Zero-shot Anomaly Detection

abstract: Zero-shot anomaly detection (ZSAD) requires detection models trained using auxiliary data to detect anomalies without any training sample in a target dataset. It is a crucial task when training data is not accessible due to various concerns, eg, data privacy, yet it is challenging since the models need to generalize to anomalies across different domains where the appearance of foreground objects, abnormal regions, and background features, such as defects/tumors on different products/organs, can vary significantly. Recently large pre-trained vision-language models (VLMs), such as CLIP, have demonstrated strong zero-shot recognition ability in various vision tasks, including anomaly detection. However, their ZSAD performance is weak since the VLMs focus more on modeling the class semantics of the foreground objects rather than the abnormality/normality in the images. In this paper we introduce a novel approach, namely AnomalyCLIP, to adapt CLIP for accurate ZSAD across different domains. The key insight of AnomalyCLIP is to learn object-agnostic text prompts that capture generic normality and abnormality in an image regardless of its foreground objects. This allows our model to focus on the abnormal image regions rather than the object semantics, enabling generalized normality and abnormality recognition on diverse types of objects. Large-scale experiments on 17 real-world anomaly detection datasets show that AnomalyCLIP achieves superior zero-shot performance of detecting and segmenting anomalies in datasets of highly diverse class semantics from various defect inspection and medical imaging domains. Code will be made available at https://github.com/zqhang/AnomalyCLIP.


title: About the ability of agnostic X-ray tests of the Kerr Hypothesis to discover new physics

abstract: In the past decade, we have seen an unprecedented progress in our ability of testing general relativity in the strong field regime with black hole observations. Most studies have focused on the so-called tests of the Kerr hypothesis: they have tried to verify whether the spacetime geometry around black holes is described by the Kerr solution as expected in general relativity. One can follow either a theory-specific analysis or an agnostic approach. Each strategy has its advantages and disadvantages. In this work, we study the ability of agnostic X-ray tests of the Kerr hypothesis to discover new physics. We simulate X-ray observations of bright Galactic black holes of specific theories of gravity and we analyze the simulated data with a reflection model employing the correct theory of gravity and another reflection model for agnostic tests of the Kerr hypothesis. Our results suggest that agnostic X-ray tests are valid tools to discover new physics, but their constraining power may be lower than a theory-specific analysis.


title: Expectile-based conditional tail moments with covariates

abstract: Expectile, as the minimizer of an asymmetric quadratic loss function, is a coherent risk measure and is helpful to use more information about the distribution of the considered risk. In this paper, we propose a new risk measure by replacing quantiles by expectiles, called expectile-based conditional tail moment, and focus on the estimation of this new risk measure as the conditional survival function of the risk, given the risk exceeding the expectile and given a value of the covariates, is heavy tail. Under some regular conditions, asymptotic properties of this new estimator are considered. The extrapolated estimation of the conditional tail moments is also investigated. These results are illustrated both on simulated data and on a real insurance data.


title: LLMs and Finetuning: Benchmarking cross-domain performance for hate speech detection

abstract: In the evolving landscape of online communication, hate speech detection remains a formidable challenge, further compounded by the diversity of digital platforms. This study investigates the effectiveness and adaptability of pre-trained and fine-tuned Large Language Models (LLMs) in identifying hate speech, to address two central questions: (1) To what extent does the model performance depend on the fine-tuning and training parameters?, (2) To what extent do models generalize to cross-domain hate speech detection? and (3) What are the specific features of the datasets or models that influence the generalization potential? The experiment shows that LLMs offer a huge advantage over the state-of-the-art even without pretraining. To answer (1) we analyze 36 in-domain classifiers comprising LLaMA, Vicuna, and their variations in pre-trained and fine-tuned states across nine publicly available datasets that span a wide range of platforms and discussion forums. To answer (2), we assessed the performance of 288 out-of-domain classifiers for a given end-domain dataset. In answer to (3), ordinary least squares analyses suggest that the advantage of training with fine-grained hate speech labels is greater for smaller training datasets but washed away with the increase in dataset size. We conclude with a vision for the future of hate speech detection, emphasizing cross-domain generalizability and appropriate benchmarking practices.


title: Power of Counting by Nonuniform Families of Polynomial-Size Finite Automata

abstract: Lately, there have been intensive studies on strengths and limitations of nonuniform families of promise decision problems solvable by various types of polynomial-size finite automata families, where "polynomial-size" refers to the polynomially-bounded state complexity of a finite automata family. In this line of study, we further expand the scope of these studies to families of partial counting and gap functions, defined in terms of nonuniform families of polynomial-size nondeterministic finite automata, and their relevant families of promise decision problems. Counting functions have an ability of counting the number of accepting computation paths produced by nondeterministic finite automata. With no unproven hardness assumption, we show numerous separations and collapses of complexity classes of those partial counting and gap function families and their induced promise decision problem families. We also investigate their relationships to pushdown automata families of polynomial stack-state complexity.


title: Spacecraft Autonomous Decision-Planning for Collision Avoidance: a Reinforcement Learning Approach

abstract: The space environment around the Earth is becoming increasingly populated by both active spacecraft and space debris. To avoid potential collision events, significant improvements in Space Situational Awareness (SSA) activities and Collision Avoidance (CA) technologies are allowing the tracking and maneuvering of spacecraft with increasing accuracy and reliability. However, these procedures still largely involve a high level of human intervention to make the necessary decisions. For an increasingly complex space environment, this decision-making strategy is not likely to be sustainable. Therefore, it is important to successfully introduce higher levels of automation for key Space Traffic Management (STM) processes to ensure the level of reliability needed for navigating a large number of spacecraft. These processes range from collision risk detection to the identification of the appropriate action to take and the execution of avoidance maneuvers. This work proposes an implementation of autonomous CA decision-making capabilities on spacecraft based on Reinforcement Learning (RL) techniques. A novel methodology based on a Partially Observable Markov Decision Process (POMDP) framework is developed to train the Artificial Intelligence (AI) system on board the spacecraft, considering epistemic and aleatory uncertainties. The proposed framework considers imperfect monitoring information about the status of the debris in orbit and allows the AI system to effectively learn stochastic policies to perform accurate Collision Avoidance Maneuvers (CAMs). The objective is to successfully delegate the decision-making process for autonomously implementing a CAM to the spacecraft without human intervention. This approach would allow for a faster response in the decision-making process and for highly decentralized operations.


title: Pressure influence on excitonic luminescence of CsPbBr3 perovskite

abstract: This study investigates the effect of hydrostatic pressure on the luminescence properties of CsPbBr3 single crystals at 12 K. The luminescence at the edge of the band gap reveals a structure attributed to free excitons, phonon replica of the free excitons, and Rashba excitons. Changes in the relative intensity of the free and Rashba excitons were observed with increasing pressure, caused by changes in the probability of nonradiative deexcitation. At pressures around 3 GPa, luminescence completely fades away. The red shift of the energy position of the maximum luminescence of free and Rashba excitons in pressure ranges of 0-1.3 GPa is attributed to the length reduction of Pb-Br bonds in [PbBr6]4- octahedra, while the high-energy shift of the Rashba excitons at pressures above 1.3 GPa is due to [PbBr6]4- octahedra rotation and changes in the Pb-Br_Pb angle.