title: Spectropolarimeter's optical design for the Arago space mission project

abstract: Arago is a concept of space mission submitted to the European Space Agency's M7 science program. It will target a number of science cases in stellar physics including the characterisation of star-planet interactions. The concept is based on a 1-m class Ritchey-Chretien F/13 telescope mounted on an Ariel-type platform. The scientific payload includes a common polarimetric unit and 2 spectrographs connected via a dichroic splitter. The polarimetric unit consists of 6 MgF2 plates in pairs connected by optical contact and a Wollaston analyzer. Each of the spectral channels represents an echelle spectrograph. The first one will operate in the UV range 119-320 nm with the spectral resolving power of R>25 000. It consists of an off-axis parabolic collimator, an echelle grating in a quasi-Littrow mounting, a cross-disperser concave grating, and a CMOS camera. The cross-disperser grating works also as a camera mirror and represents a holographic grating recorded with aberrated wavefronts and on a spherical substrate. The spectral image is projected onto a d-doped CMOS detector. The second spectral channel operates in the visible range 350-888 nm with R>35 000 and uses an immersed grating. The image is focused with a 4-lens objective onto a CMOS detector. In addition, the optical design includes two stages of fine-guiding system. The first stage represents a projecting system tracking the image around the entrance pinhole and communicating with the platform actuators. The second one is fed by the 0-th diffraction order of the visible channel echelle. It is communicating with a tip-tilt mirror in front of the dichroic. The first stage should improve the platform pointing accuracy from 8" to 200 mas precision to guarantee that the star images passes through the instrument's entrance pinhole. The second stage should correct the pointing accuracy further as well as some thermo-elastic deformations.


title: Simple Digital Controls from Approximate Plant Models

abstract: Two ways of designing low-order discrete-time (i.e. digital) controls for low-order plant (i.e. process) models are considered in this tutorial. The first polynomial method finds the controller coefficients that place the poles of the closed-loop feedback system at specified positions for adroit controls, i.e. for a rapid and compressed transient response, when the plant model is known precisely. The poles and zeros of the resulting controller are unconstrainted, although an integrator may be included in the controller structure as a special case to drive steady-state errors towards zero. The second frequency method ensures that the feedback system has the desired phase-margin at a specified gain cross-over frequency (for the desired bandwidth) yielding robust stability with respect to plant model uncertainty. The poles of the controller are at specified positions, e.g. for a standard Proportional-Integral (PI), Proportional-Derivative (PD), Proportional-Integral-Derivative (PID), structure or other more general configurations if necessary, and the problem is solved for the controller zeros. The poles and zeros of the resulting closed-loop feedback system are unconstrained. These complementary design procedures allow simple and effective controls to be derived analytically from a plant model, using a matrix inverse operation to solve a small set of linear simultaneous equations, as an alternative to more heuristic (e.g. trial-and-error) or empirical PID-tuning approaches. An azimuth controller for a pan-tilt-zoom camera mount is used as an illustrative example. The ways in which both procedures may be used to design controls with the desired balance between adroitness and robustness are discussed.


title: Fields: Towards Socially Intelligent Spatial Computing

abstract: In our everyday life, we intuitively use space to regulate our social interactions. When we want to talk to someone, we approach them; if someone joins the conversation, we adjust our bodies to make space for them. In contrast, devices are not as considerate: they interrupt us, require us to input commands, and compete for our attention. In this paper, we introduce Fields, a design framework for ubiquitous computing that informs the design of connected products with social grace. Inspired by interactionist theories on social interaction, Fields builds on the idea that the physical space we share with computers can be an interface to mediate interactions. It defines a generalized approach to spatial interactions, and a set of interaction patterns that can be adapted to different ubiquitous computing systems. We investigated its value by implementing it in a set of prototypes and evaluating it in a lab setting.


title: Nonlinear waves at the free surface of flexible mechanical metamaterials

abstract: In this letter we investigate the propagation of nonlinear pulses along the free surface of flexible metamaterials based on the rotating squares mechanism. While these metamaterials have previously been shown to support the propagation of elastic vector solitons through their bulk, here we demonstrate that they can also support the stable propagation of nonlinear pulses along their free surface. Further, we show that the stability of these surface pulses is higher when they minimally interact with the linear dispersive surface modes. Finally, we provide guidelines to select geometries that minimize such interactions.


title: CAPE: Corrective Actions from Precondition Errors using Large Language Models

abstract: Extracting commonsense knowledge from a large language model (LLM) offers a path to designing intelligent robots. Existing approaches that leverage LLMs for planning are unable to recover when an action fails and often resort to retrying failed actions, without resolving the error's underlying cause. We propose a novel approach (CAPE) that attempts to propose corrective actions to resolve precondition errors during planning. CAPE improves the quality of generated plans by leveraging few-shot reasoning from action preconditions. Our approach enables embodied agents to execute more tasks than baseline methods while ensuring semantic correctness and minimizing re-prompting. In VirtualHome, CAPE generates executable plans while improving a human-annotated plan correctness metric from 28.89% to 49.63% over SayCan. Our improvements transfer to a Boston Dynamics Spot robot initialized with a set of skills (specified in language) and associated preconditions, where CAPE improves the correctness metric of the executed task plans by 76.49% compared to SayCan. Our approach enables the robot to follow natural language commands and robustly recover from failures, which baseline approaches largely cannot resolve or address inefficiently.


title: Dominance of Bursty over Steady Heating of the 4--8 MK Coronal Plasma in a Solar Active Region: Quantification using Maps of Minimum, Maximum, and Average Brightness

abstract: A challenge in characterizing active region (AR) coronal heating is in separating transient (bursty) loop heating from the diffuse background (steady) heating. We present a method of quantifying coronal heating's bursty and steady components in ARs, applying it to FeXVIII (hot94) emission of an AR observed by SDO/AIA. The maximum, minimum, and average brightness values for each pixel, over a 24 hour period, yield a maximum-brightness map, a minimum-brightness map, and an average-brightness map of the AR. Running sets of such three maps come from repeating this process for each time step of running windows of 20, 16, 12, 8, 5, 3, 1 and 0.5 hours. From each running window's set of three maps, we obtain the AR's three corresponding luminosity light curves. We find: (1) The time-averaged ratio of minimum-brightness-map luminosity to average-brightness-map luminosity increases as the time window decreases, and the time-averaged ratio of maximum-brightness-map luminosity to average-brightness-map luminosity decreases as the window decreases. (2) For the 24-hour window, the minimum-brightness map's luminosity is 5% of the average-brightness map's luminosity, indicating that at most 5% of the AR's hot94 luminosity is from heating that is steady for 24 hours. (3) This upper limit on the fraction of the hot94 luminosity from steady heating increases to 33% for the 30-minute running window. This requires that the heating of the 4--8 MK plasma in this AR is mostly in bursts lasting less than 30 minutes: at most a third of the heating is steady for 30 minutes.


title: Explainability Via Causal Self-Talk

abstract: Explaining the behavior of AI systems is an important problem that, in practice, is generally avoided. While the XAI community has been developing an abundance of techniques, most incur a set of costs that the wider deep learning community has been unwilling to pay in most situations. We take a pragmatic view of the issue, and define a set of desiderata that capture both the ambitions of XAI and the practical constraints of deep learning. We describe an effective way to satisfy all the desiderata: train the AI system to build a causal model of itself. We develop an instance of this solution for Deep RL agents: Causal Self-Talk. CST operates by training the agent to communicate with itself across time. We implement this method in a simulated 3D environment, and show how it enables agents to generate faithful and semantically-meaningful explanations of their own behavior. Beyond explanations, we also demonstrate that these learned models provide new ways of building semantic control interfaces to AI systems.


title: Progressive Hologram Generation Based on Object Saliency

abstract: Computer-generated hologram (CGH) is promised to realize the next generation of 3D visual media with life-changing applications. However, one of the essential obstacles to this technology is the time-consuming hologram computation. Thus, facilitating the computation of the generated hologram is of significant importance in this area. We propose a progressive hologram generation based on object saliency using discrete wavelet transform. In our method, the object is decomposed into 3 levels of resolution using wavelet transform. Then, based on the saliency of the object, a progressive resolution hologram is generated. Our model generates a low resolution hologram for non-salient areas of an object and a high-resolution hologram for salient areas, thus reducing CGH generation time. We applied our method to a number of objects and show that salient parts are reconstructed with high quality while it helps the process to speed up. Finally, we compare the SSIM of the reconstructed objects.


title: Astrometric Calibration and Source Characterisation of the Latest Generation Neuromorphic Event-based Cameras for Space Imaging

abstract: As an emerging approach to space situational awareness and space imaging, the practical use of an event-based camera in space imaging for precise source analysis is still in its infancy. The nature of event-based space imaging and data collection needs to be further explored to develop more effective event-based space image systems and advance the capabilities of event-based tracking systems with improved target measurement models. Moreover, for event measurements to be meaningful, a framework must be investigated for event-based camera calibration to project events from pixel array coordinates in the image plane to coordinates in a target resident space object's reference frame. In this paper, the traditional techniques of conventional astronomy are reconsidered to properly utilise the event-based camera for space imaging and space situational awareness. This paper presents the techniques and systems used for calibrating an event-based camera for reliable and accurate measurement acquisition. These techniques are vital in building event-based space imaging systems capable of real-world space situational awareness tasks. By calibrating sources detected using the event-based camera, the spatio-temporal characteristics of detected sources or `event sources' can be related to the photometric characteristics of the underlying astrophysical objects. Finally, these characteristics are analysed to establish a foundation for principled processing and observing techniques which appropriately exploit the capabilities of the event-based camera.


title: Entry Dependent Expert Selection in Distributed Gaussian Processes Using Multilabel Classification

abstract: By distributing the training process, local approximation reduces the cost of the standard Gaussian Process. An ensemble technique combines local predictions from Gaussian experts trained on different partitions of the data. Ensemble methods aggregate models' predictions by assuming a perfect diversity of local predictors. Although it keeps the aggregation tractable, this assumption is often violated in practice. Even though ensemble methods provide consistent results by assuming dependencies between experts, they have a high computational cost, which is cubic in the number of experts involved. By implementing an expert selection strategy, the final aggregation step uses fewer experts and is more efficient. However, a selection approach that assigns a fixed set of experts to each new data point cannot encode the specific properties of each unique data point. This paper proposes a flexible expert selection approach based on the characteristics of entry data points. To this end, we investigate the selection task as a multi-label classification problem where the experts define labels, and each entry point is assigned to some experts. The proposed solution's prediction quality, efficiency, and asymptotic properties are discussed in detail. We demonstrate the efficacy of our method through extensive numerical experiments using synthetic and real-world data sets.


title: A ball quotient parametrizing trigonal genus 4 curves

abstract: We consider the moduli space of genus 4 curves endowed with a $g^1_3$ (which maps with degree 2 onto the moduli space of genus 4 curves). We prove that it defines a degree $\frac{1}{2}(3^{10}-1)$ cover of the 9-dimensional Deligne-Mostow ball quotient such that the natural divisors that live on that moduli space become totally geodesic (their normalizations are 8-dimensional ball quotients). This isomorphism differs from the one considered by S. Kond\=o and its construction is perhaps more elementary, as it does not involve K3 surfaces and their Torelli theorem: the Deligne-Mostow ball quotient parametrizes certain cyclic covers of degree 6 of a projective line and we show how a level structure on such a cover produces a degree 3 cover of that line with the same discriminant, yielding a genus 4 curve endowed with a $g^1_3$.


title: Professional Presentation and Projected Power: A Case Study of Implicit Gender Information in English CVs

abstract: Gender discrimination in hiring is a pertinent and persistent bias in society, and a common motivating example for exploring bias in NLP. However, the manifestation of gendered language in application materials has received limited attention. This paper investigates the framing of skills and background in CVs of self-identified men and women. We introduce a data set of 1.8K authentic, English-language, CVs from the US, covering 16 occupations, allowing us to partially control for the confound occupation-specific gender base rates. We find that (1) women use more verbs evoking impressions of low power; and (2) classifiers capture gender signal even after data balancing and removal of pronouns and named entities, and this holds for both transformer-based and linear classifiers.


title: Soliton generation in AlGaAs microresonators at room temperature

abstract: Chip-integrated optical frequency combs are attractive optical sources in comb applications requiring high-repetition-rate, low power consumption, or compact size. Spontaneous soliton formation via Kerr parametric oscillation is a promising generation principle in these frequency combs, and has been demonstrated in several material platforms over the past decade. Of these materials, AlGaAs has one of the largest Kerr nonlinearity coefficients allowing low pump threshold comb generation. However, bright soliton generation using this material has only been possible at cryogenic temperature because of the large thermo-optic effect at room temperature, which hinders stable access to the soliton regime. Here, we report self-stabilized single soliton generation in AlGaAs microresonators at room temperature by utilizing a rising soliton step in large free-spectral-range resonators. With sub-milliWatt optical pump power, 1 THz repetition-rate soliton generation is demonstrated. Perfect soliton crystal formation and soliton breather states are also observed. Besides the advantages of large optical nonlinearity, the devices are natural candidates for integration with III-V pump lasers.


title: MelHuBERT: A simplified HuBERT on Mel spectrograms

abstract: Self-supervised models have had great success in learning speech representations that can generalize to various downstream tasks. However, most self-supervised models require a large amount of compute and multiple GPUs to train, significantly hampering the development of self-supervised learning. In an attempt to reduce the computation of training, we revisit the training of HuBERT, a highly successful self-supervised model. We improve and simplify several key components, including the loss function, input representation, and training in multiple stages. Our model, MelHuBERT, is able to achieve favorable performance on phone recognition, speaker identification, and automatic speech recognition against HuBERT, while saving 31.2% of the pre-training time, or equivalently 33.5% MACs per one second speech. The code and pre-trained models are available in https://github.com/nervjack2/MelHuBERT.


title: VeriCompress: A Tool to Streamline the Synthesis of Verified Robust Compressed Neural Networks from Scratch

abstract: AI's widespread integration has led to neural networks (NNs) deployment on edge and similar limited-resource platforms for safety-critical scenarios. Yet, NN's fragility raises concerns about reliable inference. Moreover, constrained platforms demand compact networks. This study introduces VeriCompress, a tool that automates the search and training of compressed models with robustness guarantees. These models are well-suited for safety-critical applications and adhere to predefined architecture and size limitations, making them deployable on resource-restricted platforms. The method trains models 2-3 times faster than the state-of-the-art approaches, surpassing relevant baseline approaches by average accuracy and robustness gains of 15.1 and 9.8 percentage points, respectively. When deployed on a resource-restricted generic platform, these models require 5-8 times less memory and 2-4 times less inference time than models used in verified robustness literature. Our comprehensive evaluation across various model architectures and datasets, including MNIST, CIFAR, SVHN, and a relevant pedestrian detection dataset, showcases VeriCompress's capacity to identify compressed verified robust models with reduced computation overhead compared to current standards. This underscores its potential as a valuable tool for end users, such as developers of safety-critical applications on edge or Internet of Things platforms, empowering them to create suitable models for safety-critical, resource-constrained platforms in their respective domains.


title: Inertial Force Transmission in Dense Granular Flows

abstract: Dense granular flows are well described by several continuum models, however, their internal dynamics remain elusive. This study explores the contact force distributions in simulated steady and homogenous shear flows. Results demonstrate the existence of high magnitude contact forces in faster flows with stiffer grains. A proposed physical mechanism explains this rate-dependent force transmission. This analysis establishes a relation between contact forces and grain velocities, providing an entry point to unify a range of continuum models derived from either contact forces or grain velocity.


title: Erratum, counterexample and an additional revealing poll step for a result of "Analysis of direct searches for discontinuous functions''

abstract: This note provides a counterexample to a theorem announced in the last part of the paper ''Analysis of direct searches for discontinuous functions'', Mathematical Programming Vol. 133, pp.~299--325, 2012. The counterexample involves an objective function $f: \mathbb{R} \to \mathbb{R}$ which satisfies all the assumptions required by the theorem but contradicts some of its conclusions. A corollary of this theorem is also affected by this counterexample. The main flaw revealed by the counterexample is the possibility that a directional direct search method (dDSM) generates a sequence of trial points $(x_k)_k$ converging to a point $x_*$ where $f$ is discontinuous and whose objective function value $f(x_*)$ is strictly less than $\lim_{k\to\infty} f(x_k)$. Moreover the dDSM generates no trial point in one of the two branches of $f$ near $x_*$. This note also investigates the proof of the theorem to highlight the inexact statements in the original paper. Finally this work concludes with a modification of the dDSM that allows to recover the properties broken by the counterexample.


title: Sub-kpc radio jets in the brightest central galaxy of the cool-core galaxy cluster RXJ1720.1+2638

abstract: The cool-core galaxy cluster RXJ1720.1+2638 hosts extended radio emission near the cluster core, known as a minihalo. The origin of this emission is still debated and one piece of the puzzle has been the question of whether the supermassive black hole in the brightest central galaxy is actively powering jets. Here we present high-resolution e-MERLIN observations clearly indicating the presence of sub-kpc jets; this may have implications for the proposed origin of the minihalo emission, providing an ongoing source of relativistic electrons rather than a single burst sometime in the past, as previously assumed in simulations attempting to reproduce observational characteristics of minihalo-hosting systems.


title: Compressing Transformer-based self-supervised models for speech processing

abstract: Despite the success of Transformers in self- supervised learning with applications to various downstream tasks, the computational cost of training and inference remains a major challenge for applying these models to a wide spectrum of devices. Several isolated attempts have been made to compress Transformers, but the settings and metrics are different across studies. Trade-off at various compression rates are also largely missing in prior work, making it difficult to compare compression techniques. In this work, we aim to provide context for the isolated results, studying several commonly used compression techniques, including weight pruning, head pruning, low-rank approximation, and knowledge distillation. We report trade- off at various compression rate, including wall-clock time, the number of parameters, and the number of multiply-accumulate operations. Our results show that compared to recent approaches, basic compression techniques are strong baselines. We further present several applications of our results, revealing properties of Transformers, such as the significance of diagonal attention heads. In addition, our results lead to a simple combination of compression techniques that improves trade-off over recent approaches. We hope the results would promote more diverse comparisons among model compression techniques and promote the use of model compression as a tool for analyzing models. Our code of compressing speech self-supervised model is available at https://github.com/nervjack2/Speech-SSL-Compression/.


title: TempNet: Temporal Attention Towards the Detection of Animal Behaviour in Videos

abstract: Recent advancements in cabled ocean observatories have increased the quality and prevalence of underwater videos; this data enables the extraction of high-level biologically relevant information such as species' behaviours. Despite this increase in capability, most modern methods for the automatic interpretation of underwater videos focus only on the detection and counting organisms. We propose an efficient computer vision- and deep learning-based method for the detection of biological behaviours in videos. TempNet uses an encoder bridge and residual blocks to maintain model performance with a two-staged, spatial, then temporal, encoder. TempNet also presents temporal attention during spatial encoding as well as Wavelet Down-Sampling pre-processing to improve model accuracy. Although our system is designed for applications to diverse fish behaviours (i.e, is generic), we demonstrate its application to the detection of sablefish (Anoplopoma fimbria) startle events. We compare the proposed approach with a state-of-the-art end-to-end video detection method (ReMotENet) and a hybrid method previously offered exclusively for the detection of sablefish's startle events in videos from an existing dataset. Results show that our novel method comfortably outperforms the comparison baselines in multiple metrics, reaching a per-clip accuracy and precision of 80% and 0.81, respectively. This represents a relative improvement of 31% in accuracy and 27% in precision over the compared methods using this dataset. Our computational pipeline is also highly efficient, as it can process each 4-second video clip in only 38ms. Furthermore, since it does not employ features specific to sablefish startle events, our system can be easily extended to other behaviours in future works.


title: Coronated polyhedra and coronated ANRs

abstract: Locally compact separable metrizable spaces are characterized among all metrizable spaces as those that admit a cofinal sequence $K_1\subset K_2\subset\cdots$ of compact subsets. Their \v{C}ech cohomology is well-understood due to Petkova's short exact sequence $0\to\lim^1 H^{n-1}(K_i)\to H^n(X)\to\lim H^n(K_i)\to 0$. We study a dual class of spaces. We call a metrizable space $X$ a "coronated polyhedron" if it contains a compactum $K$ such that $X\setminus K$ is a polyhedron. These include, apart from compacta and polyhedra, spaces such as the topologist's sine curve (or the Warsaw circle) and the comb (=comb-and-flea) space. The complement of every locally compact subset of $S^n$ is a coronated polyhedron. We prove that a metrizable space $X$ is a coronated polyhedron if and only if it admits a countable polyhedral resolution; or, equivalently, a sequential polyhedral resolution $\dots\to R_2\to R_1$. In the latter case, we establish a short exact sequence $0\to\lim^1 H_{n+1}(R_i)\to H_n(X)\to\lim H_n(R_i)\to 0$ for Steenrod-Sitnikov homology and also for any (extraordinary) homology theory satisfying Milnor's axioms of map excision and $\prod$-additivity. We also show that such homology theories are invariants of strong shape for coronated polyhedra. On the other hand, Quigley's short exact sequence $0\to\lim^1\pi_{n+1}(R_i)\to\pi_n(X)\to\lim\pi_n(R_i)\to 0$ for Steenrod homotopy of compacta fails for Steenrod-Sitnikov homotopy of coronated polyhedra, at least when $n=0$.


title: Comparative evaluation of catalyst materials using a binary choice model

abstract: Advances in algorithms and hardware have enabled computers to design new materials atom-by-atom. However, in order for these computer-generated materials to truly address problems of societal importance, such as clean energy generation, it is not enough for them to have superior physical properties. It is also important for them to be adopted by as many users as possible. In this paper, we present a simple binary choice model for comparing catalyst materials on the basis of consumer preferences. This model considers a population of utility maximisers who select one of two materials by comparing catalytic turnover rates with sales prices. Through a mixture of numerical simulation and analytic theorems, we characterise the predictions of the model in a variety of regimes of consumer behavior. We also show how the model can be used as a guide for crafting policies for lowering catalyst prices in order to improve their market shares. This work represents a first step towards understanding how material properties should be balanced against production costs and consumer demand when designing new materials, an intellectual advance which may facilitate the spread of green materials in society.


title: Towards Explaining Subjective Ground of Individuals on Social Media

abstract: Large-scale language models have been reducing the gap between machines and humans in understanding the real world, yet understanding an individual's theory of mind and behavior from text is far from being resolved. This research proposes a neural model -- Subjective Ground Attention -- that learns subjective grounds of individuals and accounts for their judgments on situations of others posted on social media. Using simple attention modules as well as taking one's previous activities into consideration, we empirically show that our model provides human-readable explanations of an individual's subjective preference in judging social situations. We further qualitatively evaluate the explanations generated by the model and claim that our model learns an individual's subjective orientation towards abstract moral concepts


title: Robust DNN Surrogate Models with Uncertainty Quantification via Adversarial Training

abstract: For computational efficiency, surrogate models have been used to emulate mathematical simulators for physical or biological processes. High-speed simulation is crucial for conducting uncertainty quantification (UQ) when the simulation is repeated over many randomly sampled input points (aka, the Monte Carlo method). In some cases, UQ is only feasible with a surrogate model. Recently, Deep Neural Network (DNN) surrogate models have gained popularity for their hard-to-match emulation accuracy. However, it is well-known that DNN is prone to errors when input data are perturbed in particular ways, the very motivation for adversarial training. In the usage scenario of surrogate models, the concern is less of a deliberate attack but more of the high sensitivity of the DNN's accuracy to input directions, an issue largely ignored by researchers using emulation models. In this paper, we show the severity of this issue through empirical studies and hypothesis testing. Furthermore, we adopt methods in adversarial training to enhance the robustness of DNN surrogate models. Experiments demonstrate that our approaches significantly improve the robustness of the surrogate models without compromising emulation accuracy.


title: Emergence of a stochastic resonance in machine learning

abstract: Can noise be beneficial to machine-learning prediction of chaotic systems? Utilizing reservoir computers as a paradigm, we find that injecting noise to the training data can induce a stochastic resonance with significant benefits to both short-term prediction of the state variables and long-term prediction of the attractor of the system. A key to inducing the stochastic resonance is to include the amplitude of the noise in the set of hyperparameters for optimization. By so doing, the prediction accuracy, stability and horizon can be dramatically improved. The stochastic resonance phenomenon is demonstrated using two prototypical high-dimensional chaotic systems.


title: A Persian ASR-based SER: Modification of Sharif Emotional Speech Database and Investigation of Persian Text Corpora

abstract: Speech Emotion Recognition (SER) is one of the essential perceptual methods of humans in understanding the situation and how to interact with others, therefore, in recent years, it has been tried to add the ability to recognize emotions to human-machine communication systems. Since the SER process relies on labeled data, databases are essential for it. Incomplete, low-quality or defective data may lead to inaccurate predictions. In this paper, we fixed the inconsistencies in Sharif Emotional Speech Database (ShEMO), as a Persian database, by using an Automatic Speech Recognition (ASR) system and investigating the effect of Farsi language models obtained from accessible Persian text corpora. We also introduced a Persian/Farsi ASR-based SER system that uses linguistic features of the ASR outputs and Deep Learning-based models.


title: Quantum inverted harmonic potential

abstract: We consider a non-interacting gas under the inverted harmonic potential and present infinitely degenerate non-stationary orthogonal states. We discuss that it has an infinite entropy at the absolute zero temperature. We show that uncertainty in position of a particle under the inverted harmonic potential can be zero as there exists a solution which asymptotes to a Dirac delta function. We obtain a new free particle wave packet using the eigenstates for the inverted harmonic potential. It has unique self-focusing feature and can be used as focusing beam without a lens in optical systems where paraxial approximation is used.


title: pmwd: A Differentiable Cosmological Particle-Mesh $N$-body Library

abstract: The formation of the large-scale structure, the evolution and distribution of galaxies, quasars, and dark matter on cosmological scales, requires numerical simulations. Differentiable simulations provide gradients of the cosmological parameters, that can accelerate the extraction of physical information from statistical analyses of observational data. The deep learning revolution has brought not only myriad powerful neural networks, but also breakthroughs including automatic differentiation (AD) tools and computational accelerators like GPUs, facilitating forward modeling of the Universe with differentiable simulations. Because AD needs to save the whole forward evolution history to backpropagate gradients, current differentiable cosmological simulations are limited by memory. Using the adjoint method, with reverse time integration to reconstruct the evolution history, we develop a differentiable cosmological particle-mesh (PM) simulation library pmwd (particle-mesh with derivatives) with a low memory cost. Based on the powerful AD library JAX, pmwd is fully differentiable, and is highly performant on GPUs.


title: Potential Auto-driving Threat: Universal Rain-removal Attack

abstract: The problem of robustness in adverse weather conditions is considered a significant challenge for computer vision algorithms in the applicants of autonomous driving. Image rain removal algorithms are a general solution to this problem. They find a deep connection between raindrops/rain-streaks and images by mining the hidden features and restoring information about the rain-free environment based on the powerful representation capabilities of neural networks. However, previous research has focused on architecture innovations and has yet to consider the vulnerability issues that already exist in neural networks. This research gap hints at a potential security threat geared toward the intelligent perception of autonomous driving in the rain. In this paper, we propose a universal rain-removal attack (URA) on the vulnerability of image rain-removal algorithms by generating a non-additive spatial perturbation that significantly reduces the similarity and image quality of scene restoration. Notably, this perturbation is difficult to recognise by humans and is also the same for different target images. Thus, URA could be considered a critical tool for the vulnerability detection of image rain-removal algorithms. It also could be developed as a real-world artificial intelligence attack method. Experimental results show that URA can reduce the scene repair capability by 39.5% and the image generation quality by 26.4%, targeting the state-of-the-art (SOTA) single-image rain-removal algorithms currently available.


title: Ask4Help: Learning to Leverage an Expert for Embodied Tasks

abstract: Embodied AI agents continue to become more capable every year with the advent of new models, environments, and benchmarks, but are still far away from being performant and reliable enough to be deployed in real, user-facing, applications. In this paper, we ask: can we bridge this gap by enabling agents to ask for assistance from an expert such as a human being? To this end, we propose the Ask4Help policy that augments agents with the ability to request, and then use expert assistance. Ask4Help policies can be efficiently trained without modifying the original agent's parameters and learn a desirable trade-off between task performance and the amount of requested help, thereby reducing the cost of querying the expert. We evaluate Ask4Help on two different tasks -- object goal navigation and room rearrangement and see substantial improvements in performance using minimal help. On object navigation, an agent that achieves a $52\%$ success rate is raised to $86\%$ with $13\%$ help and for rearrangement, the state-of-the-art model with a $7\%$ success rate is dramatically improved to $90.4\%$ using $39\%$ help. Human trials with Ask4Help demonstrate the efficacy of our approach in practical scenarios. We release the code for Ask4Help here: https://github.com/allenai/ask4help.


title: Path Independent Equilibrium Models Can Better Exploit Test-Time Computation

abstract: Designing networks capable of attaining better performance with an increased inference budget is important to facilitate generalization to harder problem instances. Recent efforts have shown promising results in this direction by making use of depth-wise recurrent networks. We show that a broad class of architectures named equilibrium models display strong upwards generalization, and find that stronger performance on harder examples (which require more iterations of inference to get correct) strongly correlates with the path independence of the system -- its tendency to converge to the same steady-state behaviour regardless of initialization, given enough computation. Experimental interventions made to promote path independence result in improved generalization on harder problem instances, while those that penalize it degrade this ability. Path independence analyses are also useful on a per-example basis: for equilibrium models that have good in-distribution performance, path independence on out-of-distribution samples strongly correlates with accuracy. Our results help explain why equilibrium models are capable of strong upwards generalization and motivates future work that harnesses path independence as a general modelling principle to facilitate scalable test-time usage.


title: Phase-probability shaping for speckle-free holographic lithography

abstract: Optical holography has undergone rapid development since its invention in 1948, but the accompanying speckles with randomly distributed intensity are still untamed now due to the fundamental difficulty of eliminating intrinsic fluctuations from irregular complex-field superposition. Despite spatial, temporal and spectral averages for speckle reduction, it is extremely challenging to reconstruct high-homogeneity, edge-sharp and shape-unlimited images via holography. Here we predict that holographic speckles can be removed by narrowing the probability density distribution of encoded phase to homogenize optical superposition. Guided by this physical insight, a machine-learning-assisted probability-shaping (MAPS) method is developed to prohibit the fluctuations of intensity in a computer-generated hologram (CGH), which empowers the experimental reconstruction of irregular images with ultralow speckle contrast (C=0.08) and record-high edge sharpness (~1000 mm-1). It breaks the ultimate barrier of demonstrating high-end CGH lithography, thus enabling us to successfully pattern arbitrary-shape and edge-sharp structures such as vortex gratings and two-dimensional random barcodes.


title: Transversely product singularities of foliations in projective spaces

abstract: We prove that a transversely product component of the singular set of a holomorphic foliation on $\mathbb P^n$ is necessarily a Kupka component.


title: Optimal Algorithms for Linear Algebra in the Current Matrix Multiplication Time

abstract: We study fundamental problems in linear algebra, such as finding a maximal linearly independent subset of rows or columns (a basis), solving linear regression, or computing a subspace embedding. For these problems, we consider input matrices $\mathbf{A}\in\mathbb{R}^{n\times d}$ with $n > d$. The input can be read in $\text{nnz}(\mathbf{A})$ time, which denotes the number of nonzero entries of $\mathbf{A}$. In this paper, we show that beyond the time required to read the input matrix, these fundamental linear algebra problems can be solved in $d^{\omega}$ time, i.e., where $\omega \approx 2.37$ is the current matrix-multiplication exponent. To do so, we introduce a constant-factor subspace embedding with the optimal $m=\mathcal{O}(d)$ number of rows, and which can be applied in time $\mathcal{O}\left(\frac{\text{nnz}(\mathbf{A})}{\alpha}\right) + d^{2 + \alpha}\text{poly}(\log d)$ for any trade-off parameter $\alpha>0$, tightening a recent result by Chepurko et. al. [SODA 2022] that achieves an $\exp(\text{poly}(\log\log n))$ distortion with $m=d\cdot\text{poly}(\log\log d)$ rows in $\mathcal{O}\left(\frac{\text{nnz}(\mathbf{A})}{\alpha}+d^{2+\alpha+o(1)}\right)$ time. Our subspace embedding uses a recently shown property of stacked Subsampled Randomized Hadamard Transforms (SRHT), which actually increase the input dimension, to "spread" the mass of an input vector among a large number of coordinates, followed by random sampling. To control the effects of random sampling, we use fast semidefinite programming to reweight the rows. We then use our constant-factor subspace embedding to give the first optimal runtime algorithms for finding a maximal linearly independent subset of columns, regression, and leverage score sampling. To do so, we also introduce a novel subroutine that iteratively grows a set of independent rows, which may be of independent interest.


title: Relaxation exponents of OTOCs and overlap with local Hamiltonians

abstract: OTOC has been used to characterize the information scrambling in quantum systems. Recent studies showed that local conserved quantities play a crucial role in governing the relaxation dynamics of OTOC in non-integrable systems. In particular, slow scrambling of OTOC is seen for observables that has an overlap with local conserved quantities. However, an observable may not overlap with the Hamiltonian, but with the Hamiltonian elevated to an exponent larger than one. Here, we show that higher exponents correspond to faster relaxation, although still algebraic, and with exponents that can increase indefinitely. Our analytical results are supported by numerical experiments.


title: AVATAR submission to the Ego4D AV Transcription Challenge

abstract: In this report, we describe our submission to the Ego4D AudioVisual (AV) Speech Transcription Challenge 2022. Our pipeline is based on AVATAR, a state of the art encoder-decoder model for AV-ASR that performs early fusion of spectrograms and RGB images. We describe the datasets, experimental settings and ablations. Our final method achieves a WER of 68.40 on the challenge test set, outperforming the baseline by 43.7%, and winning the challenge.


title: Learning on Health Fairness and Environmental Justice via Interactive Visualization

abstract: This paper introduces an interactive visualization interface with a machine learning consensus analysis that enables the researchers to explore the impact of atmospheric and socioeconomic factors on COVID-19 clinical severity by employing multiple Recurrent Graph Neural Networks. We designed and implemented a visualization interface that leverages coordinated multi-views to support exploratory and predictive analysis of hospitalizations and other socio-geographic variables at multiple dimensions, simultaneously. By harnessing the strength of geometric deep learning, we build a consensus machine learning model to include knowledge from county-level records and investigate the complex interrelationships between global infectious disease, environment, and social justice. Additionally, we make use of unique NASA satellite-based observations which are not broadly used in the context of climate justice applications. Our current interactive interface focus on three US states (California, Pennsylvania, and Texas) to demonstrate its scientific value and presented three case studies to make qualitative evaluations.


title: Effective and scalable programs to facilitate labor market transitions for women in technology

abstract: We describe the design, implementation, and evaluation of a low-cost (approximately $15 per person) and scalable program, called Challenges, aimed at aiding women in Poland transition to technology-sector jobs. This program helps participants develop portfolios demonstrating job-relevant competencies. We conduct two independent evaluations, one of the Challenges program and the other of a traditional mentoring program -- Mentoring -- where experienced tech professionals work individually with mentees to support them in their job search. Exploiting the fact that both programs were oversubscribed, we randomized admissions and measured their impact on the probability of finding a job in the technology sector. We estimate that Mentoring increases the probability of finding a technology job within four months from 29% to 42% and Challenges from 20% to 29%, and the treatment effects do not attenuate over 12 months. Since both programs are capacity constrained in practice (only 28% of applicants can be accommodated), we evaluate the effectiveness of several alternative prioritization rules based on applicant characteristics. We find that a policy that selects applicants based on their predicted treatment effects increases the average treatment effect across the two programs to 22 percentage points. We further analyze how alternative prioritization rules compare to the selection that mentors used. We find that mentors selected applicants who were more likely to get a tech job even without participating in the program, and the treatment effect for applicants with similar characteristics to those selected by mentors is about half of the effect attainable when participants are prioritized optimally.


title: Effects of Active Galactic Nucleus Feedback on Cold Gas Depletion and Quenching of Central Galaxies

abstract: We investigate the influence of active galactic nucleus (AGN) feedback on the galaxy cold gas content and its connection to galaxy quenching in three hydrodynamical simulations of Illustris, IllustrisTNG and SIMBA. By comparing to the observed atomic and molecular neutral hydrogen measurements for central galaxies, we find that Illustris over-predicts the cold gas masses in star-forming galaxies and significantly under-predicts them for quenched galaxies. IllustrisTNG performs better in this comparison than Illustris, but quenched galaxies retain too much cold gas compared with observations. SIMBA shows good agreement with observations, by depleting the global cold gas reservoir for quenched galaxies. We find that the discrepancies in IllustrisTNG are caused by its weak kinetic AGN feedback that only redistributes the cold gas from the inner disks to the outer regions and reduces the inner cold gas densities. It agrees with observations much better when only the cold gas within the stellar disk is considered to infer the star formation rates. From dependences of cold gas reservoir on the black hole mass and Eddington ratio, we find that the cumulative energy release during the black hole growth is the dominant reason for the cold gas depletion and thus the galaxy quenching. We further measure the central stellar surface density within 1 kpc ($\Sigma_1$) for the high-resolution run of IllustrisTNG and find a tight correlation between $\Sigma_1$ and black hole mass. It suggests that the observed decreasing trend of cold gas mass with $\Sigma_1$ is also a reflection of the black hole growth.


title: Estimating defection in subscription-type markets: empirical analysis from the scholarly publishing industry

abstract: We present the first empirical study on customer churn prediction in the scholarly publishing industry. The study examines our proposed method for prediction on a customer subscription data over a period of 6.5 years, which was provided by a major academic publisher. We explore the subscription-type market within the context of customer defection and modelling, and provide analysis of the business model of such markets, and how these characterise the academic publishing business. The proposed method for prediction attempts to provide inference of customer's likelihood of defection on the basis of their re-sampled use of provider resources -in this context, the volume and frequency of content downloads. We show that this approach can be both accurate as well as uniquely useful in the business-to-business context, with which the scholarly publishing business model shares similarities. The main findings of this work suggest that whilst all predictive models examined, especially ensemble methods of machine learning, achieve substantially accurate prediction of churn, nearly a year ahead, this can be furthermore achieved even when the specific behavioural attributes that can be associated to each customer probability to churn are overlooked. Allowing as such highly accurate inference of churn from minimal possible data. We show that modelling churn on the basis of re-sampling customers' use of resources over subscription time is a better (simplified) approach than when considering the high granularity that can often characterise consumption behaviour.


title: Ultra-low lattice thermal conductivity induces high-performance thermoelectricity in Janus group-VIA binary monolayers

abstract: In this paper, the electrical transport, thermal transport, and thermoelectric properties of three new Janus STe$_{2}$, SeTe$_{2}$, and Se$_{2}$Te monolayers are systematically studied by first-principles calculations, as well as the comparative with available literature's results using different methods. It is found that the Seebeck coefficient and conductivity have opposite dependence on temperature, and we illustrate this phenomenon in detail. The decrease of the thermoelectric power factor (PF) with temperature originates from the decrease in conductivity. To obtain accurate and convergent lattice thermal conductivity, the root mean square (RMS) is calculated to obtain a reasonable cutoff radius for the calculation of third-order forces. Janus STe$_{2}$, SeTe$_{2}$, and Se$_{2}$Te monolayers exhibit ultra-low lattice thermal conductivity of 0.2, 0.133, and 4.81$\times10^{-4}$ W/mK at 300 K, which result from the strong coupling effect between the acoustic mode and the low-frequency optical branch, low phonon group velocity, small phonon lifetime, and large anharmonicity. Consequently, ultra-high $\textit{ZT}$ values of 2.11 (2.09), 3.28 (4.24), and 3.40 (6.51) for n-type(p-type) carrier doping of STe$_{2}$, SeTe$_{2}$, and Se$_{2}$Te are obtained, indicating that they are promising thermoelectric materials.


title: Evidence for neutrino emission from the nearby active galaxy NGC 1068

abstract: We report three searches for high energy neutrino emission from astrophysical objects using data recorded with IceCube between 2011 and 2020. Improvements over previous work include new neutrino reconstruction and data calibration methods. In one search, the positions of 110 a priori selected gamma-ray sources were analyzed individually for a possible surplus of neutrinos over atmospheric and cosmic background expectations. We found an excess of $79_{-20}^{+22}$ neutrinos associated with the nearby active galaxy NGC 1068 at a significance of 4.2$\,\sigma$. The excess, which is spatially consistent with the direction of the strongest clustering of neutrinos in the Northern Sky, is interpreted as direct evidence of TeV neutrino emission from a nearby active galaxy. The inferred flux exceeds the potential TeV gamma-ray flux by at least one order of magnitude.

categories: astro-ph.HE astro-ph.GA astro-ph.IM hep-ex


title: The Runner-up Solution for YouTube-VIS Long Video Challenge 2022

abstract: This technical report describes our 2nd-place solution for the ECCV 2022 YouTube-VIS Long Video Challenge. We adopt the previously proposed online video instance segmentation method IDOL for this challenge. In addition, we use pseudo labels to further help contrastive learning, so as to obtain more temporally consistent instance embedding to improve tracking performance between frames. The proposed method obtains 40.2 AP on the YouTube-VIS 2022 long video dataset and was ranked second place in this challenge. We hope our simple and effective method could benefit further research.


title: Metastable Carbon at Extreme Conditions

abstract: Carbon at extreme conditions is the focus of intensive scientific inquiry due to its importance for applications in inertial confinement fusion experiments and for understanding the interior structure of carbon-rich exoplanets. The extreme metastability of diamond at very high pressures has been discovered in recent dynamic compression experiments. This work addresses an important question about the existence of other competitive metastable carbon phases that might be observed in shock experiments. It was found that diamond polytypes, carbon crystals with mixed cubic and hexagonal diamond stacking planes, are the only metastable carbon crystal phases energetically competitive with cubic diamond at pressures between 100 and 1,000 GPa. Above 1 TPa, no metastable phases are found to be energetically competitive with thermodynamically stable BC8 and simple cubic phases. The existence of low enthalpy diamond polytypes suggests that they are likely candidates for metastable phases of carbon to appear upon shockwave loading of diamond.


title: Explicit bounds for large gaps between squarefree integers

abstract: We obtain explicit forms of the current best known asymptotic upper bounds for gaps between squarefree integers. In particular we show, for any $x \ge 2$, that every interval of the form $(x, x + 11x^{1/5}\log x]$ contains a squarefree integer. The constant 11 can be improved further, if $x$ is assumed to be larger than a (very) large constant.


title: How to Train Your Space Tester, Part II: Enabling Capabilities

abstract: The need for space test professionals is growing rapidly, due to establishment of the US Space Force and the extremely rapid growth of the commercial space industry. The future of space test looks bright and complex; a better training foundation is needed to impart test-mindedness to all space professionals to enable this future. Discussed from a military perspective, but applicable across the space industry, there are three critical aspects of foundational training: (1) Realistic trainers and simulators: Representative simulators are the safest way to gain repetitions in dynamic decision-making, satellite envelope expansion, fault response, and to develop ways to operate through a contested, degraded, and operationally limited (CDO) environment. This paper introduces a new term encompassing the variables of space maneuver (GET CLASS) as a standard for US Space Force training simulators; (2) Interoperable Software Tools: Adapt to new software tools without reliance on a checklist. Common standards and interfaces must be developed and enforced; and (3) Cross-functional networking: Operations, test, engineering, and program management communities must work hand-in-hand to deliver effective capabilities. Blending career fields and mission areas inspires innovation and propagates improved capabilities across the space industry.


title: DCPViz: A Visual Analytics Approach for Downscaled Climate Projections

abstract: This paper introduces a novel visual analytics approach, DCPViz, to enable climate scientists to explore massive climate data interactively without requiring the upfront movement of massive data. Thus, climate scientists are afforded more effective approaches to support the identification of potential trends and patterns in climate projections and their subsequent impacts. We designed the DCPViz pipeline to fetch and extract NEX-DCP30 data with minimal data transfer from their public sources. We implemented DCPViz to demonstrate its scalability and scientific value and to evaluate its utility under three use cases based on different models and through domain expert feedback.


title: Snowmass Cosmic Frontier Report

abstract: This report summarizes the current status of Cosmic Frontier physics and the broad and exciting future prospects identified for the Cosmic Frontier as part of the 2021 Snowmass Process.

categories: hep-ex astro-ph.CO astro-ph.HE astro-ph.IM hep-ph


title: Comparison between EM and FCM algorithms in skin tone extraction

abstract: This study aims to investigate implementing EM and FCM algorithms for skin color extraction. The capabilities of three well-known color spaces, namely, RGB, HSV, and YCbCr for skin-tone extraction are assessed by using statistical modeling of skin tones using EM and FCM algorithms. The results show that utilizing a Gaussian mixture model for parametric modeling of skin tones using EM algorithm works well in HSV color space when all three components of the color vector are used. In spite of discarding the luminance components in YCbCr and HSV color spaces, EM algorithm provides the best results. The results of the detailed comparisons are explained in the conclusion.


title: Contrastive Positive Sample Propagation along the Audio-Visual Event Line

abstract: Visual and audio signals often coexist in natural environments, forming audio-visual events (AVEs). Given a video, we aim to localize video segments containing an AVE and identify its category. It is pivotal to learn the discriminative features for each video segment. Unlike existing work focusing on audio-visual feature fusion, in this paper, we propose a new contrastive positive sample propagation (CPSP) method for better deep feature representation learning. The contribution of CPSP is to introduce the available full or weak label as a prior that constructs the exact positive-negative samples for contrastive learning. Specifically, the CPSP involves comprehensive contrastive constraints: pair-level positive sample propagation (PSP), segment-level and video-level positive sample activation (PSA$_S$ and PSA$_V$). Three new contrastive objectives are proposed (\emph{i.e.}, $\mathcal{L}_{\text{avpsp}}$, $\mathcal{L}_\text{spsa}$, and $\mathcal{L}_\text{vpsa}$) and introduced into both the fully and weakly supervised AVE localization. To draw a complete picture of the contrastive learning in AVE localization, we also study the self-supervised positive sample propagation (SSPSP). As a result, CPSP is more helpful to obtain the refined audio-visual features that are distinguishable from the negatives, thus benefiting the classifier prediction. Extensive experiments on the AVE and the newly collected VGGSound-AVEL100k datasets verify the effectiveness and generalization ability of our method.


title: Weighted Ensemble Self-Supervised Learning

abstract: Ensembling has proven to be a powerful technique for boosting model performance, uncertainty estimation, and robustness in supervised learning. Advances in self-supervised learning (SSL) enable leveraging large unlabeled corpora for state-of-the-art few-shot and supervised learning performance. In this paper, we explore how ensemble methods can improve recent SSL techniques by developing a framework that permits data-dependent weighted cross-entropy losses. We refrain from ensembling the representation backbone; this choice yields an efficient ensemble method that incurs a small training cost and requires no architectural changes or computational overhead to downstream evaluation. The effectiveness of our method is demonstrated with two state-of-the-art SSL methods, DINO (Caron et al., 2021) and MSN (Assran et al., 2022). Our method outperforms both in multiple evaluation metrics on ImageNet-1K, particularly in the few-shot setting. We explore several weighting schemes and find that those which increase the diversity of ensemble heads lead to better downstream evaluation results. Thorough experiments yield improved prior art baselines which our method still surpasses; e.g., our overall improvement with MSN ViT-B/16 is 3.9 p.p. for 1-shot learning.


title: Evolution of grain size distribution with enhanced abundance of small carbonaceous grains in galactic environments

abstract: We propose an updated dust evolution model that focuses on the grain size distribution in a galaxy. We treat the galaxy as a one-zone object and include five main processes (stellar dust production, dust destruction in supernova shocks, grain growth by accretion and coagulation, and grain disruption by shattering). In this paper, we improve the predictions related to small carbonaceous grains, which are responsible for the 2175 \AA\ bump in the extinction curve and the polycyclic aromatic hydrocarbon (PAH) emission features in the dust emission spectral energy distribution (SED), both of which were underpredicted in our previous model. In the new model, we hypothesize that small carbonaceous grains are not involved in interstellar processing. This avoids small carbonaceous grains being lost by coagulation. We find that this hypothetical model shows a much better match to the Milky Way (MW) extinction curve and dust emission SED than the previous one. The following two additional modifications further make the fit to the MW dust emission SED better: (i) The chemical enrichment model is adjusted to give a nearly solar metallicity in the present epoch, and the fraction of metals available for dust growth is limited to half. (ii) Aromatization for small carbonaceous grains is efficient, so that the aromatic fraction is unity at grain radii $\lesssim 20$ \AA. As a consequence of our modelling, we succeed in obtaining a dust evolution model that explains the MW extinction curve and dust emission SED at the same time.


title: Universal Approximation Property of Fully Convolutional Neural Networks with Zero Padding

abstract: The Convolutional Neural Network (CNN) is one of the most prominent neural network architectures in deep learning. Despite its widespread adoption, our understanding of its universal approximation properties has been limited due to its intricate nature. CNNs inherently function as tensor-to-tensor mappings, preserving the spatial structure of input data. However, limited research has explored the universal approximation properties of fully convolutional neural networks as arbitrary continuous tensor-to-tensor functions. In this study, we demonstrate that CNNs, when utilizing zero padding, can approximate arbitrary continuous functions in cases where both the input and output values exhibit the same spatial shape. Additionally, we determine the minimum depth of the neural network required for approximation and substantiate its optimality. We also verify that deep, narrow CNNs possess the UAP as tensor-to-tensor functions. The results encompass a wide range of activation functions, and our research covers CNNs of all dimensions.


title: Multi-task Learning for Sparse Traffic Forecasting

abstract: Accurate traffic prediction is crucial to improve the performance of intelligent transportation systems. Previous traffic prediction tasks mainly focus on small and non-isolated traffic subsystems, while the Traffic4cast 2022 competition is dedicated to exploring the traffic state dynamics of entire cities. Given one hour of sparse loop count data only, the task is to predict the congestion classes for all road segments and the expected times of arrival along super-segments 15 minutes into the future. The sparsity of loop counter data and highly uncertain real-time traffic conditions make the competition challenging. For this reason, we propose a multi-task learning network that can simultaneously predict the congestion classes and the speed of each road segment. Specifically, we use clustering and neural network methods to learn the dynamic features of loop counter data. Then, we construct a graph with road segments as nodes and capture the spatial dependence between road segments based on a Graph Neural Network. Finally, we learn three measures, namely the congestion class, the speed value and the volume class, simultaneously through a multi-task learning module. For the extended competition, we use the predicted speeds to calculate the expected times of arrival along super-segments. Our method achieved excellent results on the dataset provided by the Traffic4cast Competition 2022, source code is available at https://github.com/OctopusLi/NeurIPS2022-traffic4cast.


title: Phase mask pinholes as spatial filters for laser interference lithography

abstract: Laser resonators have outputs with Gaussian spatial beam profiles. In laser interference lithography (LIL), using such Gaussian shaped beams leads to an inhomogeneous exposure of the substrate. As a result, dimensions of lithography defined features vary significantly across the substrate. In most LIL setups, pinholes are used as filters to remove optical noise. Following a concept proposed by Hariharan et. al. a phase mask can be added to these pinholes. In theory, this modification results in a more uniform beam profile, and, if applied as spatial filters in LIL, in improved exposure and hence feature size uniformity. Here, we report on the first successful fabrication of such elements and demonstrate their use in an LIL setup to reduce feature dimension variations from 47.2% to 27.5% using standard and modified pinholes, respectively.


title: Pandering in a Flexible Representative Democracy

abstract: In representative democracies, the election of new representatives in regular election cycles is meant to prevent corruption and other misbehavior by elected officials and to keep them accountable in service of the ``will of the people." This democratic ideal can be undermined when candidates are dishonest when campaigning for election over these multiple cycles or rounds of voting. Much of the work on COMSOC to date has investigated strategic actions in only a single round. We introduce a novel formal model of \emph{pandering}, or strategic preference reporting by candidates seeking to be elected, and examine the resilience of two democratic voting systems to pandering within a single round and across multiple rounds. The two voting systems we compare are Representative Democracy (RD) and Flexible Representative Democracy (FRD). For each voting system, our analysis centers on the types of strategies candidates employ and how voters update their views of candidates based on how the candidates have pandered in the past. We provide theoretical results on the complexity of pandering in our setting for a single cycle, formulate our problem for multiple cycles as a Markov Decision Process, and use reinforcement learning to study the effects of pandering by both single candidates and groups of candidates across a number of rounds.


title: Simulating the charging of isolated free-falling masses from TeV to eV energies: detailed comparison with LISA Pathfinder results

abstract: A model is presented that explains the charging rate of the LISA Pathfinder test masses by the interplanetary cosmic ray environment. The model incorporates particle-tracking from TeV to eV energies using a combination of GEANT4 and a custom low-energy particle generation and tracking code. The electrostatic environment of the test mass is simulated allowing for a comparison of the test-mass charging-rate dependence on local electric fields with observations made in orbit. The model is able to reproduce the observed charging behavior with good accuracy using gold surface properties compatible with literature values. The results of the model confirm that a significant fraction of the net charging current is caused by a population of low-energy ($\sim$eV) electrons produced by electron- and ion-induced kinetic emission from the test mass and surrounding metal surfaces. Assuming a gold work function of 4.2 eV, the unbalanced flow of these electrons to and from the unbiased test mass contributes $\sim$10% of the overall test mass charging rate. Their contribution to the charging-current shot noise is disproportionately higher and it adds $\sim$40% to the overall predicted noise. However, even with this increased noise contribution the overall charging-current noise is still only 40% of that measured in-orbit, and this remains an unsolved issue.


title: Exploring WavLM on Speech Enhancement

abstract: There is a surge in interest in self-supervised learning approaches for end-to-end speech encoding in recent years as they have achieved great success. Especially, WavLM showed state-of-the-art performance on various speech processing tasks. To better understand the efficacy of self-supervised learning models for speech enhancement, in this work, we design and conduct a series of experiments with three resource conditions by combining WavLM and two high-quality speech enhancement systems. Also, we propose a regression-based WavLM training objective and a noise-mixing data configuration to further boost the downstream enhancement performance. The experiments on the DNS challenge dataset and a simulation dataset show that the WavLM benefits the speech enhancement task in terms of both speech quality and speech recognition accuracy, especially for low fine-tuning resources. For the high fine-tuning resource condition, only the word error rate is substantially improved.


title: A simple construction of infinite finitely generated torsion groups

abstract: The goal of this note is to provide yet another proof of the following theorem of Golod: there exists an infinite finitely generated group $G$ such that every element of $G$ has finite order. Our proof is based on the Nielsen-Schreier index formula and is simple enough to be included in a standard group theory course.


title: Changes of Magnetic Energy and Helicity in Solar Active Regions from Major Flares

abstract: Magnetic free energy powers solar flares and coronal mass ejections (CMEs), and the buildup of magnetic helicity might play a role in the development of unstable structures that subsequently erupt. To better understand the roles of energy and helicity in large flares and eruptions, we have characterized the evolution of magnetic energy and helicity associated with 21 X-class flares from 2010 to 2017. Our sample includes both confined and eruptive events, with 6 and 15 in each category, respectively. Using HMI vector magnetic field observations from several hours before to several hours after each event, we employ (a) the Differential Affine Velocity Estimator for Vector Magnetograms (DAVE4VM) to determine the photospheric fluxes of energy and helicity, and (b) non-linear force-free field (NLFFF) extrapolations to estimate the coronal content of energy and helicity in source-region fields. Using Superposed Epoch analysis (SPE), we find, on average: (1) decreases in both magnetic energy and helicity, in both photospheric fluxes and coronal content, that persist for a few hours after eruptions, but no clear changes, notably in relative helicity, for confined events; (2) significant increases in the twist of photospheric fields in eruptive events, with twist uncertainties too large in confined events to constrain twist changes (and lower overall twist in confined events); and (3) on longer time scales (event time +12 hours), replenishment of free magnetic energy and helicity content to near pre-event levels for eruptive events. For eruptive events, magnetic helicity and free energy in coronal models clearly decrease after flares, with the amounts of decrease proportional to each region's pre-flare content.


title: Cohomology and Deformation theory of Modified Rota-Baxter Leibniz algebras

abstract: In this paper, we define the cohomology of a modified Rota-Baxter Leibniz algebra with coefficients in a suitable representation. As applications of our cohomology, we study formal one-parameter deformations and abelian extensions of modified Rota-Baxter Leibniz algebras.


title: Look More but Care Less in Video Recognition

abstract: Existing action recognition methods typically sample a few frames to represent each video to avoid the enormous computation, which often limits the recognition performance. To tackle this problem, we propose Ample and Focal Network (AFNet), which is composed of two branches to utilize more frames but with less computation. Specifically, the Ample Branch takes all input frames to obtain abundant information with condensed computation and provides the guidance for Focal Branch by the proposed Navigation Module; the Focal Branch squeezes the temporal size to only focus on the salient frames at each convolution block; in the end, the results of two branches are adaptively fused to prevent the loss of information. With this design, we can introduce more frames to the network but cost less computation. Besides, we demonstrate AFNet can utilize fewer frames while achieving higher accuracy as the dynamic selection in intermediate features enforces implicit temporal modeling. Further, we show that our method can be extended to reduce spatial redundancy with even less cost. Extensive experiments on five datasets demonstrate the effectiveness and efficiency of our method.


title: Cohomology and Deformation theory of crossed homomorphisms on Leibniz algebras

abstract: In this paper, we construct a differential graded Lie algebra whose Maurer-Cartan elements are given by crossed homomorphisms on Leibniz algebras. This allows us to define cohomology for a crossed homomorphism. Finally, we study linear deformations, formal deformations and extendibility of finite order deformations of a crossed homomorphism in terms of the cohomology theory.


title: On $k$-ranks of topological spaces

abstract: In this paper, the concepts of $K$-subset systems and $k$-well-filtered spaces are introduced, which provide another uniform approach to $d$-spaces, $s$-well-filtered spaces (i.e., $\mathcal{U}_{S}$-admissibility) and well-filtered spaces. We prove that the $k$-well-filtered reflection of any $T_{0}$ space exists. Meanwhile, we propose the definition of $k$-rank, which is an ordinal that measures how many steps from a $T_{0}$ space to a $k$-well-filtered space. Moreover, we derive that for any ordinal $\alpha$, there exists a $T_{0}$ space whose $k$-rank equals to $\alpha$. One immediate corollary is that for any ordinal $\alpha$, there exists a $T_{0}$ space whose $d$-rank (respectively, $wf$-rank) equals to $\alpha$.


title: Contractility-induced phase separation in active solids

abstract: A combination of cellular contractility and active phase separation in cell-matrix composites is thought to be an enabler of spatiotemporal patterning in multicellular tissues across scales, from somitogenesis to cartilage condensation. To characterize these phenomena, we provide a general theory that incorporates active cellular contractility into the classical Cahn--Hilliard-Larch{\'e} model for phase separation in passive viscoelastic solids. We investigate the dynamics of phase separation in this model and show how a homogeneous mixture can be destabilized by activity via either a pitchfork or Hopf bifurcation, resulting in stable phase separation and/or traveling waves. Numerical simulations of the full equations allow us to track the evolution of the resulting self-organized patterns, in both periodic and mechanically constrained domains, and in different geometries. Altogether, our study underscores the importance of integrating both cellular activity and mechanical phase separation in understanding patterning in soft, active biosolids, and might explain previous experimental observations of cartilage condensation in both in-vivo and in-vitro settings.


title: The Duffin--Schaeffer conjecture for systems of linear forms

abstract: We extend the Duffin--Schaeffer conjecture to the setting of systems of $m$ linear forms in $n$ variables. That is, we establish a criterion to determine whether, for a given rate of approximation, almost all or almost no $n$-by-$m$ systems of linear forms are approximable at that rate using integer vectors satisfying a natural coprimality condition. When $m=n=1$, this is the classical 1941 Duffin--Schaeffer conjecture, which was proved in 2020 by Koukoulopoulos and Maynard. Pollington and Vaughan proved the higher-dimensional version, where $m>1$ and $n=1$, in 1990. The general statement we prove here was conjectured in 2009 by Beresnevich, Bernik, Dodson, and Velani. For approximations with no coprimality requirement, they also conjectured a generalized version of Catlin's conjecture, and in 2010 Beresnevich and Velani proved the $m>1$ cases of that. Catlin's classical conjecture, where $m=n=1$, follows from the classical Duffin--Schaeffer conjecture. The remaining cases of the generalized version, where $m=1$ and $n>1$, follow from our main result. Finally, through the Mass Transference Principle, our main results imply their Hausdorff measure analogues, which were also conjectured by Beresnevich \emph{et al} (2009).


title: Beyond ExaBricks: GPU Volume Path Tracing of AMR Data

abstract: Adaptive Mesh Refinement (AMR) is becoming a prevalent data representation for scientific visualization. Resulting from large fluid mechanics simulations, the data is usually cell centric, imposing a number of challenges for high quality reconstruction at sample positions. While recent work has concentrated on real-time volume and isosurface rendering on GPUs, the rendering methods used still focus on simple lighting models without scattering events and global illumination. As in other areas of rendering, key to real-time performance are acceleration data structures; in this work we analyze the major bottlenecks of data structures that were originally optimized for camera/primary ray traversal when used with the incoherent ray tracing workload of a volumetric path tracer, and propose strategies to overcome the challenges coming with this.


title: Collapsed manifolds with local Ricci bounded covering geometry

abstract: For $\rho, v>0$, we say that an $n$-manifold $M$ satisfies local $(\rho,v)$-bound Ricci covering geometry, if Ricci curvature $\text{Ric}_M\ge -(n-1)$, and for all $x\in M$, $\text{vol}(B_\rho(\tilde x))\ge v>0$, where $\tilde x$ is an inverse image of $x$ on the (local) Riemannian universal cover of the $\rho$-ball at $x$. In this paper, we extend the nilpotent fiber bundle theorem of Cheeger-Fukaya-Gromov on a collapsed $n$-manifold $M$ of bounded sectional curvature to $M$ of a local $(\rho,v)$-bound Ricci covering geometry, and $M$ is close to a non-collapsed Riemannian manifold of lower dimension. The nilpotent fiber bundle theorem significantly improves fiber bundle theorem in [Hu], and it strengthens a nilpotent fiber bundle seen from [NZ] and implies the torus bundle in [HW], which are obtained under additional local or global topological conditions, respectively. Our construction of a nilpotent fibration requires a new proof for a result in [HKRX]: if an $n$-manifold $M$ with local $(1,v)$-bound Ricci covering geometry has diameter $<\epsilon(n,v)$, a constant depends on $n$ and $v$, then $M$ is diffeomorphic to an infra-nilmanifold. The proof in [HKRX] is to show that the Ricci flows produces an almost flat metric, thus the result follows from the Gromov's theorem on almost flat manifolds. The new proof is independent of the Gromov's theorem, thus has which as a corollary. If the first Betti number $b_1(M)=n$, then $M$ satisfies a $(1,v)$-bound Ricci covering geometry, thus $M$ is diffeomorphic to a standard torus ([Co2]).


title: Anisotropic Topological Anderson Transitions in Chiral Symmetry Classes

abstract: We study quantum phase transitions of three-dimensional disordered systems in the chiral classes (AIII and BDI) with and without weak topological indices. We show that the systems with a nontrivial weak topological index universally exhibit an emergent thermodynamic phase where wave functions are delocalized along one spatial direction but exponentially localized in the other two spatial directions, which we call the quasi-localized phase. Our extensive numerical study clarifies that the critical exponent of the Anderson transition between the metallic and quasi-localized phases, as well as that between the quasi-localized and localized phases, are different from that with no weak topological index, signaling the new universality classes induced by topology. The quasi-localized phase and concomitant topological Anderson transition manifest themselves in the anisotropic transport phenomena of disordered weak topological insulators and nodal-line semimetals, which exhibit the metallic behavior in one direction but the insulating behavior in the other directions.

categories: cond-mat.dis-nn cond-mat.mes-hall cond-mat.stat-mech cond-mat.supr-con


title: Protein language model rescue mutations highlight variant effects and structure in clinically relevant genes

abstract: Despite being self-supervised, protein language models have shown remarkable performance in fundamental biological tasks such as predicting impact of genetic variation on protein structure and function. The effectiveness of these models on diverse set of tasks suggests that they learn meaningful representations of fitness landscape that can be useful for downstream clinical applications. Here, we interrogate the use of these language models in characterizing known pathogenic mutations in curated, medically actionable genes through an exhaustive search of putative compensatory mutations on each variant's genetic background. Systematic analysis of the predicted effects of these compensatory mutations reveal unappreciated structural features of proteins that are missed by other structure predictors like AlphaFold. While deep mutational scan experiments provide an unbiased estimate of the mutational landscape, we encourage the community to generate and curate rescue mutation experiments to inform the design of more sophisticated co-masking strategies and leverage large language models more effectively for downstream clinical prediction tasks.


title: BDTS: Blockchain-based Data Trading System

abstract: Trading data through blockchain platforms is hard to achieve \textit{fair exchange}. Reasons come from two folds: Firstly, guaranteeing fairness between sellers and consumers is a challenging task as the deception of any participating parties is risk-free. This leads to the second issue where judging the behavior of data executors (such as cloud service providers) among distrustful parties is impractical in the context of traditional trading protocols. To fill the gaps, in this paper, we present a \underline{b}lockchain-based \underline{d}ata \underline{t}rading \underline{s}ystem, named BDTS. BDTS implements a fair-exchange protocol in which benign behaviors can get rewarded while dishonest behaviors will be punished. Our scheme requires the seller to provide consumers with the correct encryption keys for proper execution and encourage a rational data executor to behave faithfully for maximum benefits from rewards. We analyze the strategies of consumers, sellers, and dealers in the trading game and point out that everyone should be honest about their interests so that the game will reach Nash equilibrium. Evaluations prove efficiency and practicability.


title: Influential Recommender System

abstract: Traditional recommender systems are typically passive in that they try to adapt their recommendations to the user's historical interests. However, it is highly desirable for commercial applications, such as e-commerce, advertisement placement, and news portals, to be able to expand the users' interests so that they would accept items that they were not originally aware of or interested in to increase customer interactions. In this paper, we present Influential Recommender System (IRS), a new recommendation paradigm that aims to proactively lead a user to like a given objective item by progressively recommending to the user a sequence of carefully selected items (called an influence path). We propose the Influential Recommender Network (IRN), which is a Transformer-based sequential model to encode the items' sequential dependencies. Since different people react to external influences differently, we introduce the Personalized Impressionability Mask (PIM) to model how receptive a user is to external influence to generate the most effective influence path for the user. To evaluate IRN, we design several performance metrics to measure whether or not the influence path can smoothly expand the user interest to include the objective item while maintaining the user's satisfaction with the recommendation. Experimental results show that IRN significantly outperforms the baseline recommenders and demonstrates its capability of influencing users' interests.


title: 3d human motion generation from the text via gesture action classification and the autoregressive model

abstract: In this paper, a deep learning-based model for 3D human motion generation from the text is proposed via gesture action classification and an autoregressive model. The model focuses on generating special gestures that express human thinking, such as waving and nodding. To achieve the goal, the proposed method predicts expression from the sentences using a text classification model based on a pretrained language model and generates gestures using the gate recurrent unit-based autoregressive model. Especially, we proposed the loss for the embedding space for restoring raw motions and generating intermediate motions well. Moreover, the novel data augmentation method and stop token are proposed to generate variable length motions. To evaluate the text classification model and 3D human motion generation model, a gesture action classification dataset and action-based gesture dataset are collected. With several experiments, the proposed method successfully generates perceptually natural and realistic 3D human motion from the text. Moreover, we verified the effectiveness of the proposed method using a public-available action recognition dataset to evaluate cross-dataset generalization performance.


title: X-ray from Outflow-Cloud Interaction and Its Application in Tidal Disruption Events

abstract: Tidal disruption events (TDEs) may occur in supermassive black holes (SMBHs) surrounded by clouds. TDEs can generate ultrafast and large opening-angle outflow with a velocity of $\sim$ 0.01--0.2 c, which will collide with clouds with time lags depending on outflow velocity and cloud distances. Since the fraction of the outflow energy transferred into cloud's radiation is anti-correlated with the cloud density, high density clouds was thought to be inefficient in generating radiation. In this work, we studied the radiation from the outflow-cloud interactions for high density clouds, and found that thermal conduction plays crucial roles in increasing the cloud's radiation. Up to 10\% of the bow shock energy can be transferred into clouds and gives rise to X-ray emission with equivalent temperature of $10^{5-6}$ Kelvins due to the cooling catastrophe. The inverse Compton scattering of TDE UV/optical photons by relativistic electrons at bow shock generates power-law X-ray spectra with photon indices $\Gamma\sim 2-3$. This mechanism may account for some TDE candidates with delayed X-ray emission, and can be examined by delayed radio and gamma-ray emissions.


title: Holographic dense QCD in the Veneziano limit

abstract: Solving the properties of dense QCD matter is an extremely challenging problem because standard theoretical tools do not work at intermediate densities. The gauge/gravity duality may help to provide answers in this region. I give a brief review of recent progress in this field, focusing on the V-QCD model, which is one of the most sophisticated holographic models of QCD. I discuss predictions for the phase diagram, the equation of state, and properties of baryons. I apply these results to analyze the properties of neutron stars and to quark matter production in neutron star mergers.


title: Topological Metamaterials

abstract: One of the most significant breakthroughs in physics of the last decade has been the discovery that materials with non-trivial topological properties for electronic, electromagnetic, acoustic and mechanical responses can be designed and manufactured at our will through engineered metamaterials (MMs). Here, we review the foundation and the state-of-the-art advances of topological photonics, acoustics and mechanical MMs. We discuss how topological MMs enable nontrivial wave phenomena in physics, engineering, of great interest for a broad range of interdisciplinary science disciplines such as classical and quantum chemistry. We first introduce the foundations of topological materials and the main concepts behind their peculiar features, including the concepts of topological charge and geometric phase. We then discuss the topology of electronic band structures in natural topological materials, like topological insulators and gapless Dirac and Weyl semimetals. Based on these concepts, we review the concept, design and response of topologically nontrivial MMs in photonics and phononics, including topological phases in 2D MMs with and without time-reversal symmetry, Floquet TIs based on spatial and temporal modulation, topological phases in 3D MMs, higher-order topological phases in MMs, non-Hermitian and nonlinear topological MMs and the topological features of scattering anomalies. We also discuss the topological properties emerging in other related contexts, such as the topological aspects of chemical reactions and polaritons. This survey aims at connecting the recent advances in a broad range of scientific areas associated with topological concepts, and highlights opportunities offered by topological MMs for the chemistry community at large.


title: First wide field-of-view X-ray observations by a lobster eye focusing telescope in orbit

abstract: As a novel X-ray focusing technology, lobster eye micro-pore optics (MPO) feature both a wide observing field of view and true imaging capability, promising sky monitoring with significantly improved sensitivity and spatial resolution in soft X-rays. Since first proposed by Angel (1979), the optics have been extensively studied, developed and trialed over the past decades. In this Letter, we report on the first-light results from a flight experiment of the Lobster Eye Imager for Astronomy ($LEIA$), a pathfinder of the wide-field X-ray telescope of the Einstein Probe mission. The piggyback imager, launched in July 2022, has a mostly un-vignetted field of view of $18.6^\circ \times 18.6^\circ $. Its spatial resolution is in the range of 4$-$7 arcmin in FWHM and the focal spot effective area is 2$-$3 cm$^2$, both showing only mild fluctuations across the field of view. We present images of the Galactic center region, Sco X-1 and the diffuse Cygnus Loop nebular taken in snapshot observations over 0.5$-$4 keV. These are truly wide-field X-ray images of celestial bodies observed, for the first time, by a focusing imaging telescope. Initial analyses of the in-flight data show excellent agreement between the observed images and the on-ground calibration and simulations. The instrument and its characterization are briefly described, as well as the flight experiment. The results provide a solid basis for the development of the present and proposed wide-field X-ray missions using lobster eye MPO.


title: Confounder Balancing for Instrumental Variable Regression with Latent Variable

abstract: This paper studies the confounding effects from the unmeasured confounders and the imbalance of observed confounders in IV regression and aims at unbiased causal effect estimation. Recently, nonlinear IV estimators were proposed to allow for nonlinear model in both stages. However, the observed confounders may be imbalanced in stage 2, which could still lead to biased treatment effect estimation in certain cases. To this end, we propose a Confounder Balanced IV Regression (CB-IV) algorithm to jointly remove the bias from the unmeasured confounders and the imbalance of observed confounders. Theoretically, by redefining and solving an inverse problem for potential outcome function, we show that our CB-IV algorithm can unbiasedly estimate treatment effects and achieve lower variance. The IV methods have a major disadvantage in that little prior or theory is currently available to pre-define a valid IV in real-world scenarios. Thus, we study two more challenging settings without pre-defined valid IVs: (1) indistinguishable IVs implicitly present in observations, i.e., mixed-variable challenge, and (2) latent IVs don't appear in observations, i.e., latent-variable challenge. To address these two challenges, we extend our CB-IV by a latent-variable module, namely CB-IV-L algorithm. Extensive experiments demonstrate that our CB-IV(-L) outperforms the existing approaches.


title: Near extremal Khovanov homology of Turaev genus one links

abstract: The Turaev surface of a link diagram $D$ is a closed, oriented surface constructed from a cobordism between the all-$A$ and all-$B$ Kauffman states of $D$. The Turaev genus of a link $L$ is the minimum genus of the Turaev surface of any diagram $D$ of $L$. A link is alternating if and only if its Turaev genus is zero, and so one can view Turaev genus one links as being close to alternating links. In this paper, we study the Khovanov homology of a Turaev genus one link in the first and last two polynomial gradings where the homology is nontrivial. We show that a particular summand in the Khovanov homology of a Turaev genus one link is trivial. This trivial summand leads to a computation of the Rasmussen $s$ invariant and to bounds on the smooth four genus for certain Turaev genus one knots.


title: Model-independent search for anisotropies in stochastic gravitational-wave backgrounds and application to LIGO-Virgo's first three observing Runs

abstract: A stochastic gravitational-wave (GW) background consists of a large number of weak, independent and uncorrelated events of astrophysical or cosmological origin. The GW power on the sky is assumed to contain anisotropies on top of an isotropic component, i.e., the angular monopole. Complementary to the LIGO--Virgo--KAGRA (LVK) searches, we develop an efficient analysis pipeline to compute the maximum-likelihood anisotropic sky maps in stochastic backgrounds directly in the sky pixel domain using data folded over one sidereal day. We invert the full pixel-pixel correlation matrix in map-making of the GW sky, up to an optimal eigenmode cutoff decided systematically using simulations. In addition to modeled mapping, we implement a model-independent method to probe spectral shapes of stochastic backgrounds. Using data from LIGO--Virgo's first three observing runs, we obtain upper limits on anisotropies as well as the isotropic monopole as a limiting case, consistent with the LVK results. We also set constraints on the spectral shape of the stochastic background using this novel model-independent method.


title: Structural Quality Metrics to Evaluate Knowledge Graphs

abstract: This work presents six structural quality metrics that can measure the quality of knowledge graphs and analyzes five cross-domain knowledge graphs on the web (Wikidata, DBpedia, YAGO, Google Knowledge Graph, Freebase) as well as 'Raftel', Naver's integrated knowledge graph. The 'Good Knowledge Graph' should define detailed classes and properties in its ontology so that knowledge in the real world can be expressed abundantly. Also, instances and RDF triples should use the classes and properties actively. Therefore, we tried to examine the internal quality of knowledge graphs numerically by focusing on the structure of the ontology, which is the schema of knowledge graphs, and the degree of use thereof. As a result of the analysis, it was possible to find the characteristics of a knowledge graph that could not be known only by scale-related indicators such as the number of classes and properties.


title: A Tale of Two Cities: Data and Configuration Variances in Robust Deep Learning

abstract: Deep neural networks (DNNs), are widely used in many industries such as image recognition, supply chain, medical diagnosis, and autonomous driving. However, prior work has shown the high accuracy of a DNN model does not imply high robustness (i.e., consistent performances on new and future datasets) because the input data and external environment (e.g., software and model configurations) for a deployed model are constantly changing. Hence, ensuring the robustness of deep learning is not an option but a priority to enhance business and consumer confidence. Previous studies mostly focus on the data aspect of model variance. In this article, we systematically summarize DNN robustness issues and formulate them in a holistic view through two important aspects, i.e., data and software configuration variances in DNNs. We also provide a predictive framework to generate representative variances (counterexamples) by considering both data and configurations for robust learning through the lens of search-based optimization.


title: Active Learning by Query by Committee with Robust Divergences

abstract: Active learning is a widely used methodology for various problems with high measurement costs. In active learning, the next object to be measured is selected by an acquisition function, and measurements are performed sequentially. The query by committee is a well-known acquisition function. In conventional methods, committee disagreement is quantified by the Kullback--Leibler divergence. In this paper, the measure of disagreement is defined by the Bregman divergence, which includes the Kullback--Leibler divergence as an instance, and the dual $\gamma$-power divergence. As a particular class of the Bregman divergence, the $\beta$-divergence is considered. By deriving the influence function, we show that the proposed method using $\beta$-divergence and dual $\gamma$-power divergence are more robust than the conventional method in which the measure of disagreement is defined by the Kullback--Leibler divergence. Experimental results show that the proposed method performs as well as or better than the conventional method.