title: SAM-RL: Sensing-Aware Model-Based Reinforcement Learning via Differentiable Physics-Based Simulation and Rendering

abstract: Model-based reinforcement learning (MBRL) is recognized with the potential to be significantly more sample-efficient than model-free RL. How an accurate model can be developed automatically and efficiently from raw sensory inputs (such as images), especially for complex environments and tasks, is a challenging problem that hinders the broad application of MBRL in the real world. In this work, we propose a sensing-aware model-based reinforcement learning system called SAM-RL. Leveraging the differentiable physics-based simulation and rendering, SAM-RL automatically updates the model by comparing rendered images with real raw images and produces the policy efficiently. With the sensing-aware learning pipeline, SAM-RL allows a robot to select an informative viewpoint to monitor the task process. We apply our framework to real world experiments for accomplishing three manipulation tasks: robotic assembly, tool manipulation, and deformable object manipulation. We demonstrate the effectiveness of SAM-RL via extensive experiments. Videos are available on our project webpage at https://sites.google.com/view/rss-sam-rl.


title: White Hole Cosmology and Hawking Radiation from Quantum Cosmological Perturbations

abstract: The spacetime inside the white hole is like an anisotropic cosmological background with the past singularity playing the role of a big bang singularity. The scale factor along the extended spatial direction is contracting while the scale factor along the two-sphere is expanding. We consider an eternal Schwarzschild manifold and study quantum cosmological perturbations generated near the white hole singularity which propagate towards the past event horizon and to exterior of the black hole. It is shown that an observer deep inside the white hole and an observer far outside the black hole both share the same vacuum. We calculate the Hawking radiation associated to these quantum white hole perturbations as measured by an observer in the exterior of the black hole. Furthermore, we also consider the Hawking radiation for the general case where the initial cosmological perturbations deep inside the white hole are in "non-vacuum" state yielding to a deviation from Planck distribution. This analysis suggests that if the black hole is not entirely black (due to Hawking radiation) then the white hole is not entirely white either.


title: Learning Joint Representation of Human Motion and Language

abstract: In this work, we present MoLang (a Motion-Language connecting model) for learning joint representation of human motion and language, leveraging both unpaired and paired datasets of motion and language modalities. To this end, we propose a motion-language model with contrastive learning, empowering our model to learn better generalizable representations of the human motion domain. Empirical results show that our model learns strong representations of human motion data through navigating language modality. Our proposed method is able to perform both action recognition and motion retrieval tasks with a single model where it outperforms state-of-the-art approaches on a number of action recognition benchmarks.


title: Quantum resetting in continuous measurement induced dynamics of a qubit

abstract: We study the evolution of a two-state system that is monitored continuously but with interactions with the detector tuned so as to avoid the Zeno affect. The system is allowed to interact with a sequence of prepared probes. The post-interaction probe states are measured and this leads to a stochastic evolution of the system's state vector, which can be described by a single angle variable. The system's effective evolution consists of a deterministic drift and a stochastic resetting to a fixed state at a rate that depends on the instantaneous state vector. The detector readout is a counting process. We obtain analytic results for the distribution of number of detector events and the time-evolution of the probability distribution. Earlier work on this model found transitions in the form of the steady state on increasing the measurement rate. Here we study transitions seen in the dynamics. As a spin-off we obtain, for a general stochastic resetting process with diffusion, drift and position dependent jump rates, an exact and general solution for the evolution of the probability distribution.


title: Partially Oblivious Neural Network Inference

abstract: Oblivious inference is the task of outsourcing a ML model, like neural-networks, without disclosing critical and sensitive information, like the model's parameters. One of the most prominent solutions for secure oblivious inference is based on a powerful cryptographic tools, like Homomorphic Encryption (HE) and/or multi-party computation (MPC). Even though the implementation of oblivious inference systems schemes has impressively improved the last decade, there are still significant limitations on the ML models that they can practically implement. Especially when both the ML model and the input data's confidentiality must be protected. In this paper, we introduce the notion of partially oblivious inference. We empirically show that for neural network models, like CNNs, some information leakage can be acceptable. We therefore propose a novel trade-off between security and efficiency. In our research, we investigate the impact on security and inference runtime performance from the CNN model's weights partial leakage. We experimentally demonstrate that in a CIFAR-10 network we can leak up to $80\%$ of the model's weights with practically no security impact, while the necessary HE-mutliplications are performed four times faster.


title: The center of Hecke algebras of types

abstract: We describe the center of the Hecke algebra of a type attached to a Bernstein block under some hypothesis. When $\bf G$ is a connected reductive group over non-archimedean local field $F$ that splits over a tamely ramified extension of $F$ and the residue characteristic of $F$ does not divide the order of the absolute Weyl group of $\bf G$, the works of Kim-Yu and Fintzen associate a type to each Bernstein block and our hypothesis is satisfied for such types. We use our results to give a description of the Bernstein center of the Hecke algebra $\mathcal{H}({\bf G } (F),K)$ when $K$ belongs to a nice family of compact open subgroups of ${\bf G}(F)$ (which includes all the Moy-Prasad filtrations of an Iwahori subgroup) via the theory of types.


title: Truncation Sampling as Language Model Desmoothing

abstract: Long samples of text from neural language models can be of poor quality. Truncation sampling algorithms--like top-$p$ or top-$k$ -- address this by setting some words' probabilities to zero at each step. This work provides framing for the aim of truncation, and an improved algorithm for that aim. We propose thinking of a neural language model as a mixture of a true distribution and a smoothing distribution that avoids infinite perplexity. In this light, truncation algorithms aim to perform desmoothing, estimating a subset of the support of the true distribution. Finding a good subset is crucial: we show that top-$p$ unnecessarily truncates high-probability words, for example causing it to truncate all words but Trump for a document that starts with Donald. We introduce $\eta$-sampling, which truncates words below an entropy-dependent probability threshold. Compared to previous algorithms, $\eta$-sampling generates more plausible long English documents according to humans, is better at breaking out of repetition, and behaves more reasonably on a battery of test distributions.


title: Monte Carlo method for parabolic equations involving fractional Laplacian

abstract: We apply the Monte Carlo method to solving the Dirichlet problem of linear parabolic equations with fractional Laplacian. This method exploit- s the idea of weak approximation of related stochastic differential equations driven by the symmetric stable L\'evy process with jumps. We utilize the jump- adapted scheme to approximate L\'evy process which gives exact exit time to the boundary. When the solution has low regularity, we establish a numeri- cal scheme by removing the small jumps of the L\'evy process and then show the convergence order. When the solution has higher regularity, we build up a higher-order numerical scheme by replacing small jumps with a simple process and then display the higher convergence order. Finally, numerical experiments including ten- and one hundred-dimensional cases are presented, which confirm the theoretical estimates and show the numerical efficiency of the proposed schemes for high dimensional parabolic equations.


title: A framework of distributionally robust possibilistic optimization

abstract: In this paper, an optimization problem with uncertain constraint coefficients is considered. Possibility theory is used to model the uncertainty. Namely, a joint possibility distribution in constraint coefficient realizations, called scenarios, is specified. This possibility distribution induces a necessity measure in scenario set, which in turn describes an ambiguity set of probability distributions in scenario set. The distributionally robust approach is then used to convert the imprecise constraints into deterministic equivalents. Namely, the left-hand side of an imprecise constraint is evaluated by using a risk measure with respect to the worst probability distribution that can occur. In this paper, the Conditional Value at Risk is used as the risk measure, which generalizes the strict robust and expected value approaches, commonly used in literature. A general framework for solving such a class of problems is described. Some cases which can be solved in polynomial time are identified.


title: Few-shot Image Generation via Masked Discrimination

abstract: Few-shot image generation aims to generate images of high quality and great diversity with limited data. However, it is difficult for modern GANs to avoid overfitting when trained on only a few images. The discriminator can easily remember all the training samples and guide the generator to replicate them, leading to severe diversity degradation. Several methods have been proposed to relieve overfitting by adapting GANs pre-trained on large source domains to target domains using limited real samples. This work presents a novel approach to realize few-shot GAN adaptation via masked discrimination. Random masks are applied to features extracted by the discriminator from input images. We aim to encourage the discriminator to judge various images which share partially common features with training samples as realistic. Correspondingly, the generator is guided to generate diverse images instead of replicating training samples. In addition, we employ a cross-domain consistency loss for the discriminator to keep relative distances between generated samples in its feature space. It strengthens global image discrimination and guides adapted GANs to preserve more information learned from source domains for higher image quality. The effectiveness of our approach is demonstrated both qualitatively and quantitatively with higher quality and greater diversity on a series of few-shot image generation tasks than prior methods.


title: Masked Autoencoders Are Articulatory Learners

abstract: Articulatory recordings track the positions and motion of different articulators along the vocal tract and are widely used to study speech production and to develop speech technologies such as articulatory based speech synthesizers and speech inversion systems. The University of Wisconsin X-Ray microbeam (XRMB) dataset is one of various datasets that provide articulatory recordings synced with audio recordings. The XRMB articulatory recordings employ pellets placed on a number of articulators which can be tracked by the microbeam. However, a significant portion of the articulatory recordings are mistracked, and have been so far unsuable. In this work, we present a deep learning based approach using Masked Autoencoders to accurately reconstruct the mistracked articulatory recordings for 41 out of 47 speakers of the XRMB dataset. Our model is able to reconstruct articulatory trajectories that closely match ground truth, even when three out of eight articulators are mistracked, and retrieve 3.28 out of 3.4 hours of previously unusable recordings.


title: HRTF Field: Unifying Measured HRTF Magnitude Representation with Neural Fields

abstract: Head-related transfer functions (HRTFs) are a set of functions describing the spatial filtering effect of the outer ear (i.e., torso, head, and pinnae) onto sound sources at different azimuth and elevation angles. They are widely used in spatial audio rendering. While the azimuth and elevation angles are intrinsically continuous, measured HRTFs in existing datasets employ different spatial sampling schemes, making it difficult to model HRTFs across datasets. In this work, we propose to use neural fields, a differentiable representation of functions through neural networks, to model HRTFs with arbitrary spatial sampling schemes. Such representation is unified across datasets with different spatial sampling schemes. HRTFs for arbitrary azimuth and elevation angles can be derived from this representation. We further introduce a generative model named HRTF field to learn the latent space of the HRTF neural fields across subjects. We demonstrate promising performance on HRTF interpolation and generation tasks and point out potential future work.


title: Utilizing bifurcations to separate particles in spiral inertial microfluidics

abstract: Particles suspended in fluid flow through a closed duct can focus to specific stable locations in the duct cross-section due to hydrodynamic forces arising from the inertia of the disturbed fluid. Such particle focusing is exploited in biomedical and industrial technologies to separate particles by size. In curved ducts, the particle focusing is a result of balance between two dominant forces on the particle: (i) inertial lift arising from small inertia of the fluid, and (ii) drag arising from cross-sectional vortices induced by the centrifugal force on the fluid. Bifurcations of particle equilibria take place as the bend radius of the curved duct varies. By using the mathematical model of Harding, Stokes, and Bertozzi [1], we illustrate via numerical simulations that these bifurcations can be leveraged in a spiral duct to achieve large separation between different sized particles by transiently focusing smaller particles near saddle-points. We demonstrate this by separating similar-sized particles, as well as particles that have a large difference in size, using spiral ducts with square cross-section. The formalism of using bifurcations to manipulate particle focusing can be applied more broadly to different geometries in inertial microfluidics which may open new avenues in particle separation techniques.


title: Watermarking for Out-of-distribution Detection

abstract: Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully unleash their intrinsic strength: without modifying parameters of a well-trained deep model, we can reprogram this model for a new purpose via data-level manipulation (e.g., adding a specific feature perturbation to the data). This property motivates us to reprogram a classification model to excel at OOD detection (a new task), and thus we propose a general methodology named watermarking in this paper. Specifically, we learn a unified pattern that is superimposed onto features of original data, and the model's detection capability is largely boosted after watermarking. Extensive experiments verify the effectiveness of watermarking, demonstrating the significance of the reprogramming property of deep models in OOD detection.


title: Characterising the Robustness of Reinforcement Learning for Continuous Control using Disturbance Injection

abstract: In this study, we leverage the deliberate and systematic fault-injection capabilities of an open-source benchmark suite to perform a series of experiments on state-of-the-art deep and robust reinforcement learning algorithms. We aim to benchmark robustness in the context of continuous action spaces -- crucial for deployment in robot control. We find that robustness is more prominent for action disturbances than it is for disturbances to observations and dynamics. We also observe that state-of-the-art approaches that are not explicitly designed to improve robustness perform at a level comparable to that achieved by those that are. Our study and results are intended to provide insight into the current state of safe and robust reinforcement learning and a foundation for the advancement of the field, in particular, for deployment in robotic systems.


title: Deep-MDS Framework for Recovering the 3D Shape of 2D Landmarks from a Single Image

abstract: In this paper, a low parameter deep learning framework utilizing the Non-metric Multi-Dimensional scaling (NMDS) method, is proposed to recover the 3D shape of 2D landmarks on a human face, in a single input image. Hence, NMDS approach is used for the first time to establish a mapping from a 2D landmark space to the corresponding 3D shape space. A deep neural network learns the pairwise dissimilarity among 2D landmarks, used by NMDS approach, whose objective is to learn the pairwise 3D Euclidean distance of the corresponding 2D landmarks on the input image. This scheme results in a symmetric dissimilarity matrix, with the rank larger than 2, leading the NMDS approach toward appropriately recovering the 3D shape of corresponding 2D landmarks. In the case of posed images and complex image formation processes like perspective projection which causes occlusion in the input image, we consider an autoencoder component in the proposed framework, as an occlusion removal part, which turns different input views of the human face into a profile view. The results of a performance evaluation using different synthetic and real-world human face datasets, including Besel Face Model (BFM), CelebA, CoMA - FLAME, and CASIA-3D, indicates the comparable performance of the proposed framework, despite its small number of training parameters, with the related state-of-the-art and powerful 3D reconstruction methods from the literature, in terms of efficiency and accuracy.


title: Multi-view Contrastive Learning with Additive Margin for Adaptive Nasopharyngeal Carcinoma Radiotherapy Prediction

abstract: The prediction of adaptive radiation therapy (ART) prior to radiation therapy (RT) for nasopharyngeal carcinoma (NPC) patients is important to reduce toxicity and prolong the survival of patients. Currently, due to the complex tumor micro-environment, a single type of high-resolution image can provide only limited information. Meanwhile, the traditional softmax-based loss is insufficient for quantifying the discriminative power of a model. To overcome these challenges, we propose a supervised multi-view contrastive learning method with an additive margin (MMCon). For each patient, four medical images are considered to form multi-view positive pairs, which can provide additional information and enhance the representation of medical images. In addition, the embedding space is learned by means of contrastive learning. NPC samples from the same patient or with similar labels will remain close in the embedding space, while NPC samples with different labels will be far apart. To improve the discriminative ability of the loss function, we incorporate a margin into the contrastive learning. Experimental result show this new learning objective can be used to find an embedding space that exhibits superior discrimination ability for NPC images.


title: A Survey on Parallelism and Determinism

abstract: Parallelism is often required for performance. In these situations an excess of non-determinism is harmful as it means the program can have several different behaviours or even different results. Even in domains such as high-performance computing where parallelism is crucial for performance, the computed value should be deterministic. Unfortunately, non-determinism in programs also allows dynamic scheduling of tasks, reacting to the first task that succeeds, cancelling tasks that cannot lead to a result, etc. Non-determinism is thus both a desired asset or an undesired property depending on the situation. In practice, it is often necessary to limit non-determinism and to identify precisely the sources of non-determinism in order to control what parts of a program are deterministic or not. This survey takes the perspective of programming languages, and studies how programming models can ensure the determinism of parallel programs. This survey studies not only deterministic languages but also programming models that prevent one particularly demanding source of non-determinism: data races. Our objective is to compare existing solutions to the following questions: How programming languages can help programmers write programs that run in a parallel manner without visible non-determinism? What programming paradigms ensure this kind of properties? We study these questions and discuss the merits and limitations of different approaches.


title: Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System

abstract: Unmanned aerial vehicles (UAVs) can be applied in many Internet of Things (IoT) systems, e.g., smart farms, as a data collection platform. However, the UAV-IoT wireless channels may be occasionally blocked by trees or high-rise buildings. An intelligent reflecting surface (IRS) can be applied to improve the wireless channel quality by smartly reflecting the signal via a large number of low-cost passive reflective elements. This article aims to minimize the energy consumption of the system by jointly optimizing the deployment and trajectory of the UAV. The problem is formulated as a mixed-integer-and-nonlinear programming (MINLP), which is challenging to address by the traditional solution, because the solution may easily fall into the local optimal. To address this issue, we propose a joint optimization framework of deployment and trajectory (JOLT), where an adaptive whale optimization algorithm (AWOA) is applied to optimize the deployment of the UAV, and an elastic ring self-organizing map (ERSOM) is introduced to optimize the trajectory of the UAV. Specifically, in AWOA, a variable-length population strategy is applied to find the optimal number of stop points, and a nonlinear parameter a and a partial mutation rule are introduced to balance the exploration and exploitation. In ERSOM, a competitive neural network is also introduced to learn the trajectory of the UAV by competitive learning, and a ring structure is presented to avoid the trajectory intersection. Extensive experiments are carried out to show the effectiveness of the proposed JOLT framework.


title: On the Steady Navier-Stokes system with Navier slip boundary conditions in two-dimensional channels

abstract: In this paper, we investigate the incompressible steady Navier-Stokes system with Navier slip boundary condition in a two-dimensional channel. As long as the width of cross-section of the channel grows more slowly than the linear growth, the existence of solutions with arbitrary flux is established. Furthermore, if the flux is suitably small, the solution is unique even when the width of the channel is unbounded, and approaches to the shear flows at far field where the channels tend to be straight at far fields. One of the major difficulties for the analysis on flows with Navier boundary conditions is that the tangential velocity may not be zero on the boundary so that we have to study the behavior of solutions near the boundary carefully. The crucial ingredients of analysis include the construction of an appropriate flux carrier, and the detailed analysis for the flow behavior near boundary via combining a Hardy type inequality for normal component of velocity and the divergence free property of the velocity.


title: Torque Controlled Locomotion of a Biped Robot with Link Flexibility

abstract: When a big and heavy robot moves, it exerts large forces on the environment and on its own structure, its angular momentum can varysubstantially, and even the robot's structure can deform if there is a mechanical weakness. Under these conditions, standard locomotion controllers can fail easily. In this article, we propose a complete control scheme to work with heavy robots in torque control. The full centroidal dynamics is used to generate walking gaits online, link deflections are taken into account to estimate the robot posture and all postural instructions are designed to avoid conflicting with each other, improving balance. These choices reduce model and control errors, allowing our centroidal stabilizer to compensate for the remaining residual errors. The stabilizer and motion generator are designed together to ensure feasibility under the assumption of bounded errors. We deploy this scheme to control the locomotion of the humanoid robot Talos, whose hip links flex when walking. It allows us to reach steps of 35~cm, for an average speed of 25~cm/sec, which is among the best performances so far for torque-controlled electric robots.


title: Learning on the Job: Self-Rewarding Offline-to-Online Finetuning for Industrial Insertion of Novel Connectors from Vision

abstract: Learning-based methods in robotics hold the promise of generalization, but what can be done if a learned policy does not generalize to a new situation? In principle, if an agent can at least evaluate its own success (i.e., with a reward classifier that generalizes well even when the policy does not), it could actively practice the task and finetune the policy in this situation. We study this problem in the setting of industrial insertion tasks, such as inserting connectors in sockets and setting screws. Existing algorithms rely on precise localization of the connector or socket and carefully managed physical setups, such as assembly lines, to succeed at the task. But in unstructured environments such as homes or even some industrial settings, robots cannot rely on precise localization and may be tasked with previously unseen connectors. Offline reinforcement learning on a variety of connector insertion tasks is a potential solution, but what if the robot is tasked with inserting previously unseen connector? In such a scenario, we will still need methods that can robustly solve such tasks with online practice. One of the main observations we make in this work is that, with a suitable representation learning and domain generalization approach, it can be significantly easier for the reward function to generalize to a new but structurally similar task (e.g., inserting a new type of connector) than for the policy. This means that a learned reward function can be used to facilitate the finetuning of the robot's policy in situations where the policy fails to generalize in zero shot, but the reward function generalizes successfully. We show that such an approach can be instantiated in the real world, pretrained on 50 different connectors, and successfully finetuned to new connectors via the learned reward function. Videos can be viewed at https://sites.google.com/view/learningonthejob


title: Towards the convergent therapeutic potential of GPCRs in autism spectrum disorders

abstract: Changes in genetic and/or environmental factors to developing neural circuits and subsequent synaptic functions are known to be a causative underlying the varied socio-emotional behavioural patterns associated with autism spectrum disorders (ASD). Seven transmembrane G protein-coupled receptors (GPCRs) comprising the largest family of cell-surface receptors, mediate the transfer of extracellular signals to downstream cellular responses. Disruption of GPCR and their signalling have been implicated as a convergent pathologic mechanism of ASD. Here, we aim to review the literature about the 23 GPCRs that are genetically associated to ASD pathology according to Simons Foundation Autism Research Initiative (SFARI) database such as oxytocin (OXTR) and vasopressin (V1A, V1B) receptors, metabotropic glutamate (mGlu5, mGlu7) and gamma-aminobutyric acid (GABAB) receptors, dopamine (D1, D2), serotoninergic (5-HT1B and additionally included the 5-HT2A, 5-HT7 receptors for their strong relevance to ASD), adrenergic ($\beta$2) and cholinergic (M3) receptors, adenosine (A2A, A3) receptors, angiotensin (AT2) receptors, cannabinoid (CB1) receptors, chemokine (CX3CR1) receptors, orphan (GPR37, GPR85) and olfactory (OR1C1, OR2M4, OR2T10, OR52M1) receptors. We discussed the genetic variants, relation to core ASD behavioural deficits and update on pharmacological compounds targeting these 23 GPCRs. Of these OTR, V1A, mGlu5, D2, 5-HT2A, CB1, and GPR37 serve as the best therapeutic targets and have potential towards core domains of ASD pathology. With a functional crosstalk between different GPCRs and converging pharmacological responses, there is an urge to develop novel therapeutic strategies based on multiple GPCRs to reduce the socioeconomic burden associated with ASD and we strongly emphasize the need to prioritize the increased clinical trials targeting the multiple GPCRs.


title: General Solutions of Einstein Gravity at $D\rightarrow 2$

abstract: Einstein gravity at $D\rightarrow 2$ limit can be obtained from the Kaluza-Klein procedure by taking the dimensions of the internal space to zero while keeping only the breathing mode. The resulting scalar-tensor theory can be further reduced to JT gravity or the Liouville CFT at the large central charge limit, bridging the two important 2d models. We study the general solutions of the theory, including black holes and wormholes for both positive and negative cosmological constants. We obtain the on-shell action of the nearly AdS$_2$ and show that for suitable boundary slices, the Schwarzian action governs the leading-order dynamics at the finite boundary cutoff in later time. For positive cosmological constant, we find that the scalar is well defined on the 2-sphere.


title: Timed Alignments with Mixed Moves

abstract: The subject of this paper is to study conformance checking for timed models, that is, process models that consider both the sequence of events in a process as well as the timestamps at which each event is recorded. Time-aware process mining is a growing subfield of research, and as tools that seek to discover timing related properties in processes develop, so does the need for conformance checking techniques that can tackle time constraints and provide insightful quality measures for time-aware process models. In particular, one of the most useful conformance artefacts is the alignment, that is, finding the minimal changes necessary to correct a new observation to conform to a process model. This paper follows a previous one, where we have set our problem of timed alignment. In the present paper, we solve the case where the metrics used to compare timed processes allows mixed moves, i.e. an error on the timestamp of an event may or may not have propagated to its successors, and provide linear time algorithms for distance computation and alignment on models with sequential causal processes.


title: The signaling dimension of physical systems

abstract: The signaling dimension of a physical system is the minimum dimension of a classical channel that can reproduce the set of input-output correlations attainable by the given system. Here we put the signaling dimension into perspective by reviewing some of the main known results on the topic, starting from Frenkel and Weiner's 2015 breakthrough showing that the signaling dimension of any quantum system is equal to its Hilbert space dimension.


title: Joint probability calculation of the lateral velocity distribution in strong field ionization process

abstract: We describe an approach to the description of the time-development of the process of strong field ionization of atoms based on the calculation of the joint probability of occurrence of two events, event B being finding atom in the ionized state after the end of the laser pulse, event A being finding a particular value of a given physical observable at a moment of time inside the laser pulse duration. As an example of such an physical observable we consider lateral velocity component of the electron's velocity. Our approach allows us to study time-evolution of the lateral velocity distribution for the ionized electron during the interval of the laser pulse duration. We present results of such a study for the cases of target atomic systems with short range Yukawa and Coulomb interactions.


title: COCO-DR: Combating Distribution Shifts in Zero-Shot Dense Retrieval with Contrastive and Distributionally Robust Learning

abstract: We present a new zero-shot dense retrieval (ZeroDR) method, COCO-DR, to improve the generalization ability of dense retrieval by combating the distribution shifts between source training tasks and target scenarios. To mitigate the impact of document differences, COCO-DR continues pretraining the language model on the target corpora to adapt the model to target distributions via COtinuous COtrastive learning. To prepare for unseen target queries, COCO-DR leverages implicit Distributionally Robust Optimization (iDRO) to reweight samples from different source query clusters for improving model robustness over rare queries during fine-tuning. COCO-DR achieves superior average performance on BEIR, the zero-shot retrieval benchmark. At BERT Base scale, COCO-DR Base outperforms other ZeroDR models with 60x larger size. At BERT Large scale, COCO-DR Large outperforms the giant GPT-3 embedding model which has 500x more parameters. Our analysis show the correlation between COCO-DR's effectiveness in combating distribution shifts and improving zero-shot accuracy. Our code and model can be found at \url{https://github.com/OpenMatch/COCO-DR}.


title: Superluminal propagation from IR physics

abstract: One may believe that front velocities of waves in a given theory coincide with the UV limit of phase velocities for any dispersion relations. This implies that IR physics is irrelevant to the discussion of propagation speed of waves. We first consider a theory that contains higher spatial derivatives in the wave equation and prove that front velocities coincide with the UV limit of phase velocities, at least, if parity is conserved. However, we also show that front velocities do not coincide with the UV limit of phase velocities in general dispersion relations. We explicitly give several examples in which front velocities are superluminal owing to an IR or intermediate energy scale property of dispersion relations even if the UV limit of phase velocities is luminal. Our finding conveys the important caution that not only UV physics but also IR physics can be significant to superluminality.


title: Trust and Believe -- Should We? Evaluating the Trustworthiness of Twitter Users

abstract: Social networking and micro-blogging services, such as Twitter, play an important role in sharing digital information. Despite the popularity and usefulness of social media, they are regularly abused by corrupt users. One of these nefarious activities is so-called fake news -- a "virus" that has been spreading rapidly thanks to the hospitable environment provided by social media platforms. The extensive spread of fake news is now becoming a major problem with far-reaching negative repercussions on both individuals and society. Hence, the identification of fake news on social media is a problem of utmost importance that has attracted the interest not only of the research community but most of the big players on both sides - such as Facebook, on the industry side, and political parties on the societal one. In this work, we create a model through which we hope to be able to offer a solution that will instill trust in social network communities. Our model analyses the behaviour of 50,000 politicians on Twitter and assigns an influence score for each evaluated user based on several collected and analysed features and attributes. Next, we classify political Twitter users as either trustworthy or untrustworthy using random forest and support vector machine classifiers. An active learning model has been used to classify any unlabeled ambiguous records from our dataset. Finally, to measure the performance of the proposed model, we used accuracy as the main evaluation metric.


title: Single photon detection performance of highly disordered NbTiN thin films

abstract: We experimentally investigated the detection performance of highly disordered NbxTi1-xN based superconducting nanowire single photon detectors (SNSPDs). The dependence on the composition of the transition temperature Tc for NbxTi1-xN films show a dome-like behavior on the Nb content, with a maximal Tc at xNb~0.65 , and the Nb0.65Ti0.35N films also combine relatively large sheet resistance and intermediate residual resistivity ratio. Moreover, 60-nm-wide and 7-nm-thick Nb0.65Ti0.35N nanowires show a switching current as high as 14.5 uA, and saturated intrinsic detection efficiency with a plateau of more than 2 uA at 2.4 K. Finally, the corresponding SNSPDs on an alternative SiO2/Ta2O5 dielectric mirror showed a system detection efficiency of approximately 92% for 1550 nm photons, and the timing jitter is around 26 ps. Our results demonstrate that the highly disordered NbxTi1-xN films are promising for fabricating SNSPDs for near- and middle-infrared single photons with high detection efficiency and low timing jitter.


title: Beamforming Design for Integrated Sensing and Wireless Power Transfer Systems

abstract: This letter proposes a new concept of integrated sensing and wireless power transfer (ISWPT), where radar sensing and wireless power transfer functions are integrated into one hardware platform. ISWPT provides several benefits from the integrating operation such as system size, hardware cost, power consumption, and spectrum saving, which is envisioned to facilitate future 6G wireless networks. As the initial study, we aim to characterizing the fundamental trade-off between radar sensing and wireless power transfer, by optimizing transmit beamforming vectors. We first propose a semi-definite relaxation-based approach to solve the corresponding optimization problem globally optimal, and then provide a low-complexity sub-optimal solution. Finally, numerical results verify the effectiveness of our proposed solutions, and also show the trade-off between radar sensing and wireless power transfer.


title: Absence of Lavrentiev's gap for anisotropic functionals

abstract: We establish the absence of the Lavrentiev gap between Sobolev and smooth maps for a non-autonomous variational problem of a general structure, where the integrand is assumed to be controlled by a function which is convex and anisotropic with respect to the last variable. This fact results from new results on good approximation properties of the natural underlying unconventional function space. Scalar and vector-valued problems are studied.


title: Development of a jet gas target system for the Felsenkeller underground accelerator

abstract: For direct cross-section measurements in nuclear astrophysics, in addition to suitable ion beams and detectors, also highly pure and stable targets are needed. Here, using a gas jet as a target offers an attractive approach that combines high stability even under significant beam load with excellent purity and high localisation. Such a target is currently under construction at the Felsenkeller underground ion accelerator lab for nuclear astrophysics in Dresden, Germany. The target thickness will be measured by optical interferometry, allowing an in-situ thickness determination including also beam-induced effects. The contribution reports on the status of this new system and outlines possible applications in nuclear astrophysics.


title: Parsing linearizations appreciate PoS tags - but some are fussy about errors

abstract: PoS tags, once taken for granted as a useful resource for syntactic parsing, have become more situational with the popularization of deep learning. Recent work on the impact of PoS tags on graph- and transition-based parsers suggests that they are only useful when tagging accuracy is prohibitively high, or in low-resource scenarios. However, such an analysis is lacking for the emerging sequence labeling parsing paradigm, where it is especially relevant as some models explicitly use PoS tags for encoding and decoding. We undertake a study and uncover some trends. Among them, PoS tags are generally more useful for sequence labeling parsers than for other paradigms, but the impact of their accuracy is highly encoding-dependent, with the PoS-based head-selection encoding being best only when both tagging accuracy and resource availability are high.


title: End-to-End Pareto Set Prediction with Graph Neural Networks for Multi-objective Facility Location

abstract: The facility location problems (FLPs) are a typical class of NP-hard combinatorial optimization problems, which are widely seen in the supply chain and logistics. Many mathematical and heuristic algorithms have been developed for optimizing the FLP. In addition to the transportation cost, there are usually multiple conflicting objectives in realistic applications. It is therefore desirable to design algorithms that find a set of Pareto solutions efficiently without enormous search cost. In this paper, we consider the multi-objective facility location problem (MO-FLP) that simultaneously minimizes the overall cost and maximizes the system reliability. We develop a learning-based approach to predicting the distribution probability of the entire Pareto set for a given problem. To this end, the MO-FLP is modeled as a bipartite graph optimization problem and two graph neural networks are constructed to learn the implicit graph representation on nodes and edges. The network outputs are then converted into the probability distribution of the Pareto set, from which a set of non-dominated solutions can be sampled non-autoregressively. Experimental results on MO-FLP instances of different scales show that the proposed approach achieves a comparable performance to a widely used multi-objective evolutionary algorithm in terms of the solution quality while significantly reducing the computational cost for search.


title: TASA: Deceiving Question Answering Models by Twin Answer Sentences Attack

abstract: We present Twin Answer Sentences Attack (TASA), an adversarial attack method for question answering (QA) models that produces fluent and grammatical adversarial contexts while maintaining gold answers. Despite phenomenal progress on general adversarial attacks, few works have investigated the vulnerability and attack specifically for QA models. In this work, we first explore the biases in the existing models and discover that they mainly rely on keyword matching between the question and context, and ignore the relevant contextual relations for answer prediction. Based on two biases above, TASA attacks the target model in two folds: (1) lowering the model's confidence on the gold answer with a perturbed answer sentence; (2) misguiding the model towards a wrong answer with a distracting answer sentence. Equipped with designed beam search and filtering methods, TASA can generate more effective attacks than existing textual attack methods while sustaining the quality of contexts, in extensive experiments on five QA datasets and human evaluations.


title: Topologically protected boundary discrete time crystal for a solvable model

abstract: Floquet time crystal, which breaks discrete time-translation symmetry, is an intriguing phenomenon in non-equilibrium systems. It is crucial to understand the rigidity and robustness of discrete time crystal (DTC) phases in a many-body system, and finding a precisely solvable model can pave a way for understanding of the DTC phase. Here, we propose and study a solvable spin chain model by mapping it to a Floquet superconductor through the Jordan-Wigner transformation. The phase diagrams of Floquet topological systems are characterized by topological invariants and tell the existence of anomalous edge states. The sub-harmonic oscillation, which is the typical signal of the DTC, can be generated from such edge states and protected by topology. We also examine the robustness of the DTC by adding symmetry-preserving and symmetry-breaking perturbations. Our results on topologically protected DTC can provide a deep understanding of the DTC when generalized to other interacting or dissipative systems.


title: Lattices of flats for symplectic matroids

abstract: We present a construction of $C_n$ lattices corresponding to a class of ranked symplectic matroids, providing a new way of constructing symplectic matroids. We proceed to prove a few properties of these lattices, the main two being shellability and a characterization by atom orderings.


title: The Effect of Normalization for Bi-directional Amharic-English Neural Machine Translation

abstract: Machine translation (MT) is one of the main tasks in natural language processing whose objective is to translate texts automatically from one natural language to another. Nowadays, using deep neural networks for MT tasks has received great attention. These networks require lots of data to learn abstract representations of the input and store it in continuous vectors. This paper presents the first relatively large-scale Amharic-English parallel sentence dataset. Using these compiled data, we build bi-directional Amharic-English translation models by fine-tuning the existing Facebook M2M100 pre-trained model achieving a BLEU score of 37.79 in Amharic-English 32.74 in English-Amharic translation. Additionally, we explore the effects of Amharic homophone normalization on the machine translation task. The results show that the normalization of Amharic homophone characters increases the performance of Amharic-English machine translation in both directions.


title: BERT-Flow-VAE: A Weakly-supervised Model for Multi-Label Text Classification

abstract: Multi-label Text Classification (MLTC) is the task of categorizing documents into one or more topics. Considering the large volumes of data and varying domains of such tasks, fully supervised learning requires manually fully annotated datasets which is costly and time-consuming. In this paper, we propose BERT-Flow-VAE (BFV), a Weakly-Supervised Multi-Label Text Classification (WSMLTC) model that reduces the need for full supervision. This new model (1) produces BERT sentence embeddings and calibrates them using a flow model, (2) generates an initial topic-document matrix by averaging results of a seeded sparse topic model and a textual entailment model which only require surface name of topics and 4-6 seed words per topic, and (3) adopts a VAE framework to reconstruct the embeddings under the guidance of the topic-document matrix. Finally, (4) it uses the means produced by the encoder model in the VAE architecture as predictions for MLTC. Experimental results on 6 multi-label datasets show that BFV can substantially outperform other baseline WSMLTC models in key metrics and achieve approximately 84% performance of a fully-supervised model.


title: Iterative pseudo-forced alignment by acoustic CTC loss for self-supervised ASR domain adaptation

abstract: High-quality data labeling from specific domains is costly and human time-consuming. In this work, we propose a self-supervised domain adaptation method, based upon an iterative pseudo-forced alignment algorithm. The produced alignments are employed to customize an end-to-end Automatic Speech Recognition (ASR) and iteratively refined. The algorithm is fed with frame-wise character posteriors produced by a seed ASR, trained with out-of-domain data, and optimized throughout a Connectionist Temporal Classification (CTC) loss. The alignments are computed iteratively upon a corpus of broadcast TV. The process is repeated by reducing the quantity of text to be aligned or expanding the alignment window until finding the best possible audio-text alignment. The starting timestamps, or temporal anchors, are produced uniquely based on the confidence score of the last aligned utterance. This score is computed with the paths of the CTC-alignment matrix. With this methodology, no human-revised text references are required. Alignments from long audio files with low-quality transcriptions, like TV captions, are filtered out by confidence score and ready for further ASR adaptation. The obtained results, on both the Spanish RTVE2022 and CommonVoice databases, underpin the feasibility of using CTC-based systems to perform: highly accurate audio-text alignments, domain adaptation and semi-supervised training of end-to-end ASR.


title: Ab initio no-core shell model study of neutron-rich $^{18,19,20}$C isotopes

abstract: We implement the ab initio no-core shell model approach to study neutron-rich $^{18}$C, $^{19}$C and $^{20}$C isotopes. For this purpose, we employ charge-dependent Bonn 2000 (CDB2K), inside non-local outside Yukawa (INOY) and chiral next-to-next-to-next-to-leading order (N$^{3}$LO) nucleon-nucleon interactions. Low-lying energy spectra, electromagnetic properties and point-proton radii for these nuclei up to basis space $N_{\rm max}$ = 4 are calculated. Binding energies obtained with INOY interaction are in better agreement with the experimental values as compared to other \textit{ab initio} interactions. We also show the behavior of ground state energy and point-proton radii with the NCSM parameters, $\hbar$$\Omega$ and $N_{\rm max}$. We report a strong sensitivity of the B(E2) values from the first excited $2^+$ to the ground state of $^{18}$C and $^{20}$C to the nuclear interaction. Shell model calculations with YSOX interaction are also performed, and corresponding results are compared with ab initio one.


title: Solving Audio Inverse Problems with a Diffusion Model

abstract: This paper presents CQT-Diff, a data-driven generative audio model that can, once trained, be used for solving various different audio inverse problems in a problem-agnostic setting. CQT-Diff is a neural diffusion model with an architecture that is carefully constructed to exploit pitch-equivariant symmetries in music. This is achieved by preconditioning the model with an invertible Constant-Q Transform (CQT), whose logarithmically-spaced frequency axis represents pitch equivariance as translation equivariance. The proposed method is evaluated with objective and subjective metrics in three different and varied tasks: audio bandwidth extension, inpainting, and declipping. The results show that CQT-Diff outperforms the compared baselines and ablations in audio bandwidth extension and, without retraining, delivers competitive performance against modern baselines in audio inpainting and declipping. This work represents the first diffusion-based general framework for solving inverse problems in audio processing.


title: On Chow groups of toric schemes over a DVR

abstract: We give an explicit combinatorial presentation of the Chow groups of a toric scheme over a DVR. As an application, we compute the Chow groups of several toric schemes over a DVR and of their special fibers.


title: How well can Text-to-Image Generative Models understand Ethical Natural Language Interventions?

abstract: Text-to-image generative models have achieved unprecedented success in generating high-quality images based on natural language descriptions. However, it is shown that these models tend to favor specific social groups when prompted with neutral text descriptions (e.g., 'a photo of a lawyer'). Following Zhao et al. (2021), we study the effect on the diversity of the generated images when adding ethical intervention that supports equitable judgment (e.g., 'if all individuals can be a lawyer irrespective of their gender') in the input prompts. To this end, we introduce an Ethical NaTural Language Interventions in Text-to-Image GENeration (ENTIGEN) benchmark dataset to evaluate the change in image generations conditional on ethical interventions across three social axes -- gender, skin color, and culture. Through ENTIGEN framework, we find that the generations from minDALL.E, DALL.E-mini and Stable Diffusion cover diverse social groups while preserving the image quality. Preliminary studies indicate that a large change in the model predictions is triggered by certain phrases such as 'irrespective of gender' in the context of gender bias in the ethical interventions. We release code and annotated data at https://github.com/Hritikbansal/entigen_emnlp.


title: Unsupervised Boundary-Aware Language Model Pretraining for Chinese Sequence Labeling

abstract: Boundary information is critical for various Chinese language processing tasks, such as word segmentation, part-of-speech tagging, and named entity recognition. Previous studies usually resorted to the use of a high-quality external lexicon, where lexicon items can offer explicit boundary information. However, to ensure the quality of the lexicon, great human effort is always necessary, which has been generally ignored. In this work, we suggest unsupervised statistical boundary information instead, and propose an architecture to encode the information directly into pre-trained language models, resulting in Boundary-Aware BERT (BABERT). We apply BABERT for feature induction of Chinese sequence labeling tasks. Experimental results on ten benchmarks of Chinese sequence labeling demonstrate that BABERT can provide consistent improvements on all datasets. In addition, our method can complement previous supervised lexicon exploration, where further improvements can be achieved when integrated with external lexicon information.


title: Visualizing Squircular Implicit Surfaces

abstract: The squircle is an intermediate shape between the square and the circle. In this paper, we examine and discuss equations for different types of squircles. We then build upon these 2D shapes to come-up with various 3D surfaces based on squircles.


title: Towards bosonization of Virasoro coadjoint orbits

abstract: We show that Schwarzian theories associated to certain hyperbolic and parabolic Virasoro coadjoint orbits admit bosonization, i.e. a global $S^1$-equivariant Darboux chart in which the corresponding path integral becomes Gaussian. In this chart, correlation functions of bilocals, time-ordered and out-of-time ordered, can be computed explicitly. We conjecture that a similar global chart exists for the Teichm\"uller orbit.


title: Creating a morphological and syntactic tagged corpus for the Uzbek language

abstract: Nowadays, creation of the tagged corpora is becoming one of the most important tasks of Natural Language Processing (NLP). There are not enough tagged corpora to build machine learning models for the low-resource Uzbek language. In this paper, we tried to fill that gap by developing a novel Part Of Speech (POS) and syntactic tagset for creating the syntactic and morphologically tagged corpus of the Uzbek language. This work also includes detailed description and presentation of a web-based application to work on a tagging as well. Based on the developed annotation tool and the software, we share our experience results of the first stage of the tagged corpus creation


title: SSD: Towards Better Text-Image Consistency Metric in Text-to-Image Generation

abstract: Generating consistent and high-quality images from given texts is essential for visual-language understanding. Although impressive results have been achieved in generating high-quality images, text-image consistency is still a major concern in existing GAN-based methods. Particularly, the most popular metric $R$-precision may not accurately reflect the text-image consistency, often resulting in very misleading semantics in the generated images. Albeit its significance, how to design a better text-image consistency metric surprisingly remains under-explored in the community. In this paper, we make a further step forward to develop a novel CLIP-based metric termed as Semantic Similarity Distance ($SSD$), which is both theoretically founded from a distributional viewpoint and empirically verified on benchmark datasets. Benefiting from the proposed metric, we further design the Parallel Deep Fusion Generative Adversarial Networks (PDF-GAN) that aims at improving text-image consistency by fusing semantic information at different granularities and capturing accurate semantics. Equipped with two novel plug-and-play components: Hard-Negative Sentence Constructor and Semantic Projection, the proposed PDF-GAN can mitigate inconsistent semantics and bridge the text-image semantic gap. A series of experiments show that, as opposed to current state-of-the-art methods, our PDF-GAN can lead to significantly better text-image consistency while maintaining decent image quality on the CUB and COCO datasets.


title: Painting the black box white: experimental findings from applying XAI to an ECG reading setting

abstract: The shift from symbolic AI systems to black-box, sub-symbolic, and statistical ones has motivated a rapid increase in the interest toward explainable AI (XAI), i.e. approaches to make black-box AI systems explainable to human decision makers with the aim of making these systems more acceptable and more usable tools and supports. However, we make the point that, rather than always making black boxes transparent, these approaches are at risk of \emph{painting the black boxes white}, thus failing to provide a level of transparency that would increase the system's usability and comprehensibility; or, even, at risk of generating new errors, in what we termed the \emph{white-box paradox}. To address these usability-related issues, in this work we focus on the cognitive dimension of users' perception of explanations and XAI systems. To this aim, we designed and conducted a questionnaire-based experiment by which we involved 44 cardiology residents and specialists in an AI-supported ECG reading task. In doing so, we investigated different research questions concerning the relationship between users' characteristics (e.g. expertise) and their perception of AI and XAI systems, including their trust, the perceived explanations' quality and their tendency to defer the decision process to automation (i.e. technology dominance), as well as the mutual relationships among these different dimensions. Our findings provide a contribution to the evaluation of AI-based support systems from a Human-AI interaction-oriented perspective and lay the ground for further investigation of XAI and its effects on decision making and user experience.


title: Seq2Seq-SC: End-to-End Semantic Communication Systems with Pre-trained Language Model

abstract: In this work, we propose a realistic semantic network called seq2seq-SC, designed to be compatible with 5G NR and capable of working with generalized text datasets using a pre-trained language model. The goal is to achieve unprecedented communication efficiency by focusing on the meaning of messages in semantic communication. We employ a performance metric called semantic similarity, measured by BLEU for lexical similarity and SBERT for semantic similarity. Our findings demonstrate that seq2seq-SC outperforms previous models in extracting semantically meaningful information while maintaining superior performance. This study paves the way for continued advancements in semantic communication and its prospective incorporation with future wireless systems in 6G networks.


title: Joint Channel and Direction Estimation for Ground-to-UAV Communications Enabled by A Simultaneous Reflecting and Sensing RIS

abstract: Hybrid Reconfigurable Intelligent Surfaces (HRISs), which are capable of simultaneous programmable reflections and sensing, are expected to play a significant role in future wireless networks, enabling various Integrated Sensing and Communication (ISAC) applications. In this paper, we focus on HRIS-enabled Unmanned Aerial Vehicle (UAV) networks and design the HRIS parameters (phase profile, reception combining, and the power splitting between the two functionalities) for jointly estimating the individual UAV-HRIS and HRIS-base-station channels as well as the Angle of Arrival (AoA) of the Line-of-Sight (LoS) component of the UAV-HRIS channel. We derive the Cram\'er Rao lower bounds for the estimated channels and evaluate the performance of the proposed approach in terms of the channel estimation error and the LoS AoA estimation accuracy, verifying its effectiveness for HRIS-enabled ground-to-UAV wireless communication systems.


title: Data-Driven Process Optimization of Fused Filament Fabrication based on In Situ Measurements

abstract: The tuning of fused filament fabrication parameters is notoriously challenging. We propose an autonomous data-driven method to select parameters based on in situ measurements. We use a laser sensor to evaluate the surface roughness of a printed part. We then correlate the roughness to the mechanical properties of the part, and show how print quality affects mechanical performance. Finally, we use Bayesian optimization to search for optimal print parameters. We demonstrate our method by printing liquid crystal polymer samples, and successfully find parameters that produce high-performance prints and maximize the manufacturing process efficiency.


title: On Limit Eigenvalue Distributions Associated to Residual Chains of Groups

abstract: Let $G$ be a residually finite group. We give an explicit example in the discrete Heisenberg group that the Brown measure of multiplication operators $A \in \mathbb{Z}[G] \subseteq \mathcal{B}(\ell^2(G))$ in general can not be approximated using finite quotients $G/N$ of $G$. We show that in finitely generated abelian groups the Brown measure can be approximated using finite quotients.


title: Nuclear Matter and Neutron Stars from Relativistic Brueckner-Hartree-Fock Theory

abstract: The momentum and isospin dependence of the single-particle potential for the in-medium nucleon are the key quantities in the Relativistic Brueckner-Hartree-Fock (RBHF) theory. It depends on how to extract the scalar and the vector components of the single-particle potential inside nuclear matter. In contrast to the RBHF calculations in the Dirac space with the positive-energy states (PESs) only, the single-particle potential can be determined in a unique way by the RBHF theory together with the negative-energy states (NESs), i.e., the RBHF theory in the full Dirac space. The saturation properties of symmetric and asymmetric nuclear matter in the full Dirac space are systematically investigated based on the realistic Bonn nucleon-nucleon potentials. In order to further specify the importance of the calculations in the full Dirac space, the neutron star properties are investigated. The direct URCA process in neutron star cooling will happen at density $\rho_{\rm{DURCA}}=0.43,~0.48,~0.52$ fm$^{-3}$ with the proton fractions $Y_{p,\rm{DURCA}}=0.13$. The radii of a $1.4M_\odot$ neutron star are predicated as $R_{1.4M_\odot}=11.97,~12.13,~12.27$ km, and their tidal deformabilities are $\Lambda_{1.4M_\odot}=376,~405,~433$ for potential Bonn A, B, C. Comparing with the results obtained in the Dirac space with PESs only, full-Dirac-space RBHF calculation predicts the softest symmetry energy which would be more favored by the gravitational waves (GW) detection from GW170817. Furthermore, the results from full-Dirac-space RBHF theory are consistent with the recent astronomical observations of massive neutron stars and simultaneous mass-radius measurement.


title: Compressed-Sensing-Based 3D Localization with Distributed Passive Reconfigurable Intelligent Surfaces

abstract: In this paper, the programmable signal propagation paradigm, enabled by Reconfigurable Intelligent Surfaces (RISs), is exploited for high accuracy $3$-Dimensional (3D) user localization with a single multi-antenna base station. Capitalizing on the tunable reflection capability of passive RISs, we present a two-stage user localization method leveraging the multi-reflection wireless environment. In the first stage, we deploy an off-grid compressive sensing approach, which is based on the atomic norm minimization, for estimating the angles of arrival associated with each RIS, which is followed, in the second stage, by a maximum likelihood location estimation initialized with a least-squares line intersection technique. The presented numerical results showcase the high accuracy of the proposed 3D localization method, verifying our theoretical Cram\'er Rao lower bound analysis.


title: A Distributed Adaptive Algorithm for Non-Smooth Spatial Filtering Problems

abstract: Computing the optimal solution to a spatial filtering problems in a Wireless Sensor Network can incur large bandwidth and computational requirements if an approach relying on data centralization is used. The so-called distributed adaptive signal fusion (DASF) algorithm solves this problem by having the nodes collaboratively solve low-dimensional versions of the original optimization problem, relying solely on the exchange of compressed views of the sensor data between the nodes. However, the DASF algorithm has only been shown to converge for filtering problems that can be expressed as smooth optimization problems. In this paper, we explore an extension of the DASF algorithm to a family of non-smooth spatial filtering problems, allowing the addition of non-smooth regularizers to the optimization problem, which could for example be used to perform node selection, and eliminate nodes not contributing to the filter objective, therefore further reducing communication costs. We provide a convergence proof of the non-smooth DASF algorithm and validate its convergence via simulations in both a static and adaptive setting.


title: Learning Deep Robotic Skills on Riemannian manifolds

abstract: In this paper, we propose RiemannianFlow, a deep generative model that allows robots to learn complex and stable skills evolving on Riemannian manifolds. Examples of Riemannian data in robotics include stiffness (symmetric and positive definite matrix (SPD)) and orientation (unit quaternion (UQ)) trajectories. For Riemannian data, unlike Euclidean ones, different dimensions are interconnected by geometric constraints which have to be properly considered during the learning process. Using distance preserving mappings, our approach transfers the data between their original manifold and the tangent space, realizing the removing and re-fulfilling of the geometric constraints. This allows to extend existing frameworks to learn stable skills from Riemannian data while guaranteeing the stability of the learning results. The ability of RiemannianFlow to learn various data patterns and the stability of the learned models are experimentally shown on a dataset of manifold motions. Further, we analyze from different perspectives the robustness of the model with different hyperparameter combinations. It turns out that the model's stability is not affected by different hyperparameters, a proper combination of the hyperparameters leads to a significant improvement (up to 27.6%) of the model accuracy. Last, we show the effectiveness of RiemannianFlow in a real peg-in-hole (PiH) task where we need to generate stable and consistent position and orientation trajectories for the robot starting from different initial poses.


title: The Optimal Sample Size in Crosswise Model for Sensitive Questions

abstract: The problem is in the estimation of the fraction of population with a stigmatizing characteristic. In the paper the nonrandomized response model proposed by Tian, Yu, Tang, and Geng (2007) is considered. The exact confidence interval for this fraction is constructed. Also the optimal sample size for obtaining the confidence interval of a given length is derived.


title: Slowly evolving horizons in Einstein gravity and beyond

abstract: We study event horizon candidates for slowly evolving dynamical black holes in General Relativity and Einstein-Gauss-Bonnet (EGB) gravity. Such a type of horizon candidate has been termed as slowly evolving null surface (SENS). It signifies a near-equilibrium state of a dynamic black hole. We demonstrate the time evolution of such surfaces for three different metrics. First, we locate such a surface for a charged Vaidya metric and show that the parameter space of the black hole gets constrained to allow a physically admissible slowly evolving null surface. We then consider a supertranslated Vaidya solution that contains a non-spherical horizon and study the properties of the SENS. This spacetime generates a non-vanishing shear at the SENS due to the presence of the supertranslation field. The SENS for a spherically symmetric Vaidya-like solution in EGB gravity yields a bound on the accretion rate that depends on the size of the horizon. We also show that the first and second laws of black hole mechanics can be established for these slowly evolving surfaces.


title: A few-shot learning approach with domain adaptation for personalized real-life stress detection in close relationships

abstract: We design a metric learning approach that aims to address computational challenges that yield from modeling human outcomes from ambulatory real-life data. The proposed metric learning is based on a Siamese neural network (SNN) that learns the relative difference between pairs of samples from a target user and non-target users, thus being able to address the scarcity of labelled data from the target. The SNN further minimizes the Wasserstein distance of the learned embeddings between target and non-target users, thus mitigating the distribution mismatch between the two. Finally, given the fact that the base rate of focal behaviors is different per user, the proposed method approximates the focal base rate based on labelled samples that lay closest to the target, based on which further minimizes the Wasserstein distance. Our method is exemplified for the purpose of hourly stress classification using real-life multimodal data from 72 dating couples. Results in few-shot and one-shot learning experiments indicate that proposed formulation benefits stress classification and can help mitigate the aforementioned challenges.


title: Unsupervised Knowledge Graph Construction and Event-centric Knowledge Infusion for Scientific NLI

abstract: With the advance of natural language inference (NLI), a rising demand for NLI is to handle scientific texts. Existing methods depend on pre-trained models (PTM) which lack domain-specific knowledge. To tackle this drawback, we introduce a scientific knowledge graph to generalize PTM to scientific domain. However, existing knowledge graph construction approaches suffer from some drawbacks, i.e., expensive labeled data, failure to apply in other domains, long inference time and difficulty extending to large corpora. Therefore, we propose an unsupervised knowledge graph construction method to build a scientific knowledge graph (SKG) without any labeled data. Moreover, to alleviate noise effect from SKG and complement knowledge in sentences better, we propose an event-centric knowledge infusion method to integrate external knowledge into each event that is a fine-grained semantic unit in sentences. Experimental results show that our method achieves state-of-the-art performance and the effectiveness and reliability of SKG.


title: Some conditions implying stability of graphs

abstract: A graph $X$ is said to be unstable if the direct product $X\times K_2$ (also called the canonical double cover of $X$) has automorphisms that do not come from automorphisms of its factors $X$ and $K_2$. It is non-trivially unstable if it is unstable, connected, non-bipartite, and distinct vertices have distinct sets of neighbours. In this paper, we prove two sufficient conditions for stability of graphs in which every edge lies on a triangle, revising an incorrect claim of Surowski and filling in some gaps in the proof of another one. We also consider triangle-free graphs, and prove that there are no non-trivially unstable triangle-free graphs of diameter 2. An interesting construction of non-trivially unstable graphs is given and several open problems are posed.


title: A remark on Greenberg's generalized conjecture for imaginary $S_3$-extensions of $\mathbb{Q}$

abstract: Let $K/ \mathbb{Q}$ be an imaginary $S_3$-extension, and $p$ a prime number which splits into exactly three primes in $K$. We give a sufficient condition for the validity of Greenberg's generalized conjecture for $K$ and $p$.


title: Optimal control for production inventory system with various cost criterion

abstract: In this article, we investigate a dynamic control problem of a production-inventory system. Here, demands arrive at the production unit according to a Poisson process and are processed in an FCFS manner. The processing time of the customers' demand is the exponential distribution. The production manufacturers produce the items on a make-to-order basis to meet customer demands. The production is run until the inventory level becomes sufficiently large. We assume that an item's production time follows exponential distribution and the amount of time for the produced item to reach the retail shop is negligible. Also, we assume that no new customer joins the queue when there is a void inventory. This yields an explicit product-form solution for the steady-state probability vector of the system. The optimal policy that minimizes the discounted/average/pathwise average total cost per production is derived using a Markov decision process approach. We find optimal policy using value/policy iteration algorithms. Numerical examples are discussed to verify the proposed algorithms.


title: A random variable related to the Hurwitz zeta-function with algebraic parameter

abstract: In this paper, we introduce a certain random variable closely related to the value-distribution of the Hurwitz zeta-function with algebraic parameter. We prove a version of the limit theorem, where the limit measure is presented by the law of this random variable. Then we apply it to show that any complex number can be approximated by values of the Hurwitz zeta-function for arbitrary quadratic irrational parameters but with finite exceptions.


title: An extended generalized Pareto regression model for count data

abstract: The statistical modeling of discrete extremes has received less attention than their continuous counterparts in the Extreme Value Theory (EVT) literature. One approach to the transition from continuous to discrete extremes is the modeling of threshold exceedances of integer random variables by the discrete version of the generalized Pareto distribution. However, the optimal choice of thresholds defining exceedances remains a problematic issue. Moreover, in a regression framework, the treatment of the majority of non-extreme data below the selected threshold is either ignored or separated from the extremes. To tackle these issues, we expand on the concept of employing a smooth transition between the bulk and the upper tail of the distribution. In the case of zero inflation, we also develop models with an additional parameter. To incorporate possible predictors, we relate the parameters to additive smoothed predictors via an appropriate link, as in the generalized additive model (GAM) framework. A penalized maximum likelihood estimation procedure is implemented. We illustrate our modeling proposal with a real dataset of avalanche activity in the French Alps. With the advantage of bypassing the threshold selection step, our results indicate that the proposed models are more flexible and robust than competing models, such as the negative binomial distribution


title: Hessian spectrum at the global minimum and topology trivialization of locally isotropic Gaussian random fields

abstract: We study the energy landscape near the ground state of a model of a single particle in a random potential with trivial topology. More precisely, we find the large dimensional limit of the Hessian spectrum at the global minimum of the Hamiltonian $X_N(x) +\frac\mu2 \|x\|^2, x\in\rz^N,$ when $\mu$ is above the phase transition threshold so that the system has only one critical point. Here $X_N$ is a locally isotropic Gaussian random field. The same idea is also applied to study the more general model of elastic manifold. In the replica symmetric regime, our results confirm the predictions of Fyodorov and Le Doussal made in 2018 and 2020 using the replica method.


title: RePAST: A ReRAM-based PIM Accelerator for Second-order Training of DNN

abstract: The second-order training methods can converge much faster than first-order optimizers in DNN training. This is because the second-order training utilizes the inversion of the second-order information (SOI) matrix to find a more accurate descent direction and step size. However, the huge SOI matrices bring significant computational and memory overheads in the traditional architectures like GPU and CPU. On the other side, the ReRAM-based process-in-memory (PIM) technology is suitable for the second-order training because of the following three reasons: First, PIM's computation happens in memory, which reduces data movement overheads; Second, ReRAM crossbars can compute SOI's inversion in $O\left(1\right)$ time; Third, if architected properly, ReRAM crossbars can perform matrix inversion and vector-matrix multiplications which are important to the second-order training algorithms. Nevertheless, current ReRAM-based PIM techniques still face a key challenge for accelerating the second-order training. The existing ReRAM-based matrix inversion circuitry can only support 8-bit accuracy matrix inversion and the computational precision is not sufficient for the second-order training that needs at least 16-bit accurate matrix inversion. In this work, we propose a method to achieve high-precision matrix inversion based on a proven 8-bit matrix inversion (INV) circuitry and vector-matrix multiplication (VMM) circuitry. We design \archname{}, a ReRAM-based PIM accelerator architecture for the second-order training. Moreover, we propose a software mapping scheme for \archname{} to further optimize the performance by fusing VMM and INV crossbar. Experiment shows that \archname{} can achieve an average of 115.8$\times$/11.4$\times$ speedup and 41.9$\times$/12.8$\times$energy saving compared to a GPU counterpart and PipeLayer on large-scale DNNs.


title: PolyGloT: A Personalized and Gamified eTutoring System

abstract: The digital age is changing the role of educators and pushing for a paradigm shift in the education system as a whole. Growing demand for general and specialized education inside and outside classrooms is at the heart of this rising trend. In modern, heterogeneous learning environments, the one-size-fits-all approach is proven to be fundamentally flawed. Individualization through adaptivity is, therefore, crucial to nurture individual potential and address accessibility needs and neurodiversity. By formalizing a learning framework that takes into account all these different aspects, we aim to define and implement an open, content-agnostic, and extensible eTutoring platform to design and consume adaptive and gamified learning experiences. Adaptive technology supplementing teaching can extend the reach of every teacher, making it possible to scale 1-1 learning experiences. There are many successful existing technologies available but they come with fixed environments that are not always suitable for the targeted audiences of the course material. This paper presents PolyGloT, a system able to help teachers to design and implement a gamified and adaptive learning paths. Through it we address some important issues including the engagement, fairness, and effectiveness of learning environments. We do not only propose an innovative platform that could foster the learning process of different disciplines, but it could also help teachers and instructors in organizing learning material in an easy-access repository


title: ERNIE-ViLG 2.0: Improving Text-to-Image Diffusion Model with Knowledge-Enhanced Mixture-of-Denoising-Experts

abstract: Recent progress in diffusion models has revolutionized the popular technology of text-to-image generation. While existing approaches could produce photorealistic high-resolution images with text conditions, there are still several open problems to be solved, which limits the further improvement of image fidelity and text relevancy. In this paper, we propose ERNIE-ViLG 2.0, a large-scale Chinese text-to-image diffusion model, to progressively upgrade the quality of generated images by: (1) incorporating fine-grained textual and visual knowledge of key elements in the scene, and (2) utilizing different denoising experts at different denoising stages. With the proposed mechanisms, ERNIE-ViLG 2.0 not only achieves a new state-of-the-art on MS-COCO with zero-shot FID score of 6.75, but also significantly outperforms recent models in terms of image fidelity and image-text alignment, with side-by-side human evaluation on the bilingual prompt set ViLG-300.


title: Forecasting Graph Signals with Recursive MIMO Graph Filters

abstract: Forecasting time series on graphs is a fundamental problem in graph signal processing. When each entity of the network carries a vector of values for each time stamp instead of a scalar one, existing approaches resort to the use of product graphs to combine this multidimensional information, at the expense of creating a larger graph. In this paper, we show the limitations of such approaches, and propose extensions to tackle them. Then, we propose a recursive multiple-input multiple-output graph filter which encompasses many already existing models in the literature while being more flexible. Numerical simulations on a real world data set show the effectiveness of the proposed models.


title: High SNR Analysis of RIS-Aided MIMO Broadcast Channels

abstract: We analyze the influence of a reconfigurable intelligent surface (RIS) on the Gram channel eigenvalues in a high signal-to-noise ratio (SNR) scenario. This allows to connect specific channel properties with the rank improvement capabilities of the RIS. In particular, fundamental limits due to a possible line of sight (LOS) setup between the base station (BS) and the RIS are derived. Furthermore, dirty paper coding (DPC) based schemes are compared to linear precoding in such a scenario and it is shown that under certain channel conditions, the performance gap between DPC and linear precoding vanishes.


title: An algebraic treatment of the Pastro polynomials on the real line

abstract: The properties of the Pastro polynomials on the real line are studied with the help of a triplet of $q$-difference operators. The $q$-difference equation and recurrence relation these polynomials obey are shown to arise as generalized eigenvalue problems involving the triplet of operators, with the Pastro polynomials as solutions. Moreover, a discrete biorthogonality relation on the real line for the Pastro polynomials is obtained and is then understood using adjoint operators. The algebra realized by the triplet of $q$-difference operators is investigated.


title: A knowledge-driven vowel-based approach of depression classification from speech using data augmentation

abstract: We propose a novel explainable machine learning (ML) model that identifies depression from speech, by modeling the temporal dependencies across utterances and utilizing the spectrotemporal information at the vowel level. Our method first models the variable-length utterances at the local-level into a fixed-size vowel-based embedding using a convolutional neural network with a spatial pyramid pooling layer ("vowel CNN"). Following that, the depression is classified at the global-level from a group of vowel CNN embeddings that serve as the input of another 1D CNN ("depression CNN"). Different data augmentation methods are designed for both the training of vowel CNN and depression CNN. We investigate the performance of the proposed system at various temporal granularities when modeling short, medium, and long analysis windows, corresponding to 10, 21, and 42 utterances, respectively. The proposed method reaches comparable performance with previous state-of-the-art approaches and depicts explainable properties with respect to the depression outcome. The findings from this work may benefit clinicians by providing additional intuitions during joint human-ML decision-making tasks.


title: On Asymptotic Universality of Strong Interactions at Large Distances

abstract: We propose a generalisation of the Pomeranchuk theorem which argues that elastic cross-sections should show a universal energy dependence: difference of integrated elastic cross-sections of any pair of initial channels has to disappear at high enough energy


title: A Note On K\"ahler-Ricci Flow on Fano Threefolds

abstract: In this note, we show that the solution of K\"ahler-Ricci flow on every Fano threefold from the family No.2.23 in the Mori-Mukai's list develops type II singularity. In fact, we show that no Fano threefold from the family No.2.23 admits K\"ahler-Ricci soliton and the Gromov-Hausdorff limit of the K\"ahler-Ricci flow must be a singular $\mathbb{Q}$-Fano variety. This gives new examples of Fano manifolds of the lowest dimension on which K\"ahler-Ricci flow develops type II singularity.


title: Generating the right evidence at the right time: Principles of a new class of flexible augmented clinical trial designs

abstract: The past few years have seen an increasing number of initiatives aimed at integrating information generated outside of confirmatory randomised clinical trials (RCTs) into drug development. However, data generated non-concurrently and through observational studies can provide results that are difficult to compare with randomised trial data. Moreover, the scientific questions these data can serve to answer often remain vague. Our starting point is to use clearly defined objectives for evidence generation, which are formulated towards early discussion with health technology assessment (HTA) bodies and are additional to regulatory requirements for authorisation of a new treatment. We propose FACTIVE (Flexible Augmented Clinical Trial for Improved eVidencE generation), a new class of study designs enabling flexible augmentation of confirmatory randomised controlled trials with concurrent and close-to-real-world elements. These enabling designs facilitate estimation of certain treatment effects in the confirmatory part and other, complementary treatment effects in a concurrent real-world part. Each stakeholder should use the evidence that is relevant within their own decision-making framework. High quality data are generated under one single protocol and the use of randomisation ensures rigorous statistical inference and interpretation within and between the different parts of the experiment. Evidence for the decision-making of HTA bodies could be available earlier than is currently the case.


title: Conversation Disentanglement with Bi-Level Contrastive Learning

abstract: Conversation disentanglement aims to group utterances into detached sessions, which is a fundamental task in processing multi-party conversations. Existing methods have two main drawbacks. First, they overemphasize pairwise utterance relations but pay inadequate attention to the utterance-to-context relation modeling. Second, huge amount of human annotated data is required for training, which is expensive to obtain in practice. To address these issues, we propose a general disentangle model based on bi-level contrastive learning. It brings closer utterances in the same session while encourages each utterance to be near its clustered session prototypes in the representation space. Unlike existing approaches, our disentangle model works in both supervised setting with labeled data and unsupervised setting when no such data is available. The proposed method achieves new state-of-the-art performance on both settings across several public datasets.


title: A shallow layer laboratory model of large-scale atmospheric circulation

abstract: A new shallow layer laboratory model of global atmosphere circulation is realized. The shallow rotating cylindrical layer of fluid with the localized heater at the bottom periphery and localized cooler in the central part of the upper boundary is considered. The rim heater imitates the equator heating and disc cooler -- the north pole cooling. The rim heater is intentionally shifted from the sidewall to decrease the influence of the no-slip vertical boundaries and provide anticyclonic-cyclonic motion in the upper layer, imitating the formation of large-scale zonal flows (easterlies and westerlies) in the low latitudes. The low-viscous silicon oil is used instead of water to avoid complex effects provided by the formation of a thin film of a surface-active substance on the open surface. The flow transforms from the Hadley-like regime to the baroclinic wave regime through transitional states. The decrease in the thermal Rossby number for the fixed value of Taylor number results in the regularization of the baroclinic waves. The main difference between presented and classical annulus configurations is the absence of the steady waves. All wave regimes, even with regular wave structures, are characterized by strong non-periodic fluctuations. The observed baroclinic wave structures are a combination of temporarily evolving different baroclinic modes. The presented model provides the formation of atmospheric-like flows, characterized by complex temporal behaviour and can serve as an efficient tool for studying different aspects of global atmospheric circulation.


title: Renormalization of spin$\unicode{x2013}$boson interactions mediated by singular form factors

abstract: We study and discuss the extension of the rotating-wave spin$\unicode{x2013}$boson model, together with more general models describing a system$\unicode{x2013}$field coupling with a similar rotating-wave structure, to interactions mediated by possibly singular (non-normalizable) form factors satisfying a weaker growth constraint. To this purpose, a construction of annihilation and creation operators as continuous maps on a scale of Fock spaces, together with a rigorous renormalization procedure, is employed.


title: Calculation of critical exponents on fractal lattice Ising model by higher-order tensor renormalization group method

abstract: The critical behavior of the Ising model on a fractal lattice, which has the Hausdorff dimension $\log_{4} 12 \approx 1.792$, is investigated using a modified higher-order tensor renormalization group algorithm supplemented with automatic differentiation to compute relevant derivatives efficiently and accurately. The complete set of critical exponents characteristic of a second-order phase transition was obtained. Correlations near the critical temperature were analyzed through two impurity tensors inserted into the system, which allowed us to obtain the correlation lengths and calculate the critical exponent $\nu$. The critical exponent $\alpha$ was found to be negative, consistent with the observation that the specific heat does not diverge at the critical temperature. The extracted exponents satisfy the known relations given by various scaling assumptions within reasonable accuracy. Perhaps most interestingly, the hyperscaling relation, which contains the spatial dimension, is satisfied very well, assuming the Hausdorff dimension takes the place of the spatial dimension. Moreover, using automatic differentiation, we have extracted four critical exponents ($\alpha$, $\beta$, $\gamma$, and $\delta$) globally by differentiating the free energy. Surprisingly, the global exponents differ from those obtained locally by the technique of the impurity tensors; however, the scaling relations remain satisfied even in the case of the global exponents.


title: Electron-phonon mediated spin-flip as driving mechanism for ultrafast magnetization dynamics in 3$d$ ferromagnets

abstract: Despite intense experimental effort, theoretical proposals and modeling approaches, a lack of consensus exists about the intrinsic mechanisms driving ultrafast magnetization dynamics in 3$d$ ferromagnets. In this work, we find evidence of electron-phonon mediated spin-flip as the driving mechanism for the ultrafast magnetization dynamics in all three 3$d$ ferromagnets; nickel, iron and cobalt. We use a microscopic three temperature model with parameters calculated from first-principles, which has been validated by direct comparison to the electron and lattice dynamics extracted from previous experiments. By direct comparison to the experimentally measured magnetization dynamics for different laser fluence, we determine the spin-flip probability of each material. In contrast to previous findings but in agreement to ab-initio predictions, we find that relatively small values of the spin-flip probability enable ultrafast demagnetization in all three 3$d$ ferromagnets.


title: Generalized Matrix-Pencil Approach to Estimation of Complex Exponentials with Gapped Data

abstract: A generalized matrix-pencil approach is proposed for the estimation of complex exponential components with segmented signal samples, which is very efficient and provides super-resolution estimations. It is applicable to the signals sampled segmentally with the same sampling frequency and direction of arrival (DOA) estimation with distributed arrays within which array elements are placed uniformly with the same inter-element spacing.


title: Drug repositioning for Alzheimer's disease with transfer learning

abstract: Deep Learning and DRUG-seq (Digital RNA with perturbation of genes) have attracted attention in drug discovery. However, the public DRUG-seq dataset is too small to be used for directly training a deep learning neural network from scratch. Inspired by the transfer learning technique, we pretrain a drug efficacy prediction neural network model with the Library of Integrated Network-based Cell-Signature (LINCS) L1000 data and then use human neural cell DRUG-seq data to fine-tune it. After training, the model is used for virtual screening to find potential drugs for Alzheimer's disease (AD) treatment. Finally, we find 27 potential drugs for AD treatment including Irsogladine (PDE4 inhibitor), Tasquinimod (HDAC4 selective inhibitor), Suprofen (dual COX-1/COX-2 inhibitor) et al.


title: A Fast and Accurate Pitch Estimation Algorithm Based on the Pseudo Wigner-Ville Distribution

abstract: Estimation of fundamental frequency (F0) in voiced segments of speech signals, also known as pitch tracking, plays a crucial role in pitch synchronous speech analysis, speech synthesis, and speech manipulation. In this paper, we capitalize on the high time and frequency resolution of the pseudo Wigner-Ville distribution (PWVD) and propose a new PWVD-based pitch estimation method. We devise an efficient algorithm to compute PWVD faster and use cepstrum-based pre-filtering to avoid cross-term interference. Evaluating our approach on a database with speech and electroglottograph (EGG) recordings yields a state-of-the-art mean absolute error (MAE) of around 4Hz. Our approach is also effective at voiced/unvoiced classification and handling sudden frequency changes.


title: Partial-twuality polynomials of delta-matroids

abstract: Gross, Mansour and Tucker introduced the partial-twuality polynomial of a ribbon graph. Chumutov and Vignes-Tourneret posed a problem: it would be interesting to know whether the partial duality polynomial and the related conjectures would make sense for general delta-matroids. In this paper we consider analogues of partial-twuality polynomials for delta-matroids. Various possible properties of partial-twuality polynomials of set systems are studied. We discuss the numerical implications of partial-twualities on a single element and prove that the intersection graphs can determine the partial-twuality polynomials of bouquets and normal binary delta-matroids, respectively. Finally, we give a characterization of vf-safe delta-matroids whose partial-twuality polynomials have only one term.


title: Improved Feature Distillation via Projector Ensemble

abstract: In knowledge distillation, previous feature distillation methods mainly focus on the design of loss functions and the selection of the distilled layers, while the effect of the feature projector between the student and the teacher remains under-explored. In this paper, we first discuss a plausible mechanism of the projector with empirical evidence and then propose a new feature distillation method based on a projector ensemble for further performance improvement. We observe that the student network benefits from a projector even if the feature dimensions of the student and the teacher are the same. Training a student backbone without a projector can be considered as a multi-task learning process, namely achieving discriminative feature extraction for classification and feature matching between the student and the teacher for distillation at the same time. We hypothesize and empirically verify that without a projector, the student network tends to overfit the teacher's feature distributions despite having different architecture and weights initialization. This leads to degradation on the quality of the student's deep features that are eventually used in classification. Adding a projector, on the other hand, disentangles the two learning tasks and helps the student network to focus better on the main feature extraction task while still being able to utilize teacher features as a guidance through the projector. Motivated by the positive effect of the projector in feature distillation, we propose an ensemble of projectors to further improve the quality of student features. Experimental results on different datasets with a series of teacher-student pairs illustrate the effectiveness of the proposed method.