title: Unified Convergence Theory of Stochastic and Variance-Reduced Cubic Newton Methods

abstract: We study stochastic Cubic Newton methods for solving general possibly non-convex minimization problems. We propose a new framework, which we call the helper framework, that provides a unified view of the stochastic and variance-reduced second-order algorithms equipped with global complexity guarantees. It can also be applied to learning with auxiliary information. Our helper framework offers the algorithm designer high flexibility for constructing and analyzing the stochastic Cubic Newton methods, allowing arbitrary size batches, and the use of noisy and possibly biased estimates of the gradients and Hessians, incorporating both the variance reduction and the lazy Hessian updates. We recover the best-known complexities for the stochastic and variance-reduced Cubic Newton, under weak assumptions on the noise. A direct consequence of our theory is the new lazy stochastic second-order method, which significantly improves the arithmetic complexity for large dimension problems. We also establish complexity bounds for the classes of gradient-dominated objectives, that include convex and strongly convex problems. For Auxiliary Learning, we show that using a helper (auxiliary function) can outperform training alone if a given similarity measure is small.


title: Investigating Catastrophic Overfitting in Fast Adversarial Training: A Self-fitting Perspective

abstract: Although fast adversarial training provides an efficient approach for building robust networks, it may suffer from a serious problem known as catastrophic overfitting (CO), where multi-step robust accuracy suddenly collapses to zero. In this paper, we for the first time decouple single-step adversarial examples into data-information and self-information, which reveals an interesting phenomenon called "self-fitting". Self-fitting, i.e., the network learns the self-information embedded in single-step perturbations, naturally leads to the occurrence of CO. When self-fitting occurs, the network experiences an obvious "channel differentiation" phenomenon that some convolution channels accounting for recognizing self-information become dominant, while others for data-information are suppressed. In this way, the network can only recognize images with sufficient self-information and loses generalization ability to other types of data. Based on self-fitting, we provide new insights into the existing methods to mitigate CO and extend CO to multi-step adversarial training. Our findings reveal a self-learning mechanism in adversarial training and open up new perspectives for suppressing different kinds of information to mitigate CO.


title: Sharp upper bounds for Steklov eigenvalues of a hypersurface of revolution with two boundary components in Euclidean space

abstract: We investigate the question of sharp upper bounds for the Steklov eigenvalues of a hypersurface of revolution of the Euclidean space with two boundary components isometric to two copies of $\mathbb{S}^{n-1}$. For the case of the first non zero Steklov eigenvalue, we give a sharp upper bound $B_n(L)$ (that depends only on the dimension $n \ge 3$ and the meridian length $L>0$) which is reached by a degenerated metric $g^*$, that we compute explicitly. We also give a sharp upper bound $B_n$ which depends only on $n$. Our method also permits us to prove some stability properties of these upper bounds.


title: The Generalizability of Explanations

abstract: Due to the absence of ground truth, objective evaluation of explainability methods is an essential research direction. So far, the vast majority of evaluations can be summarized into three categories, namely human evaluation, sensitivity testing, and salinity check. This work proposes a novel evaluation methodology from the perspective of generalizability. We employ an Autoencoder to learn the distributions of the generated explanations and observe their learnability as well as the plausibility of the learned distributional features. We first briefly demonstrate the evaluation idea of the proposed approach at LIME, and then quantitatively evaluate multiple popular explainability methods. We also find that smoothing the explanations with SmoothGrad can significantly enhance the generalizability of explanations.


title: Machine Learning for QoS Prediction in Vehicular Communication: Challenges and Solution Approaches

abstract: As cellular networks evolve towards the 6th generation, machine learning is seen as a key enabling technology to improve the capabilities of the network. Machine learning provides a methodology for predictive systems, which can make networks become proactive. This proactive behavior of the network can be leveraged to sustain, for example, a specific quality of service requirement. With predictive quality of service, a wide variety of new use cases, both safety- and entertainment-related, are emerging, especially in the automotive sector. Therefore, in this work, we consider maximum throughput prediction enhancing, for example, streaming or high-definition mapping applications. We discuss the entire machine learning workflow highlighting less regarded aspects such as the detailed sampling procedures, the in-depth analysis of the dataset characteristics, the effects of splits in the provided results, and the data availability. Reliable machine learning models need to face a lot of challenges during their lifecycle. We highlight how confidence can be built on machine learning technologies by better understanding the underlying characteristics of the collected data. We discuss feature engineering and the effects of different splits for the training processes, showcasing that random splits might overestimate performance by more than twofold. Moreover, we investigate diverse sets of input features, where network information proved to be most effective, cutting the error by half. Part of our contribution is the validation of multiple machine learning models within diverse scenarios. We also use explainable AI to show that machine learning can learn underlying principles of wireless networks without being explicitly programmed. Our data is collected from a deployed network that was under full control of the measurement team and covered different vehicular scenarios and radio environments.


title: Full control of solid-state electrolytes for electrostatic gating

abstract: Ionic gating is a powerful technique to realize field-effect transistors (FETs) enabling experiments not possible otherwise. So far, ionic gating has relied on the use of top-electrolyte gates, which pose experimental constraints and make device fabrication complex. Promising results obtained recently in FETs based on solid-state electrolytes remain plagued by spurious phenomena of unknown origin, preventing proper transistor operation, and causing limited control and reproducibility. Here we explore a class of solid-state electrolytes for gating (Lithium-ion conducting glass-ceramics, LICGCs), identify the processes responsible for the spurious phenomena and irreproducible behavior,and demonstrate properly functioning transistors exhibiting high density ambipolar operation with gate capacitance of ~20-50 $\mu$F/cm$^2$ (depending on the polarity of the accumulated charges). Using two-dimensional semiconducting transition-metal dichalcogenides we demonstrate the ability to implement ionic-gate spectroscopy to determine the semiconducting bandgap, and to accumulate electron densities above 10$^{14}$ cm$^{-2}$, resulting in gate-induced superconductivity in MoS$_2$ multilayers. As LICGCs are implemented in a back-gate configuration, they leave the surface of the material exposed, enabling the use of surface-sensitive techniques (such as scanning tunneling microscopy and photoemission spectroscopy) impossible so far in ionic-liquid gated devices. They also allow double ionic gated devices providing independent control of charge density and electric field.


title: Buckling Metamaterials for Extreme Vibration Damping

abstract: Damping mechanical resonances is a formidable challenge in an increasing number of applications. Many of the passive damping methods rely on using low stiffness dissipative elements, complex mechanical structures or electrical systems, while active vibration damping systems typically add an additional layer of complexity. However, in many cases, the reduced stiffness or additional complexity and mass render these vibration damping methods unfeasible. Here, we introduce a method for passive vibration damping by allowing buckling of the primary load path, which sets an upper limit for vibration transmission: the transmitted acceleration saturates at a maximum value, no matter what the input acceleration is. This nonlinear mechanism leads to an extreme damping coefficient tan delta ~0.23 in our metal metamaterial|orders of magnitude larger than the linear damping of traditional lightweight structural materials. We demonstrate this principle experimentally and numerically in free-standing rubber and metal mechanical metamaterials over a range of accelerations, and show that bi-directional buckling can further improve its performance. Buckling metamaterials pave the way towards extreme vibration damping without mass or stiffness penalty, and as such could be applicable in a multitude of high-tech applications, including aerospace structures, vehicles and sensitive instruments.


title: XL-MIMO Channel Modeling and Prediction for Wireless Power Transfer

abstract: Massive antenna arrays form physically large apertures with a beam-focusing capability, leading to outstanding wireless power transfer (WPT) efficiency paired with low radiation levels outside the focusing region. However, leveraging these features requires accurate knowledge of the multipath propagation channel and overcoming the (Rayleigh) fading channel present in typical application scenarios. For that, reciprocity-based beamforming is an optimal solution that estimates the actual channel gains from pilot transmissions on the uplink. But this solution is unsuitable for passive backscatter nodes that are not capable of sending any pilots in the initial access phase. Using measured channel data from an extremely large-scale MIMO (XL-MIMO) testbed, we compare geometry-based planar wavefront and spherical wavefront beamformers with a reciprocity-based beamformer, to address this initial access problem. We also show that we can predict specular multipath components (SMCs) based only on geometric environment information. We demonstrate that a transmit power of 1W is sufficient to transfer more than 1mW of power to a device located at a distance of 12.3m when using a (40x25) array at 3.8GHz. The geometry-based beamformer exploiting predicted SMCs suffers a loss of only 2dB compared with perfect channel state information.


title: ArtiFact: A Large-Scale Dataset with Artificial and Factual Images for Generalizable and Robust Synthetic Image Detection

abstract: Synthetic image generation has opened up new opportunities but has also created threats in regard to privacy, authenticity, and security. Detecting fake images is of paramount importance to prevent illegal activities, and previous research has shown that generative models leave unique patterns in their synthetic images that can be exploited to detect them. However, the fundamental problem of generalization remains, as even state-of-the-art detectors encounter difficulty when facing generators never seen during training. To assess the generalizability and robustness of synthetic image detectors in the face of real-world impairments, this paper presents a large-scale dataset named ArtiFact, comprising diverse generators, object categories, and real-world challenges. Moreover, the proposed multi-class classification scheme, combined with a filter stride reduction strategy addresses social platform impairments and effectively detects synthetic images from both seen and unseen generators. The proposed solution significantly outperforms other top teams by 8.34% on Test 1, 1.26% on Test 2, and 15.08% on Test 3 in the IEEE VIP Cup challenge at ICIP 2022, as measured by the accuracy metric.


title: Efficiently handling constraints with Metropolis-adjusted Langevin algorithm

abstract: In this study, we investigate the performance of the Metropolis-adjusted Langevin algorithm in a setting with constraints on the support of the target distribution. We provide a rigorous analysis of the resulting Markov chain, establishing its convergence and deriving an upper bound for its mixing time. Our results demonstrate that the Metropolis-adjusted Langevin algorithm is highly effective in handling this challenging situation: the mixing time bound we obtain is superior to the best known bounds for competing algorithms without an accept-reject step. Our numerical experiments support these theoretical findings, indicating that the Metropolis-adjusted Langevin algorithm shows promising performance when dealing with constraints on the support of the target distribution.


title: Implication of the double-gating mode in hybrid photon counting detector for measurements of transient heat conduction in GaAs/AlAs superlattice structures

abstract: Understanding and control of thermal transport in solids at nanoscale is crucial to engineer and to enhance properties of a new generation of optoelectronic, thermoelectric, and photonic devices. In this regard, semiconductor superlattice structures provide a unique platform to study phenomena associated with phonon propagations in solids such as heat conduction. Transient X-ray diffraction can directly probe atomic motions and therefore is among the rare techniques sensitive to phonon dynamics in a condensed matter. Here, we study optically induced transient heat conduction in GaAs/AlAs superlattice structures using EIGER2 detector. Benchmark experiments have been performed at the Austrian SAXS beamline at Elettra Sincrotrone Trieste that operated in the hybrid filling mode. We demonstrate that drifts of experimental conditions, such as synchrotron beam fluctuations, become less essential when utilizing EIGER2 double gating mode that results in a faster acquisition of high quality data and facilitates data analysis and data interpretation.


title: Fixed Points of Mean Section Operators

abstract: We characterize rotation equivariant bounded linear operators from $C(\mathbb{S}^{n-1})$ to $C^2(\mathbb{S}^{n-1})$ by the mass distribution of the spherical Laplacian of their kernel function on small polar caps. Using this characterization, we show that every continuous, homogeneous, translation invariant, and rotation equivariant Minkowski valuation $\Phi$ that is weakly monotone maps the space of convex bodies with a $C^2$ support function into itself. As an application, we prove that if $\Phi$ is in addition even or a mean section operator, then Euclidean balls are its only fixed points in some $C^2$ neighborhood of the unit ball. Our approach unifies and extends previous results by Ivaki from 2017 and the second author together with Schuster from 2021.


title: LightCTS: A Lightweight Framework for Correlated Time Series Forecasting

abstract: Correlated time series (CTS) forecasting plays an essential role in many practical applications, such as traffic management and server load control. Many deep learning models have been proposed to improve the accuracy of CTS forecasting. However, while models have become increasingly complex and computationally intensive, they struggle to improve accuracy. Pursuing a different direction, this study aims instead to enable much more efficient, lightweight models that preserve accuracy while being able to be deployed on resource-constrained devices. To achieve this goal, we characterize popular CTS forecasting models and yield two observations that indicate directions for lightweight CTS forecasting. On this basis, we propose the LightCTS framework that adopts plain stacking of temporal and spatial operators instead of alternate stacking that is much more computationally expensive. Moreover, LightCTS features light temporal and spatial operator modules, called L-TCN and GL-Former, that offer improved computational efficiency without compromising their feature extraction capabilities. LightCTS also encompasses a last-shot compression scheme to reduce redundant temporal features and speed up subsequent computations. Experiments with single-step and multi-step forecasting benchmark datasets show that LightCTS is capable of nearly state-of-the-art accuracy at much reduced computational and storage overheads.


title: Optical spectroscopy of Be stars: peak separation of Balmer emission lines

abstract: The Be stars display variable optical emission lines originating in the circumstellar disc. Here we analyse high resolution spectroscopic observations of Be stars and the distance between the peaks of H-alpha, H-beta, and H-gamma emission lines ($\Delta V_\alpha$, $\Delta V_\beta$, and $\Delta V_\gamma$ respectively). Combining published data, spectra from the ELODIE archive (obtained in the period 1998 -- 2003) and Rozhen spectra (obtained 2015 -- 2023) of 93 Be stars, we find a set of relations connecting $\Delta V_\alpha$, $\Delta V_\beta$ and $\Delta V_\gamma$. They are effective for $30 \le \Delta V_\alpha \le 500$ km s$^{-1}$, $80 \le \Delta V_\beta \le 600$ km s$^{-1}$, and $40 \le \Delta V_\gamma \le 300$ km s$^{-1}$. The new equations are in the form $y=ax + b$ and are valid for a wider velocity range than in previous studies.


title: Inadequacy of fluvial energetics for describing gravity current autosuspension

abstract: "Consider the [turbidity] current as ... a river" R. A. Bagnold (1962); the foundation of contemporary deep marine sedimentology. Gravity currents, such as sediment-laden turbidity currents, are ubiquitous natural flows that are driven by a density difference. Turbidity currents have provided vital motivation to advance understanding of this class of flows because their enigmatic long run-out and driving mechanisms are not properly understood. Extant models assume that material transport by gravity currents is dynamically similar to fluvial flows. Here, empirical research from different types of particle-driven gravity currents is integrated with our experimental data, to show that material transport is fundamentally different from fluvial systems. Contrary to current theory, buoyancy production is shown to have a non-linear dependence on available flow power, indicating an underestimation of the total kinetic energy lost from the mean flow. A revised energy budget directly implies that the mixing efficiency of gravity currents is enhanced.


title: AGN feedback in an infant galaxy cluster: the LOFAR-Chandra view of the giant FRII radio galaxy J103025+052430 at z=1.7

abstract: In the nearby universe jets from AGN are observed to have a dramatic impact on their surrounding extragalactic environment. Their effect at the `cosmic noon' (z>1.5), the epoch when star formation and AGN activity peak, is instead much less constrained. Here we present a study of the giant (750 kpc) radio galaxy 103025+052430 located at the centre of a protocluster at redshift z=1.7, with a focus on its interaction with the external medium. We present new LOFAR observations at 144 MHz, which we combine with VLA 1.4 GHz and 0.5-7 keV Chandra archival data. The new map at 144 MHz confirms that the source has a complex morphology, possibly consistent with the `hybrid morphology' classification. The large size of the source gave us the possibility to perform a resolved radio spectral index analysis, a very unique opportunity for a source at such high redshift. This reveals a tentative flattening of the radio spectral index at the edge of the backflow in the Western lobe, which might be indicating plasma compression. The spatial coincidence between this region and the thermal X-ray bubble C suggests a causal connection between the two. Contrary to previous estimates for the bright X-ray component A, we find that inverse Compton scattering between the radio-emitting plasma of the Eastern lobe and the CMB photons can account for a large fraction (~45%-80%) of its total 0.5-7 keV measured flux. Finally, the X-ray bubble C, which is consistent with a thermal origin, is found to be significantly overpressurised with respect to the ambient medium. This suggests that it will tend to expand and release its energy in the surroundings, contributing to the overall intracluster medium heating. Overall, 103025+052430 gives us the chance to investigate the interaction between AGN jets and the surrounding gas in a system that is likely the predecessor of the rich galaxy clusters we all well know at z=0.


title: Does Deep Learning Learn to Abstract? A Systematic Probing Framework

abstract: Abstraction is a desirable capability for deep learning models, which means to induce abstract concepts from concrete instances and flexibly apply them beyond the learning context. At the same time, there is a lack of clear understanding about both the presence and further characteristics of this capability in deep learning models. In this paper, we introduce a systematic probing framework to explore the abstraction capability of deep learning models from a transferability perspective. A set of controlled experiments are conducted based on this framework, providing strong evidence that two probed pre-trained language models (PLMs), T5 and GPT2, have the abstraction capability. We also conduct in-depth analysis, thus shedding further light: (1) the whole training phase exhibits a "memorize-then-abstract" two-stage process; (2) the learned abstract concepts are gathered in a few middle-layer attention heads, rather than being evenly distributed throughout the model; (3) the probed abstraction capabilities exhibit robustness against concept mutations, and are more robust to low-level/source-side mutations than high-level/target-side ones; (4) generic pre-training is critical to the emergence of abstraction capability, and PLMs exhibit better abstraction with larger model sizes and data scales.


title: Data-Driven Observability Analysis for Nonlinear Stochastic Systems

abstract: Distinguishability and, by extension, observability are key properties of dynamical systems. Establishing these properties is challenging, especially when no analytical model is available and they are to be inferred directly from measurement data. The presence of noise further complicates this analysis, as standard notions of distinguishability are tailored to deterministic systems. We build on distributional distinguishability, which extends the deterministic notion by comparing distributions of outputs of stochastic systems. We first show that both concepts are equivalent for a class of systems that includes linear systems. We then present a method to assess and quantify distributional distinguishability from output data. Specifically, our quantification measures how much data is required to tell apart two initial states, inducing a continuous spectrum of distinguishability. We propose a statistical test to determine a threshold above which two states can be considered distinguishable with high confidence. We illustrate these tools by computing distinguishability maps over the state space in simulation, then leverage the test to compare sensor configurations on hardware.


title: Internal force distributions in 't Hooft-Polyakov monopole and Julia-Zee dyon

abstract: The energy-momentum tensor of the 't Hooft-Polyakov monopole and the Julia-Zee dyon are studied. This tensor contains important information about the pressure and the shear force distributions which define the mechanical properties of systems. Obtaining the violation of the local stability criterion for the magnetic monopole and dyon we decompose the EMTs into long- and short-range parts. This decomposition depends on the abelian field strength tensor which can not be uniquely defined. We suggest to use the modified 't Hooft definition for the tensor. Finally, the long- and short-range parts of the EMTs are computed and new equilibrium equations are obtained. Numerical values for masses, $D$-terms and various mean square radii for the monopole and the dyon are also computed.


title: Unsupervised Noise adaptation using Data Simulation

abstract: Deep neural network based speech enhancement approaches aim to learn a noisy-to-clean transformation using a supervised learning paradigm. However, such a trained-well transformation is vulnerable to unseen noises that are not included in training set. In this work, we focus on the unsupervised noise adaptation problem in speech enhancement, where the ground truth of target domain data is completely unavailable. Specifically, we propose a generative adversarial network based method to efficiently learn a converse clean-to-noisy transformation using a few minutes of unpaired target domain data. Then this transformation is utilized to generate sufficient simulated data for domain adaptation of the enhancement model. Experimental results show that our method effectively mitigates the domain mismatch between training and test sets, and surpasses the best baseline by a large margin.


title: A Plot is Worth a Thousand Words: Model Information Stealing Attacks via Scientific Plots

abstract: Building advanced machine learning (ML) models requires expert knowledge and many trials to discover the best architecture and hyperparameter settings. Previous work demonstrates that model information can be leveraged to assist other attacks, such as membership inference, generating adversarial examples. Therefore, such information, e.g., hyperparameters, should be kept confidential. It is well known that an adversary can leverage a target ML model's output to steal the model's information. In this paper, we discover a new side channel for model information stealing attacks, i.e., models' scientific plots which are extensively used to demonstrate model performance and are easily accessible. Our attack is simple and straightforward. We leverage the shadow model training techniques to generate training data for the attack model which is essentially an image classifier. Extensive evaluation on three benchmark datasets shows that our proposed attack can effectively infer the architecture/hyperparameters of image classifiers based on convolutional neural network (CNN) given the scientific plot generated from it. We also reveal that the attack's success is mainly caused by the shape of the scientific plots, and further demonstrate that the attacks are robust in various scenarios. Given the simplicity and effectiveness of the attack method, our study indicates scientific plots indeed constitute a valid side channel for model information stealing attacks. To mitigate the attacks, we propose several defense mechanisms that can reduce the original attacks' accuracy while maintaining the plot utility. However, such defenses can still be bypassed by adaptive attacks.


title: Category-level Shape Estimation for Densely Cluttered Objects

abstract: Accurately estimating the shape of objects in dense clutters makes important contribution to robotic packing, because the optimal object arrangement requires the robot planner to acquire shape information of all existed objects. However, the objects for packing are usually piled in dense clutters with severe occlusion, and the object shape varies significantly across different instances for the same category. They respectively cause large object segmentation errors and inaccurate shape recovery on unseen instances, which both degrade the performance of shape estimation during deployment. In this paper, we propose a category-level shape estimation method for densely cluttered objects. Our framework partitions each object in the clutter via the multi-view visual information fusion to achieve high segmentation accuracy, and the instance shape is recovered by deforming the category templates with diverse geometric transformations to obtain strengthened generalization ability. Specifically, we first collect the multi-view RGB-D images of the object clutters for point cloud reconstruction. Then we fuse the feature maps representing the visual information of multi-view RGB images and the pixel affinity learned from the clutter point cloud, where the acquired instance segmentation masks of multi-view RGB images are projected to partition the clutter point cloud. Finally, the instance geometry information is obtained from the partially observed instance point cloud and the corresponding category template, and the deformation parameters regarding the template are predicted for shape estimation. Experiments in the simulated environment and real world show that our method achieves high shape estimation accuracy for densely cluttered everyday objects with various shapes.


title: Unsupervised Domain Adaptation via Distilled Discriminative Clustering

abstract: Unsupervised domain adaptation addresses the problem of classifying data in an unlabeled target domain, given labeled source domain data that share a common label space but follow a different distribution. Most of the recent methods take the approach of explicitly aligning feature distributions between the two domains. Differently, motivated by the fundamental assumption for domain adaptability, we re-cast the domain adaptation problem as discriminative clustering of target data, given strong privileged information provided by the closely related, labeled source data. Technically, we use clustering objectives based on a robust variant of entropy minimization that adaptively filters target data, a soft Fisher-like criterion, and additionally the cluster ordering via centroid classification. To distill discriminative source information for target clustering, we propose to jointly train the network using parallel, supervised learning objectives over labeled source data. We term our method of distilled discriminative clustering for domain adaptation as DisClusterDA. We also give geometric intuition that illustrates how constituent objectives of DisClusterDA help learn class-wisely pure, compact feature distributions. We conduct careful ablation studies and extensive experiments on five popular benchmark datasets, including a multi-source domain adaptation one. Based on commonly used backbone networks, DisClusterDA outperforms existing methods on these benchmarks. It is also interesting to observe that in our DisClusterDA framework, adding an additional loss term that explicitly learns to align class-level feature distributions across domains does harm to the adaptation performance, though more careful studies in different algorithmic frameworks are to be conducted.


title: Automatic Detecting Unethical Behavior in Open-source Software Projects

abstract: Given the rapid growth of Open-Source Software (OSS) projects, ethical considerations are becoming more important. Past studies focused on specific ethical issues (e.g., gender bias and fairness in OSS). There is little to no study on the different types of unethical behavior in OSS projects. We present the first study of unethical behavior in OSS projects from the stakeholders' perspective. Our study of 316 GitHub issues provides a taxonomy of 15 types of unethical behavior guided by six ethical principles (e.g., autonomy).Examples of new unethical behavior include soft forking (copying a repository without forking) and self-promotion (promoting a repository without self-identifying as contributor to the repository). We also identify 18 types of software artifacts affected by the unethical behavior. The diverse types of unethical behavior identified in our study (1) call for attentions of developers and researchers when making contributions in GitHub, and (2) point to future research on automated detection of unethical behavior in OSS projects. Based on our study, we propose Etor, an approach that can automatically detect six types of unethical behavior by using ontological engineering and Semantic Web Rule Language (SWRL) rules to model GitHub attributes and software artifacts. Our evaluation on 195,621 GitHub issues (1,765 GitHub repositories) shows that Etor can automatically detect 548 unethical behavior with 74.8% average true positive rate. This shows the feasibility of automated detection of unethical behavior in OSS projects.


title: Classic Harmonic Oscillator Model of Coupled Metal Nanoparticles with Arbitrary Configuration in Plane

abstract: A classic harmonic oscillator model is developed to investigate the optical properties of coupled metal nanoparticles (MNPs) with arbitrary configuration in plane. The coupling coefficients are derived from classical electrodynamics. Using this model, we can easily obtain the spectra of coupled MNPs varying with the configurations of the system and the polarizations of external light. Furthermore, the far field electric field distributions of different configurations are revealed. This model is an extension of our previous works which only discuss the parallel and vertical excitations for dimer. It is useful to related applications


title: Direct Observation of Tunable Thermal Conductance at Solid/porous Crystalline Solid Interfaces Induced by Water Adsorbents

abstract: Improving interfacial thermal transport is crucial for heat dissipation in systems. Here, we design a strategy by utilizing the water adsorption-desorption process in porous metal-organic frameworks (MOFs) to tune the interfacial heat transfer. We observe a changeable thermal conductance across the solid/porous MOFs interfaces owing to the dense water channel formed by the adsorbed water molecules in MOFs. Our experimental results show that the interfacial thermal conductance of Au/Cu3(BTC)2 heterointerfaces is increased up to 7.1 folds by this strategy, where Cu3(BTC)2 is a typical porous MOF and usually referred to as HKUST-1. Our molecular dynamics simulations further show that the surface tension of Au layer will cause the adsorbed water molecules in HKUST-1 to gather at the interfacial region. The dense water channel formed at the interfacial region can activate the high-frequency lattice vibrations and act as an additional thermal pathway, and then enhance heat transfer across the interfaces significantly. Our findings provide a new concept for tailoring thermal transport at the solid/porous MOFs heterointerfaces which will largely benefit MOF-related applications.


title: Time Complexity of Broadcast and Consensus for Randomized Oblivious Message Adversaries

abstract: Broadcast and consensus are most fundamental tasks in distributed computing. These tasks are particularly challenging in dynamic networks where communication across the network links may be unreliable, e.g., due to mobility or failures. Indeed, over the last years, researchers have derived several impossibility results and high time complexity lower bounds (i.e., linear in the number of nodes $n$) for these tasks, even for oblivious message adversaries where communication networks are rooted trees. However, such deterministic adversarial models may be overly conservative, as many processes in real-world settings are stochastic in nature rather than worst case. This paper initiates the study of broadcast and consensus on stochastic dynamic networks, introducing a randomized oblivious message adversary. Our model is reminiscent of the SI model in epidemics, however, revolving around trees (which renders the analysis harder due to the apparent lack of independence). In particular, we show that if information dissemination occurs along random rooted trees, broadcast and consensus complete fast with high probability, namely in logarithmic time. Our analysis proves the independence of a key variable, which enables a formal understanding of the dissemination process. More formally, for a network with $n$ nodes, we first consider the completely random case where in each round the communication network is chosen uniformly at random among rooted trees. We then introduce the notion of randomized oblivious message adversary, where in each round, an adversary can choose $k$ edges to appear in the communication network, and then a rooted tree is chosen uniformly at random among the set of all rooted trees that include these edges. We show that broadcast completes in $O(k+\log n)$ rounds, and that this it is also the case for consensus as long as $k \le 0.1n$.


title: Metric-oriented Speech Enhancement using Diffusion Probabilistic Model

abstract: Deep neural network based speech enhancement technique focuses on learning a noisy-to-clean transformation supervised by paired training data. However, the task-specific evaluation metric (e.g., PESQ) is usually non-differentiable and can not be directly constructed in the training criteria. This mismatch between the training objective and evaluation metric likely results in sub-optimal performance. To alleviate it, we propose a metric-oriented speech enhancement method (MOSE), which leverages the recent advances in the diffusion probabilistic model and integrates a metric-oriented training strategy into its reverse process. Specifically, we design an actor-critic based framework that considers the evaluation metric as a posterior reward, thus guiding the reverse process to the metric-increasing direction. The experimental results demonstrate that MOSE obviously benefits from metric-oriented training and surpasses the generative baselines in terms of all evaluation metrics.


title: Extension and embedding theorems for Campanato spaces on $C^{0,\gamma}$ domains

abstract: We consider Campanato spaces with exponents $\lambda , p$ on domains of class $C^{0,\gamma}$ in the N-dimensional Euclidean space endowed with a natural anisotropic metric depending on $\gamma$. We discuss several results including the appropriate Campanato's embedding theorem and we prove that functions of those spaces can be extended to the whole of the Euclidean space without deterioration of the exponents $\lambda, p$.


title: Multi-vehicle Dynamic Water Surface Monitoring

abstract: Repeated exploration of a water surface to detect objects of interest and their subsequent monitoring is important in search-and-rescue or ocean clean-up operations. Since the location of any detected object is dynamic, we propose to address the combined surface exploration and monitoring of the detected objects by modeling spatio-temporal reward states and coordinating a team of vehicles to collect the rewards. The model characterizes the dynamics of the water surface and enables the planner to predict future system states. The state reward value relevant to the particular water surface cell increases over time and is nullified by being in a sensor range of a vehicle. Thus, the proposed multi-vehicle planning approach is to minimize the collective value of the dynamic model reward states. The purpose is to address vehicles' motion constraints by using model predictive control on receding horizon, thus fully exploiting the utilized vehicles' motion capabilities. Based on the evaluation results, the approach indicates improvement in a solution to the kinematic orienteering problem and the team orienteering problem in the monitoring task compared to the existing solutions. The proposed approach has been experimentally verified, supporting its feasibility in real-world monitoring tasks.


title: Solving Recurrent MIPs with Semi-supervised Graph Neural Networks

abstract: We propose an ML-based model that automates and expedites the solution of MIPs by predicting the values of variables. Our approach is motivated by the observation that many problem instances share salient features and solution structures since they differ only in few (time-varying) parameters. Examples include transportation and routing problems where decisions need to be re-optimized whenever commodity volumes or link costs change. Our method is the first to exploit the sequential nature of the instances being solved periodically, and can be trained with ``unlabeled'' instances, when exact solutions are unavailable, in a semi-supervised setting. Also, we provide a principled way of transforming the probabilistic predictions into integral solutions. Using a battery of experiments with representative binary MIPs, we show the gains of our model over other ML-based optimization approaches.


title: xURLLC-Aware Service Provisioning in Vehicular Networks: A Semantic Communication Perspective

abstract: Semantic communication (SemCom), as an emerging paradigm focusing on meaning delivery, has recently been considered a promising solution for the inevitable crisis of scarce communication resources. This trend stimulates us to explore the potential of applying SemCom to wireless vehicular networks, which normally consume a tremendous amount of resources to meet stringent reliability and latency requirements. Unfortunately, the unique background knowledge matching mechanism in SemCom makes it challenging to simultaneously realize efficient service provisioning for multiple users in vehicle-to-vehicle networks. To this end, this paper identifies and jointly addresses two fundamental problems of knowledge base construction (KBC) and vehicle service pairing (VSP) inherently existing in SemCom-enabled vehicular networks in alignment with the next-generation ultra-reliable and low-latency communication (xURLLC) requirements. Concretely, we first derive the knowledge matching based queuing latency specific for semantic data packets, and then formulate a latency-minimization problem subject to several KBC and VSP related reliability constraints. Afterward, a SemCom-empowered Service Supplying Solution (S$^{\text{4}}$) is proposed along with the theoretical analysis of its optimality guarantee and computational complexity. Numerical results demonstrate the superiority of S$^{\text{4}}$ in terms of average queuing latency, semantic data packet throughput, user knowledge matching degree and knowledge preference satisfaction compared with two benchmarks.


title: On the analysis of waveguide modes in an electromagnetic transmission line

abstract: Modal expansions are useful to understand wave propagation in an infinite electromagnetic transmission line or waveguide. They can also be used to construct generalized Dirichlet-to-Neumann maps that can be used to provide artificial boundary conditions for truncating a computational domain when discretizing the field by finite elements. The modes of a waveguide arise as eigenfunctions of a non-symmetric eigenvalue problem, and the eigenvalues determine the propagation (or decay) of the modes along the waveguide. For the successful use of waveguide modes, it is necessary to know that the modes exist and form a dense set in a suitable function space containing the trace of the electric field in the waveguide. This paper is devoted to proving such a density result using the methods of Keldysh. We also show that the modes satisfy a useful orthogonality property, and show how the Dirichlet-to-Neumann map can be calculated. Our existence and density results are proved under realistic regularity assumptions on the cross section of the waveguide, and the electromagnetic properties of the materials in the waveguide, so generalizing existing results.


title: Contextuality with disturbance and without: Neither can violate substantive requirements the other satisfies

abstract: Contextuality was originally defined only for consistently connected systems of random variables (those without disturbance/signaling). Contextuality-by-Default theory (CbD) offers an extension of the notion of contextuality to inconsistently connected systems (those with disturbance), by defining it in terms of the systems' couplings subject to certain constraints. Such extensions are sometimes met with skepticism. We pose the question of whether it is possible to develop a set of substantive requirements (i.e., those addressing a notion itself rather than its presentation form) such that (1) for any consistently connected system these requirements are satisfied, but (2) they are violated for some inconsistently connected systems. We show that no such set of requirements is possible, not only for CbD but for all possible CbD-like extensions of contextuality. This follows from the fact that any extended contextuality theory \T is contextually equivalent to a theory \T' in which all systems are consistently connected. The contextual equivalence means the following: there is a bijective correspondence between the systems in \T and \T' such that the corresponding systems in \T and \T' are, in a well-defined sense, mere reformulations of each other, and they are contextual or noncontextual together.


title: K-SHAP: Policy Clustering Algorithm for Anonymous Multi-Agent State-Action Pairs

abstract: Learning agent behaviors from observational data has shown to improve our understanding of their decision-making processes, advancing our ability to explain their interactions with the environment and other agents. While multiple learning techniques have been proposed in the literature, there is one particular setting that has not been explored yet: multi agent systems where agent identities remain anonymous. For instance, in financial markets labeled data that identifies market participant strategies is typically proprietary, and only the anonymous state-action pairs that result from the interaction of multiple market participants are publicly available. As a result, sequences of agent actions are not observable, restricting the applicability of existing work. In this paper, we propose a Policy Clustering algorithm, called K-SHAP, that learns to group anonymous state-action pairs according to the agent policies. We frame the problem as an Imitation Learning (IL) task, and we learn a world-policy able to mimic all the agent behaviors upon different environmental states. We leverage the world-policy to explain each anonymous observation through an additive feature attribution method called SHAP (SHapley Additive exPlanations). Finally, by clustering the explanations we show that we are able to identify different agent policies and group observations accordingly. We evaluate our approach on simulated synthetic market data and a real-world financial dataset. We show that our proposal significantly and consistently outperforms the existing methods, identifying different agent strategies.


title: Beamforming Design with Partial Channel Estimation and Feedback for FDD RIS-Assisted Systems

abstract: Beamforming design with partial channel estimation and feedback for frequency-division duplexing (FDD) reconfigurable intelligent surface (RIS) assisted systems is considered in this paper. We leverage the observation that path angle information (PAI) varies more slowly than path gain information (PGI). Then, several dominant paths are selected among all the cascaded paths according to the known PAI for maximizing the spectral efficiency of downlink data transmission. To acquire the dominating path gain information (DPGI, also regarded as the path gains of selected dominant paths) at the base station (BS), we propose a DPGI estimation and feedback scheme by jointly beamforming design at BS and RIS. Both the required number of downlink pilot signals and the length of uplink feedback vector are reduced to the number of dominant paths, and thus we achieve a great reduction of the pilot overhead and feedback overhead. Furthermore, we optimize the active BS beamformer and passive RIS beamformer by exploiting the feedback DPGI to further improve the spectral efficiency. From numerical results, we demonstrate the superiority of our proposed algorithms over the conventional schemes.


title: On Thermodynamic Stability of Black Holes. Part I: Classical Stability

abstract: We revisit the classical thermodynamic stability of the standard black hole solutions by implementing the intrinsic necessary and sufficient conditions for stable global and local thermodynamic equilibrium. The criteria for such equilibria are quite generic and well-established in classical thermodynamics, but they have not been fully utilized in black hole physics. We show how weaker or incomplete conditions could lead to misleading or incorrect results for the thermodynamic stability of the system. We also stress the importance of finding all possible local heat capacities in order to fully describe the classical equilibrium picture of black holes. Finally, we thoroughly investigate the critical and phase transition curves and the limits of the classical analysis. This paper is the first in the line of intended works on thermodynamic stability of black holes in modified theories of gravity and holography.


title: Exchange Correlation Potentials from Full Configuration Interaction in a Slater Orbital Basis

abstract: Ryabinkin-Kohut-Staroverov (RKS) theory builds a bridge between wave function theory and density functional theory by using quantities from the former to produce accurate exchange-correlation potentials needed by the latter. In this work, the RKS method is developed and tested alongside Slater atomic orbital basis functions for the first time. To evaluate this approach, Full Configuration Interaction computations in the Slater orbitals are employed to give quality input to RKS method, allowing full correlation to be present along with correct nuclei cusps and asymptotic decay of the wavefunction. The RKS method will be shown to be an efficient algorithm to arrive at exchange correlation potentials without unphysical artifacts in moderately-sized basis sets. Furthermore, enforcement of the nuclear cusp conditions will be shown to be vital for the success of the Slater-basis RKS method. Examples of weakly and strongly correlated molecular systems will demonstrate the main features of Slater RKS.


title: Graph Construction using Principal Axis Trees for Simple Graph Convolution

abstract: Graph Neural Networks (GNNs) are increasingly becoming the favorite method for graph learning. They exploit the semi-supervised nature of deep learning, and they bypass computational bottlenecks associated with traditional graph learning methods. In addition to the feature matrix $X$, GNNs need an adjacency matrix $A$ to perform feature propagation. In many cases, the adjacency matrix $A$ is missing. We introduce a graph construction scheme that constructs the adjacency matrix $A$ using unsupervised and supervised information. Unsupervised information characterizes the neighborhood around points. We used Principal Axis trees (PA-trees) as a source for unsupervised information, where we create edges between points falling onto the same leaf node. For supervised information, we used the concept of penalty and intrinsic graphs. A penalty graph connects points with different class labels, whereas an intrinsic graph connects points with the same class labels. We used the penalty and intrinsic graphs to remove or add edges to the graph constructed via PA-tree. We tested this graph construction scheme on two well-known GNNs: 1) Graph Convolutional Network (GCN) and 2) Simple Graph Convolution (SGC). The experiments show that it is better to use SGC because it is faster and delivers better or the same results as GCN. We also test the effect of oversmoothing on both GCN and SGC. We found out that the level of smoothing has to be carefully selected for SGC to avoid oversmoothing.


title: Random Projection Forest Initialization for Graph Convolutional Networks

abstract: Graph convolutional networks (GCNs) were a great step towards extending deep learning to unstructured data such as graphs. But GCNs still need a constructed graph to work with. To solve this problem, classical graphs such as $k$-nearest neighbor are usually used to initialize the GCN. Although it is computationally efficient to construct $k$-nn graphs, the constructed graph might not be very useful for learning. In a $k$-nn graph, points are restricted to have a fixed number of edges, and all edges in the graph have equal weights. We present a new way to construct the graph and initialize the GCN. It is based on random projection forest (rpForest). rpForest enables us to assign varying weights on edges indicating varying importance, which enhanced the learning. The number of trees is a hyperparameter in rpForest. We performed spectral analysis to help us setting this parameter in the right range. In the experiments, initializing the GCN using rpForest provides better results compared to $k$-nn initialization.


title: Master's Thesis: Out-of-distribution Detection with Energy-based Models

abstract: Today, deep learning is increasingly applied in security-critical situations such as autonomous driving and medical diagnosis. Despite its success, the behavior and robustness of deep networks are not fully understood yet, posing a significant risk. In particular, researchers recently found that neural networks are overly confident in their predictions, even on data they have never seen before. To tackle this issue, one can differentiate two approaches in the literature. One accounts for uncertainty in the predictions, while the second estimates the underlying density of the training data to decide whether a given input is close to the training data, and thus the network is able to perform as expected.In this thesis, we investigate the capabilities of EBMs at the task of fitting the training data distribution to perform detection of out-of-distribution (OOD) inputs. We find that on most datasets, EBMs do not inherently outperform other density estimators at detecting OOD data despite their flexibility. Thus, we additionally investigate the effects of supervision, dimensionality reduction, and architectural modifications on the performance of EBMs. Further, we propose Energy-Prior Network (EPN) which enables estimation of various uncertainties within an EBM for classification, bridging the gap between two approaches for tackling the OOD detection problem. We identify a connection between the concentration parameters of the Dirichlet distribution and the joint energy in an EBM. Additionally, this allows optimization without a held-out OOD dataset, which might not be available or costly to collect in some applications. Finally, we empirically demonstrate that Energy-Prior Network (EPN) is able to detect OOD inputs, datasets shifts, and adversarial examples. Theoretically, EPN offers favorable properties for the asymptotic case when inputs are far from the training data.


title: Robust Representation Learning by Clustering with Bisimulation Metrics for Visual Reinforcement Learning with Distractions

abstract: Recent work has shown that representation learning plays a critical role in sample-efficient reinforcement learning (RL) from pixels. Unfortunately, in real-world scenarios, representation learning is usually fragile to task-irrelevant distractions such as variations in background or viewpoint. To tackle this problem, we propose a novel clustering-based approach, namely Clustering with Bisimulation Metrics (CBM), which learns robust representations by grouping visual observations in the latent space. Specifically, CBM alternates between two steps: (1) grouping observations by measuring their bisimulation distances to the learned prototypes; (2) learning a set of prototypes according to the current cluster assignments. Computing cluster assignments with bisimulation metrics enables CBM to capture task-relevant information, as bisimulation metrics quantify the behavioral similarity between observations. Moreover, CBM encourages the consistency of representations within each group, which facilitates filtering out task-irrelevant information and thus induces robust representations against distractions. An appealing feature is that CBM can achieve sample-efficient representation learning even if multiple distractions exist simultaneously.Experiments demonstrate that CBM significantly improves the sample efficiency of popular visual RL algorithms and achieves state-of-the-art performance on both multiple and single distraction settings. The code is available at https://github.com/MIRALab-USTC/RL-CBM.


title: Knowledge Distillation-based Information Sharing for Online Process Monitoring in Decentralized Manufacturing System

abstract: In advanced manufacturing, the incorporation of sensing technology provides an opportunity to achieve efficient in-situ process monitoring using machine learning methods. Meanwhile, the advances of information technologies also enable a connected and decentralized environment for manufacturing systems, making different manufacturing units in the system collaborate more closely. In a decentralized manufacturing system, the involved units may fabricate same or similar products and deploy their own machine learning model for online process monitoring. However, due to the possible inconsistency of task progress during the operation, it is also common that some units have more informative data while some have less informative data. Thus, the monitoring performance of machine learning model for each unit may highly vary. Therefore, it is extremely valuable to achieve efficient and secured knowledge sharing among the units in a decentralized manufacturing system for enhancement of poorly performed models. To realize this goal, this paper proposes a novel knowledge distillation-based information sharing (KD-IS) framework, which could distill informative knowledge from well performed models to improve the monitoring performance of poorly performed models. To validate the effectiveness of this method, a real-world case study is conducted in a connected fused filament fabrication (FFF)-based additive manufacturing (AM) platform. The experimental results show that the developed method is very efficient in improving model monitoring performance at poorly performed models, with solid protection on potential data privacy.


title: Constraining Lorentz Invariance Violation with Next-Generation Long-Baseline Experiments

abstract: Unified theories such as string theory and loop quantum gravity allow the Lorentz Invariance Violation (LIV) at the Planck Scale ($M_P \sim 10^{19}$ GeV). Using an effective field theory, this effect can be observed at low energies in terms of new interactions with a strength of $\sim 1/M_P$. These new interactions contain operators with LIV coefficients which can be CPT-violating or CPT-conserving. In this work, we study in detail how these LIV parameters modify the transition probabilities in the next-generation long-baseline experiments, DUNE and T2HK. We evaluate the sensitivities of these experiments in isolation and combination to constrain the off-diagonal CPT-violating ($a_{e\mu}$, $a_{e\tau}$, $a_{\mu\tau}$) and CPT-conserving ($c_{e\mu}$, $c_{e\tau}$, $c_{\mu\tau}$) LIV parameters. We derive approximate compact analytical expressions of $\nu_{\mu}\to\nu_e$ and $\nu_{\mu}\to\nu_\mu$ probabilities in the presence of these LIV parameters to explain our numerical results. We explore the possible correlations and degeneracies between these LIV parameters & 3$\nu$ parameters $\theta_{23}$ & $\delta_{\rm CP}$. We find that for non-maximal values of $\theta_{23}$, there exist degenerate solutions in its opposite octant for standalone DUNE and T2HK. These degeneracies disappear when we combine the data from DUNE and T2HK. In case of no-show, we place the expected bounds on these CPT-violating and CPT-conserving LIV parameters at 95% C.L. using the standalone DUNE, T2HK, and their combination. We observe that due to its access to a longer baseline and high-energy neutrinos, DUNE has a better reach in probing all these LIV parameters as compared to T2HK. Since the terms containing the CPT-conserving LIV parameters are proportional to neutrino energy in oscillation probabilities, T2HK is almost insensitive to the CPT-conserving LIV parameters because it mostly deals with sub-GeV neutrinos.


title: Does the evaluation stand up to evaluation? A first-principle approach to the evaluation of classifiers

abstract: How can one meaningfully make a measurement, if the meter does not conform to any standard and its scale expands or shrinks depending on what is measured? In the present work it is argued that current evaluation practices for machine-learning classifiers are affected by this kind of problem, leading to negative consequences when classifiers are put to real use; consequences that could have been avoided. It is proposed that evaluation be grounded on Decision Theory, and the implications of such foundation are explored. The main result is that every evaluation metric must be a linear combination of confusion-matrix elements, with coefficients - "utilities" - that depend on the specific classification problem. For binary classification, the space of such possible metrics is effectively two-dimensional. It is shown that popular metrics such as precision, balanced accuracy, Matthews Correlation Coefficient, Fowlkes-Mallows index, F1-measure, and Area Under the Curve are never optimal: they always give rise to an in-principle avoidable fraction of incorrect evaluations. This fraction is even larger than would be caused by the use of a decision-theoretic metric with moderately wrong coefficients.


title: DMMG: Dual Min-Max Games for Self-Supervised Skeleton-Based Action Recognition

abstract: In this work, we propose a new Dual Min-Max Games (DMMG) based self-supervised skeleton action recognition method by augmenting unlabeled data in a contrastive learning framework. Our DMMG consists of a viewpoint variation min-max game and an edge perturbation min-max game. These two min-max games adopt an adversarial paradigm to perform data augmentation on the skeleton sequences and graph-structured body joints, respectively. Our viewpoint variation min-max game focuses on constructing various hard contrastive pairs by generating skeleton sequences from various viewpoints. These hard contrastive pairs help our model learn representative action features, thus facilitating model transfer to downstream tasks. Moreover, our edge perturbation min-max game specializes in building diverse hard contrastive samples through perturbing connectivity strength among graph-based body joints. The connectivity-strength varying contrastive pairs enable the model to capture minimal sufficient information of different actions, such as representative gestures for an action while preventing the model from overfitting. By fully exploiting the proposed DMMG, we can generate sufficient challenging contrastive pairs and thus achieve discriminative action feature representations from unlabeled skeleton data in a self-supervised manner. Extensive experiments demonstrate that our method achieves superior results under various evaluation protocols on widely-used NTU-RGB+D and NTU120-RGB+D datasets.


title: Quantum dissipation and the virial theorem

abstract: In this note, we study the celebrated virial theorem for dissipative systems, both classical and quantum. The classical formulation is discussed and an intriguing effect of the random force (noise) is made explicit in the context of the virial theorem. Subsequently, we derive a generalized virial theorem for a dissipative quantum oscillator, i.e. a quantum oscillator coupled with a quantum heat bath. Such a heat bath is modeled as an infinite collection of independent quantum oscillators with a certain distribution of initial conditions. In this situation, the non-Markovian nature of the quantum noise leads to novel bath-induced terms in the virial theorem. We also consider the case of an electrical circuit with thermal noise and analyze the role of non-Markovian noise in the context of the virial theorem.


title: Hybrid VMAT-3DCRT as Breast Treatment Improvement Tool

abstract: Radiation therapy is an important tool in the treatment of breast cancer and can play a crucial role in improving patient outcomes. For breast cancer, if the technique has been for a long time the use of 3DCRT, clinicians have seen the management evolve greatly in recent years. Field-in-field and IMRT approaches and more recently dynamic arctherapy are increasingly present. All of these approaches are constantly trying to improve tumour coverage and to preserve organs at risk by minimising the doses delivered to them. If arctherapy allows a considerable reduction of high doses received by healthy tissues, no one can deny that it also leads to an increase of low doses in tissues that would not have received any with other techniques. It is with this in mind that we propose a hybrid approach combining the robustness of the 3DCRT approach and the high technicality and efficiency of arctherapy. Statistical tests allow us to draw conclusions about the possibility of using the hybrid approach in certain cases (right breast, BMI > 23, age > 48, target volume >350cc, etc.). Indeed, depending on the breast laterality and patients morphological characteristics, hybridization may prove to be a therapeutic tool of choice in the management of breast cancer in radiotherapy. a)


title: Nonextensive effects on QCD chiral phase diagram and baryon-number fluctuations within Polyakov-Nambu-Jona-Lasinio model

abstract: In this paper, a version of the Polyakov-Nambu-Jona-Lasinio (PNJL) model based on nonextensive statistical mechanics is presented. This new statistics summarizes all possible factors that violate the assumptions of the Boltzmann-Gibbs (BG) statistics to a dimensionless nonextensivity parameter $q$, and when $q$ tends to 1, it returns to the BG case. Within the nonextensive PNJL model, we found that as $q$ increases, the location of the critical end point (CEP) exhibits non-monotonic behavior. That is, for $q<1.15$, CEP moves in the direction of lower temperature and larger quark chemical potential. But for $q>1.15$, CEP turns to move in the direction of lower temperature and lower quark chemical potential. In addition, we studied the moments of the net-baryon number distribution, that is, the variance ($\sigma^{2}$), skewness (S), and kurtosis ($\kappa$). Our results are generally consistent with the latest experimental data, especially for $\sqrt{S_{NN}}>19.6\ \mathrm{GeV}$, when $q$ is set to $1.07$.


title: A Generalized Weighted Loss for SVC and MLP

abstract: Usually standard algorithms employ a loss where each error is the mere absolute difference between the true value and the prediction, in case of a regression task. In the present, we introduce several error weighting schemes that are a generalization of the consolidated routine. We study both a binary classification model for Support Vector Classification and a regression net for Multi-layer Perceptron. Results proves that the error is never worse than the standard procedure and several times it is better.


title: Novel Epileptic Seizure Detection Techniques and their Empirical Analysis

abstract: An Electroencephalogram (EEG) is a non-invasive exam that records the brain's electrical activity. This is used to help diagnose conditions such as different brain problems. EEG signals are taken for epilepsy detection, and with Discrete Wavelet Transform (DWT) and machine learning classifier, they perform epilepsy detection. In Epilepsy seizure detection, machine learning classifiers and statistical features are mainly used. The hidden information in the EEG signal helps detect diseases affecting the brain. Sometimes it is complicated to identify the minimum changes in the EEG in the time and frequency domain's purpose. The DWT can give a suitable decomposition of the signals in different frequency bands and feature extraction. We use the tri-dimensionality reduction algorithm, Principal Component Analysis (PCA), Independent Component Analysis (ICA), and Linear Discriminant Analysis (LDA). Finally, features are selected by using a fusion rule and at the last step, three different classifiers, Support Vector Machine (SVM), Naive Bayes (NB), and K-Nearest-Neighbor (KNN) have been used individually for the classification. The proposed framework is tested on the Bonn dataset. The simulation results provide 100% accuracy for the LDA and NB combination outperforming accuracy with other classifiers combinations, including 89.17% for LDA and SVM, 80.42% for LDA and KNN, 89.92% for PCA and NB, 85.58% PCA and SVM, 80.42% PCA and KNN, 82.33% for ICA and NB, 90.42% for ICA and SVM, 90% for ICA and KNN. Also, the LDA and NB combination shows the sensitivity, specificity, accuracy, Precision, and Recall of 100%, 100%, 100%, 100%, and 100%. The results prove the effectiveness of this model.


title: Orders-of-coupling representation with a single neural network with optimal neuron activation functions and without nonlinear parameter optimization

abstract: Representations of multivariate functions with low-dimensional functions that depend on subsets of original coordinates (corresponding of different orders of coupling) are useful in quantum dynamics and other applications, especially where integration is needed. Such representations can be conveniently built with machine learning methods, and previously, methods building the lower-dimensional terms of such representations with neural networks [e.g. Comput. Phys. Comm. 180 (2009) 2002] and Gaussian process regressions [e.g. Mach. Learn. Sci. Technol. 3 (2022) 01LT02] were proposed. Here, we show that neural network models of orders-of-coupling representations can be easily built by using a recently proposed neural network with optimal neuron activation functions computed with a first-order additive Gaussian process regression [arXiv:2301.05567] and avoiding non-linear parameter optimization. Examples are given of representations of molecular potential energy surfaces.


title: normflows: A PyTorch Package for Normalizing Flows

abstract: Normalizing flows model probability distributions through an expressive tractable density. They transform a simple base distribution, such as a Gaussian, through a sequence of invertible functions, which are referred to as layers. These layers typically use neural networks to become very expressive. Flows are ubiquitous in machine learning and have been applied to image generation, text modeling, variational inference, approximating Boltzmann distributions, and many other problems. Here, we present normflows, a Python package for normalizing flows. It allows to build normalizing flow models from a suite of base distributions, flow layers, and neural networks. The package is implemented in the popular deep learning framework PyTorch, which simplifies the integration of flows in larger machine learning models or pipelines. It supports most of the common normalizing flow architectures, such as Real NVP, Glow, Masked Autoregressive Flows, Neural Spline Flows, Residual Flows, and many more. The package can be easily installed via pip and the code is publicly available on GitHub.


title: Entanglement parallelization via quantum Fourier transform

abstract: In this study, we present a technique based on the quantum Fourier transform (QFT) that allows the generation of disjoint sets of entangled particles, in such a way that particles of the same set are entangled with each other, while particles of different sets are completely independent. Several applications of this technique are implemented on three physical platforms, of 5 (Belem), 7 (Oslo), and 14 (Melbourne) qubits, of the international business machine (IBM Q) quantum experience program, where all these applications were specially selected due to their particular commitment to the future Quantum Internet.


title: Asymptotic coarse Lipschitz equivalence

abstract: We introduce the notion of asymptotic coarse Lipschitz equivalence of metric spaces. We show that it is strictly weaker than coarse Lipschitz equivalence. We study its impact on the asymptotic dimension of metric spaces. Then we focus on Banach spaces. We prove that, for $2\leq p<\infty$, being linearly isomorphic to $\ell_p$ is stable under asymptotic coarse Lipschitz equivalences. Finally, we establish a version of the Gorelik principle in this setting and apply it to prove the stability of various properties of asymptotic uniform smoothness of Banach spaces under asymptotic coarse Lipschitz equivalences.


title: Least $H^2$ Norm Updating Quadratic Interpolation Model Function for Derivative-free Trust-region Algorithms

abstract: Derivative-free optimization methods are numerical methods for optimization problems in which no derivative information is used. Such optimization problems are widely seen in many real applications. One particular class of derivative-free optimization algorithms is trust-region algorithms based on quadratic models given by under-determined interpolation. Different techniques in updating the quadratic model from iteration to iteration will give different interpolation models. In this paper, we propose a new way to update the quadratic model by minimizing the $H^2$ norm of the difference between neighbouring quadratic models. Motivation for applying the $H^2$ norm is given, and theoretical properties of our new updating technique are also presented. Projection in the sense of $H^2$ norm and interpolation error analysis of our model function are proposed. We obtain the coefficients of the quadratic model function by using the KKT conditions. Numerical results show advantages of our model, and the derivative-free algorithms based on our least $H^2$ norm updating quadratic model functions can solve test problems with fewer function evaluations than algorithms based on least Frobenius norm updating.


title: Gaussian Switch Sampling: A Second Order Approach to Active Learning

abstract: In active learning, acquisition functions define informativeness directly on the representation position within the model manifold. However, for most machine learning models (in particular neural networks) this representation is not fixed due to the training pool fluctuations in between active learning rounds. Therefore, several popular strategies are sensitive to experiment parameters (e.g. architecture) and do not consider model robustness to out-of-distribution settings. To alleviate this issue, we propose a grounded second-order definition of information content and sample importance within the context of active learning. Specifically, we define importance by how often a neural network "forgets" a sample during training - artifacts of second order representation shifts. We show that our definition produces highly accurate importance scores even when the model representations are constrained by the lack of training data. Motivated by our analysis, we develop Gaussian Switch Sampling (GauSS). We show that GauSS is setup agnostic and robust to anomalous distributions with exhaustive experiments on three in-distribution benchmarks, three out-of-distribution benchmarks, and three different architectures. We report an improvement of up to 5% when compared against four popular query strategies.


title: Forecasting and stabilizing chaotic regimes in two macroeconomic models via artificial intelligence technologies and control methods

abstract: One of the key tasks in the economy is forecasting the economic agents' expectations of the future values of economic variables using mathematical models. The behavior of mathematical models can be irregular, including chaotic, which reduces their predictive power. In this paper, we study the regimes of behavior of two economic models and identify irregular dynamics in them. Using these models as an example, we demonstrate the effectiveness of evolutionary algorithms and the continuous deep Q-learning method in combination with Pyragas control method for deriving a control action that stabilizes unstable periodic trajectories and suppresses chaotic dynamics. We compare qualitative and quantitative characteristics of the model's dynamics before and after applying control and verify the obtained results by numerical simulation. Proposed approach can improve the reliability of forecasting and tuning of the economic mechanism to achieve maximum decision-making efficiency.


title: Personalized Privacy-Preserving Framework for Cross-Silo Federated Learning

abstract: Federated learning (FL) is recently surging as a promising decentralized deep learning (DL) framework that enables DL-based approaches trained collaboratively across clients without sharing private data. However, in the context of the central party being active and dishonest, the data of individual clients might be perfectly reconstructed, leading to the high possibility of sensitive information being leaked. Moreover, FL also suffers from the nonindependent and identically distributed (non-IID) data among clients, resulting in the degradation in the inference performance on local clients' data. In this paper, we propose a novel framework, namely Personalized Privacy-Preserving Federated Learning (PPPFL), with a concentration on cross-silo FL to overcome these challenges. Specifically, we introduce a stabilized variant of the Model-Agnostic Meta-Learning (MAML) algorithm to collaboratively train a global initialization from clients' synthetic data generated by Differential Private Generative Adversarial Networks (DP-GANs). After reaching convergence, the global initialization will be locally adapted by the clients to their private data. Through extensive experiments, we empirically show that our proposed framework outperforms multiple FL baselines on different datasets, including MNIST, Fashion-MNIST, CIFAR-10, and CIFAR-100.


title: Derivative-Free Optimization with Transformed Objective Functions (DFOTO) and the Algorithm Based on the Least Frobenius Norm Updating Quadratic Model

abstract: Derivative-free optimization problems are optimization problems where derivative information is unavailable. The least Frobenius norm updating quadratic interpolation model function is one of the essential under-determined model functions for model-based derivative-free trust-region methods. This article proposes derivative-free optimization with transformed objective functions and gives a trust-region method with the least Frobenius norm model. The model updating formula is based on Powell's formula. The method shares the same framework with those for problems without transformations, and its query scheme is given. We propose the definitions related to optimality-preserving transformations to understand the interpolation model in our method. We prove the existence of model optimality-preserving transformations beyond translation transformation. The necessary and sufficient condition for such transformations is given. The affine transformation with a positive multiplication coefficient is not model optimality-preserving. We also analyze the corresponding least Frobenius norm updating model and its interpolation error when the objective function is affinely transformed. Convergence property of a provable algorithmic framework containing our model is given. Numerical results of solving test problems and a real-world problem with the implementation NEWUOA-Trans show that our method can successfully solve most problems with objective optimality-preserving transformations, even though such transformations will change the optimality of the model function. To our best knowledge, this is the first work providing the model-based derivative-free algorithm and analysis for transformed problems with the function evaluation oracle (not the function-value comparison oracle). This article also proposes the "moving-target" optimization problem.


title: DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule

abstract: We propose a tuning-free dynamic SGD step size formula, which we call Distance over Gradients (DoG). The DoG step sizes depend on simple empirical quantities (distance from the initial point and norms of gradients) and have no ``learning rate'' parameter. Theoretically, we show that a slight variation of the DoG formula enjoys strong parameter-free convergence guarantees for stochastic convex optimization assuming only \emph{locally bounded} stochastic gradients. Empirically, we consider a broad range of vision and language transfer learning tasks, and show that DoG's performance is close to that of SGD with tuned learning rate. We also propose a per-layer variant of DoG that generally outperforms tuned SGD, approaching the performance of tuned Adam. A PyTorch implementation is available at https://github.com/formll/dog


title: Third sound detectors in accelerated motion

abstract: An accelerated observer moving through empty space sees particles appearing and disappearing, while an observer with a constant velocity does not register any particles. This phenomenon, generally known as the Unruh effect, relies on an initial vacuum state, thereby unifying the experience of all inertial observers. We propose an experiment to probe this observer-dependent detector response, using a laser beam in circular motion as a local detector of superfluid helium-4 surface modes or third sound waves. To assess experimental feasibility, we develop a theoretical framework to include a non-zero temperature initial state. We find that an acceleration-dependent signal persists, independent of the initial temperature. By introducing a signal-to-noise measure we show that observing this signal is within experimental reach.


title: Comparative Study of Coupling and Autoregressive Flows through Robust Statistical Tests

abstract: Normalizing Flows have emerged as a powerful brand of generative models, as they not only allow for efficient sampling of complicated target distributions, but also deliver density estimation by construction. We propose here an in-depth comparison of coupling and autoregressive flows, both of the affine and rational quadratic spline type, considering four different architectures: Real-valued Non-Volume Preserving (RealNVP), Masked Autoregressive Flow (MAF), Coupling Rational Quadratic Spline (C-RQS), and Autoregressive Rational Quadratic Spline (A-RQS). We focus on a set of multimodal target distributions of increasing dimensionality ranging from 4 to 400. The performances are compared by means of different test-statistics for two-sample tests, built from known distance measures: the sliced Wasserstein distance, the dimension-averaged one-dimensional Kolmogorov-Smirnov test, and the Frobenius norm of the difference between correlation matrices. Furthermore, we include estimations of the variance of both the metrics and the trained models. Our results indicate that the A-RQS algorithm stands out both in terms of accuracy and training speed. Nonetheless, all the algorithms are generally able, without too much fine-tuning, to learn complicated distributions with limited training data and in a reasonable time, of the order of hours on a Tesla A40 GPU. The only exception is the C-RQS, which takes significantly longer to train, does not always provide good accuracy, and becomes unstable for large dimensionalities. All algorithms have been implemented using TensorFlow2 and TensorFlow Probability and made available on \href{https://github.com/NF4HEP/NormalizingFlowsHD}{GitHub}.


title: Even-odd alternative dispersions and beyond. Part I. Oscillations on both sides of the (anti-)shock, shocliton and other indications

abstract: We have two basic observations: mathematically, the variational principle and Hamiltonian formulation of some models, such as the Korteweg-de Vries (KdV) equation, are preserved, \textit{mutatis mutandis}, if each mode of freedom is assigned a different dispersion coefficient; and, physically, (similar) dispersive oscillations appear on both sides of some ion-acoustic and quantum shocks, not generated by the dynamics of the models such as the KdV(-Burgers) equation. We thus consider assigning different types of dispersions for different dynamical modes, particularly with the alternation of the signs for alternative Fourier components, different to the two-sided KdV equations for head-on collisions of nonlinear waves. The KdV equation with periodic boundary condition and longest-wave sinusoidal initial field, as used by N. Zabusky and M. D. Kruskal, is chosen for our case study with such alternating-dispersion of the Fourier modes of (normalized) even and odd wavenumbers. Numerical results verify the capability of our model to produce two-sided (around the shock) similar oscillations and indicate even more, including the notion of (anti)shock-soliton duality and/or ``(anti)shocliton'', singular zero-dispersion limit or non-convergence to the classical shock (described by the entropy solution) and non-thermalization (of the Galerkin-truncated models). Extensions to other models and generalization of the mode-dependent dispersion models are also discussed, showcased respectively with Benjamin-Ono-type and the modified-KdV ones. A tentative physical application oriented towards modeling the ion-acoustic shock with the even-odd alternative dispersion model is made to compare against the traditional KdV-Burgers approach.


title: Probing chiral-even and chiral-odd leading twist quark generalised parton distributions through the exclusive photoproduction of a $ \gamma \rho $ pair

abstract: We extend our studies of a new class of $2 \to 3$ exclusive processes using the collinear factorisation framework by considering the exclusive photoproduction of a $\gamma\,\rho$ pair, in the kinematics where the pair has a large invariant mass, {and the outgoing $ \rho $-meson has a sufficiently large transverse momentum to not resonate with the nucleon}. We cover the whole kinematical range from medium energies in fixed target experiments to very large energies of colliders, by considering the experimental conditions of JLab~12-GeV, COMPASS, future EIC and LHC (in ultra-peripheral collisions) cases. One of the main interest in studying the present process is that it provides access to both chiral-even and chiral-odd GPDs, depending on the polarisation of the outgoing $\rho$-meson, both at leading twist. Our analysis covers both neutral and charged $ \rho $-mesons. We find that the order of magnitude of the obtained cross sections are sufficiently large for a dedicated experimental analysis to be performed, especially at JLab, for both longitudinally and transversely polarised $\rho$. Furthermore, we compute the linear photon beam polarisation asymmetry {which is} sizeable for a longitudinally polarised meson. These predictions are obtained for both asymptotic distribution amplitude (DA) and the \textit{holographic} DA.


title: Forecasting with Deep Learning

abstract: This paper presents a method for time series forecasting with deep learning and its assessment on two datasets. The method starts with data preparation, followed by model training and evaluation. The final step is a visual inspection. Experimental work demonstrates that a single time series can be used to train deep learning networks if time series in a dataset contain patterns that repeat even with a certain variation. However, for less structured time series such as stock market closing prices, the networks perform just like a baseline that repeats the last observed value. The implementation of the method as well as the experiments are open-source.


title: Novel Class Discovery: an Introduction and Key Concepts

abstract: Novel Class Discovery (NCD) is a growing field where we are given during training a labeled set of known classes and an unlabeled set of different classes that must be discovered. In recent years, many methods have been proposed to address this problem, and the field has begun to mature. In this paper, we provide a comprehensive survey of the state-of-the-art NCD methods. We start by formally defining the NCD problem and introducing important notions. We then give an overview of the different families of approaches, organized by the way they transfer knowledge from the labeled set to the unlabeled set. We find that they either learn in two stages, by first extracting knowledge from the labeled data only and then applying it to the unlabeled data, or in one stage by conjointly learning on both sets. For each family, we describe their general principle and detail a few representative methods. Then, we briefly introduce some new related tasks inspired by the increasing number of NCD works. We also present some common tools and techniques used in NCD, such as pseudo labeling, self-supervised learning and contrastive learning. Finally, to help readers unfamiliar with the NCD problem differentiate it from other closely related domains, we summarize some of the closest areas of research and discuss their main differences.


title: Online Minimum Spanning Trees with Weight Predictions

abstract: We consider the minimum spanning tree problem with predictions, using the weight-arrival model, i.e., the graph is given, together with predictions for the weights of all edges. Then the actual weights arrive one at a time and an irrevocable decision must be made regarding whether or not the edge should be included into the spanning tree. In order to assess the quality of our algorithms, we define an appropriate error measure and analyze the performance of the algorithms as a function of the error. We prove that, according to competitive analysis, the simplest algorithm, Follow-the-Predictions, is optimal. However, intuitively, one should be able to do better, and we present a greedy variant of Follow-the-Predictions. In analyzing that algorithm, we believe we present the first random order analysis of a non-trivial online algorithm with predictions, by which we obtain an algorithmic separation. This may be useful for distinguishing between algorithms for other problems when Follow-the-Predictions is optimal according to competitive analysis.


title: Back-end and Flexible Substrate Compatible Analog Ferroelectric Field Effect Transistors for Accurate Online Training in Deep Neural Network Accelerators

abstract: Online training of deep neural networks (DNN) can be significantly accelerated by performing in-situ vector matrix multiplication in a crossbar array of analog memories. However, training accuracies often suffer due to device non-idealities such as nonlinearity, asymmetry, limited bit precision and dynamic weight update range within constrained power budget. Here, we report a three-terminal Ferroelectric-Field-Effect-Transistor based on low thermal budget processes that can work efficiently as an analog synaptic transistor. Ferroelectric polymer P(VDF-TrFE) as the gate insulator and 2D semiconductor MoS2 as the n-type semiconducting channel material makes them suitable for flexible and wearable substrate integration. The analog conductance of the FeFETs can be precisely manipulated by employing a ferroelectric-dielectric layer as the gate stack. The ferroelectric-only devices show excellent performance as digital non-volatile memory operating at +-5V while the hybrid ferroelectric-dielectric devices show quasi-continuous resistive switching resulting from gradual ferroelectric domain rotation, important for their multibit operation. Analog conductance states of the hybrid devices allow linearity and symmetry of weight updates and produce a dynamic conductance range of 104 with >16 reproducible conducting states. Network training experiments of these FeFETs show >96% classification accuracy with MNIST handwritten datasets highlighting their potential for implementation in scaled DNN architectures.


title: Gradient descent-based freeform optics design using algorithmic differentiable non-sequential ray tracing

abstract: Algorithmic differentiable ray tracing is a new paradigm that allows one to solve the forward problem of how light propagates through an optical system while obtaining gradients of the simulation results with respect to parameters specifying the optical system. Specifically, the use of algorithmically differentiable non-sequential ray tracing provides an opportunity in the field of illumination design. We demonstrate its potential by designing freeform lenses that project a prescribed irradiance distribution onto a plane. The challenge consists in finding a suitable surface geometry of the lens so that the light emitted by a light source is redistributed into a desired irradiance distribution. We discuss the crucial steps allowing the non-sequential ray tracer to be differentiable. The obtained gradients are used to optimize the geometry of the freeform, and we investigate the effectiveness of adding a multi-layer perceptron neural network to the optimization that outputs parameters defining the freeform lens. Lenses are designed for various sources such as collimated ray bundles or point sources, and finally, a grid of point sources approximating an extended source. The obtained lens designs are finally validated using the commercial non-sequential ray tracer LightTools.


title: Extension of General Relativity with MOND limit predicts novel orbital structure in and around galaxies

abstract: Detailed knowledge of the different classes of stellar orbits that can be accommodated in a given galactic potential is a prerequisite when building self-consistent models using for instance the Schwazschild technique. Furthermore, observational properties of galaxies depend on what these classes of orbits are and on the presence of chaos in the systems. In the realistic case in which the starting point for modeling is not a gravitational potential, but an observed density distribution, we will require a gravitational theory to make the connection between the stars that we see and the movement these stars may be having. The argument can be turned upside down: understanding what orbits may be allowed by each gravitational theory may give us a greater insight on what these theories are and on how we can test them. Our aim is thus to understand novel properties of orbits that are predicted by the latest extension of the MOND phenomenology into the relativistic world. We integrated orbits numerically in a fixed density distribution. The potential required for such integration was obtained also numerically by assuming different gravitational models. We find that thanks to the presence of a mass term in the field equations, the theory can allocate new classes of orbits that do not exist in Newtonian gravity nor standard MOND. We discuss consequences that these new families of orbits can have in non-linear cosmological structure formation as well as explore a possible alternative model for galactic structure based on them.


title: Emergent charge density wave featuring quasi-one-dimensional chains in Ta-intercalated bilayer 2$H$-TaS$_{2}$ with coexisting superconductivity

abstract: Recently, intercalation emerges as an effective way to manipulate ground-state properties and enrich quantum phase diagrams of layered transition metal dichalcogenides (TMDCs). In this work, we focus on fully Ta-intercalated bilayer 2$H$-TaS$_{2}$ with a stoichiometry of Ta$_{3}$S$_{4}$, which has recently been experimentally synthesized. Based on first-principles calculations, we computationally show the suppression of an intrinsic $3\times3$ charge-density wave (CDW) in the TaS$_{2}$ layer, and the emergence of a $2\times1$ CDW in intercalated Ta layer. The formation of the CDW in Ta$_{3}$S$_{4}$ is triggered by strong electron-phonon coupling (EPC) between the $d$-like orbitals of intercalated Ta atoms via the imaginary phonon modes at M point. A 2$\times$1 CDW structure is identified, featuring quasi-one-dimensional Ta chains, attributable to the competition between the CDW displacements associated with potential CDW vectors ($\boldsymbol{q}_{\text{CDW}}$s). Superconductivity is found to coexist with the 2$\times$1 CDW in Ta$_{3}$S$_{4}$, with an estimated superconducting transition temperature ($T_{\mathrm{c}}$) of 3.0 K, slightly higher than that of bilayer TaS$_{2}$. The Ta$_{3}$S$_{4}$ structures of non-CDW, 2$\times$1 CDW, and $2\times$2 CDW can be switched by strain. Our work enriches the phase diagram of TaS$_{2}$, offers a candidate material for studying the interplay between CDW and superconductivity, and highlights intercalation as an effective way to tune the physical properties of layered materials.


title: Variable selection in linear regression models: choosing the best subset is not always the best choice

abstract: Variable selection in linear regression settings is a much discussed problem. Best subset selection (BSS) is often considered the intuitive 'gold standard', with its use being restricted only by its NP-hard nature. Alternatives such as the least absolute shrinkage and selection operator (Lasso) or the elastic net (Enet) have become methods of choice in high-dimensional settings. A recent proposal represents BSS as a mixed integer optimization problem so that much larger problems have become feasible in reasonable computation time. We present an extensive neutral comparison assessing the variable selection performance, in linear regressions, of BSS compared to forward stepwise selection (FSS), Lasso and Enet. The simulation study considers a wide range of settings that are challenging with regard to dimensionality (with respect to the number of observations and variables), signal-to-noise ratios and correlations between predictors. As main measure of performance, we used the best possible F1-score for each method to ensure a fair comparison irrespective of any criterion for choosing the tuning parameters, and results were confirmed by alternative performance measures. Somewhat surprisingly, it was only in settings where the signal-to-noise ratio was high and the variables were (nearly) uncorrelated that BSS reliably outperformed the other methods, even in low-dimensional settings. Further, the FSS's performance was nearly identical to BSS. Our results shed new light on the usual presumption of BSS being, in principle, the best choice for variable selection. Especially for correlated variables, alternatives like Enet are faster and appear to perform better in practical settings.


title: On classical orthogonal polynomials and the Cholesky factorization of a class of Hankel matrices

abstract: Classical moment functionals (Hermite, Laguerre, Jacobi, Bessel) can be characterized as those linear functionals whose moments satisfy a second order linear recurrence relation. In this work, we use this characterization to link the theory of classical orthogonal polynomials and the study of Hankel matrices whose entries satisfy a second order linear recurrence relation. Using the recurrent character of the entries of such Hankel matrices, we give several characterizations of the triangular and diagonal matrices involved in their Cholesky factorization and connect them with a corresponding characterization of classical orthogonal polynomials.