title: Online Knowledge Distillation via Multi-branch Diversity Enhancement

abstract: Knowledge distillation is an effective method to transfer the knowledge from the cumbersome teacher model to the lightweight student model. Online knowledge distillation uses the ensembled prediction results of multiple student models as soft targets to train each student model. However, the homogenization problem will lead to difficulty in further improving model performance. In this work, we propose a new distillation method to enhance the diversity among multiple student models. We introduce Feature Fusion Module (FFM), which improves the performance of the attention mechanism in the network by integrating rich semantic information contained in the last block of multiple student models. Furthermore, we use the Classifier Diversification(CD) loss function to strengthen the differences between the student models and deliver a better ensemble result. Extensive experiments proved that our method significantly enhances the diversity among student models and brings better distillation performance. We evaluate our method on three image classification datasets: CIFAR-10/100 and CINIC-10. The results show that our method achieves state-of-the-art performance on these datasets.


title: JAKET: Joint Pre-training of Knowledge Graph and Language Understanding

abstract: Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information from KG into language modeling. And the understanding of a knowledge graph requires related context. We propose a novel joint pre-training framework, JAKET, to model both the knowledge graph and language. The knowledge module and language module provide essential information to mutually assist each other: the knowledge module produces embeddings for entities in text while the language module generates context-aware initial embeddings for entities and relations in the graph. Our design enables the pre-trained model to easily adapt to unseen knowledge graphs in new domains. Experimental results on several knowledge-aware NLP tasks show that our proposed framework achieves superior performance by effectively leveraging knowledge in language understanding.


title: Exact Solutions and Symmetry Analysis of a Boussinesq type Equation for Longitudinal Waves through a Magneto-Electro-Elastic Circular Rod

abstract: In this work the longitudinal wave equation through magneto-electro-elastic circular rod is studied analytically. Painlev\'e test is performed to check integrability of the equation. Exact solitary wave solutions are found by homogeneous balance method and Tanh method and are plotted using suitable values of physical parameters. A similar solution to an earlier related work [17, 20] is obtained. However we have obtained a new solution as well. Lie symmetry analysis has been done and similarity reduction of the equation is presented. Numerical results related to phase velocity etc for different materials has been derived and compared.


title: (Dis)connectedness of nonlocal minimal surfaces in a cylinder and a stickiness property

abstract: We consider nonlocal minimal surfaces in a cylinder with prescribed datum given by the complement of a slab. We show that when the width of the slab is large the minimizers are disconnected and when the width of the slab is small the minimizers are connected. This feature is in agreement with the classical case of the minimal surfaces. Nevertheless, we show that when the width of the slab is large the minimizers are not flat discs, as it happens in the classical setting, and, in particular, in dimension $2$ we provide a quantitative bound on the stickiness property exhibited by the minimizers. Moreover, differently from the classical case, we show that when the width of the slab is small then the minimizers completely adhere to the side of the cylinder, thus providing a further example of stickiness phenomenon.


title: Intruder Dynamics in a Frictional Granular Fluid: A Molecular Dynamics Study

abstract: We study the dynamics of an intruder moving through a fluidized granular medium in three dimensions ($d=3$). The intruder and grains have both translational and rotational degrees of freedom. The energy-dissipation mechanism is solid friction between all pairs of particles. We keep the granular system fluidized even at rather high densities by randomly perturbing the linear and angular velocities of the grains. We apply a constant external force of magnitude $F$ to the intruder, and obtain its steady state velocity $V_s$ in the center-of-mass frame of the grains. The $F$-$V_s$ relation is of great interest in the industrial processing of granular matter, and has been the subject of most experiments on this problem. We also obtain the mobility, which is proportional to the inverse viscosity, as a function of the volume fraction $\phi$. This is shown to diverge at the jamming volume fraction. For $\phi$ below the jamming fraction, we find that $V_s \sim F$ for small $F$ and $V_s \sim F^{1/2}$ for large $F$. The intruder shows diffusive motion in the plane perpendicular to the direction of the external force.


title: Averaging of thermoacoustic azimuthal instabilities

abstract: We consider the acoustic flow field of rotationally symmetric systems, like an annular combustor and the flow in a round duct, in absence of a mean azimuthal flow field. We focus on azimuthal instabilities, which manifest as either spinning (rotating) waves or standing waves, or a linear combination of the two. These instabilities are often excited by some level of background noise that makes the system randomly change between spinning and standing states, undergo amplitude variations and changes to the azimuthal orientation of the solution. To account for this random change, we make use of a novel ansatz to track as a function of time the amplitude, orientation, nature (standing/spinning) and temporal phase of these instabilities. To capture the effect of the background noise, we apply stochastic averaging on the governing equations and obtain a novel differential equation. The equation allows to study the effects of acoustic sources and sinks on the statistics of the solution, and of explicit and spontaneous symmetry breaking and noise intensity. We focus on this last effect and show how the noise intensity affects the system preference for spinning and/or standing states. We find for example that, when present, background noise pushes the system away from spinning states and towards standing states, consistently with experiments and numerical simulations.


title: Block-wise Image Transformation with Secret Key for Adversarially Robust Defense

abstract: In this paper, we propose a novel defensive transformation that enables us to maintain a high classification accuracy under the use of both clean images and adversarial examples for adversarially robust defense. The proposed transformation is a block-wise preprocessing technique with a secret key to input images. We developed three algorithms to realize the proposed transformation: Pixel Shuffling, Bit Flipping, and FFX Encryption. Experiments were carried out on the CIFAR-10 and ImageNet datasets by using both black-box and white-box attacks with various metrics including adaptive ones. The results show that the proposed defense achieves high accuracy close to that of using clean images even under adaptive attacks for the first time. In the best-case scenario, a model trained by using images transformed by FFX Encryption (block size of 4) yielded an accuracy of 92.30% on clean images and 91.48% under PGD attack with a noise distance of 8/255, which is close to the non-robust accuracy (95.45%) for the CIFAR-10 dataset, and it yielded an accuracy of 72.18% on clean images and 71.43% under the same attack, which is also close to the standard accuracy (73.70%) for the ImageNet dataset. Overall, all three proposed algorithms are demonstrated to outperform state-of-the-art defenses including adversarial training whether or not a model is under attack.


title: PrognoseNet: A Generative Probabilistic Framework for Multimodal Position Prediction given Context Information

abstract: The ability to predict multiple possible future positions of the ego-vehicle given the surrounding context while also estimating their probabilities is key to safe autonomous driving. Most of the current state-of-the-art Deep Learning approaches are trained on trajectory data to achieve this task. However trajectory data captured by sensor systems is highly imbalanced, since by far most of the trajectories follow straight lines with an approximately constant velocity. This poses a huge challenge for the task of predicting future positions, which is inherently a regression problem. Current state-of-the-art approaches alleviate this problem only by major preprocessing of the training data, e.g. resampling, clustering into anchors etc. In this paper we propose an approach which reformulates the prediction problem as a classification task, allowing for powerful tools, e.g. focal loss, to combat the imbalance. To this end we design a generative probabilistic model consisting of a deep neural network with a Mixture of Gaussian head. A smart choice of the latent variable allows for the reformulation of the log-likelihood function as a combination of a classification problem and a much simplified regression problem. The output of our model is an estimate of the probability density function of future positions, hence allowing for prediction of multiple possible positions while also estimating their probabilities. The proposed approach can easily incorporate context information and does not require any preprocessing of the data.


title: Ranging success probability of PPP distributed automotive radar in presence of generalized fading

abstract: In automotive radar applications, multiple radars are used in all vehicles for improving the imaging quality. However this causes radar-to-radar interference from neighbouring vehicles, thus reducing the imaging quality. One metric to measure the imaging quality is ranging success probability. The ranging success probability is the probability that a multiple radar system successfully detects an object at a given range, under certain operating conditions. In state-of-the-art literature, closed form expressions for ranging success probability have been derived assuming no fading in desired signal component. Similarly in literature, though distribution of fading in interferers is assumed to be arbitrary, closed form expression is derived only for no-fading assumption in interferers. As fading is always present in a wireless channel, we have derived ranging success probability assuming desired channel experiences the popular Rayleigh fading. And we have assumed generalized $\kappa$-$\mu$ shadowed fading for interfering channels that generalizes many popular fading models such as Rayleigh, Rician, Nakagami-$m$, $\kappa$-$\mu$ etc. The interferers are assumed to be located on points drawn from a Poisson point process distribution. We have also studied how the relationship between shadowing component and number of clusters can affect the impact of LOS component on ranging success probability.


title: Kac-Rice formulas and the number of solutions of parametrized systems of polynomial equations

abstract: Kac-Rice formulas express the expected number of elements a fiber of a random field has in terms of a multivariate integral. We consider here parametrized systems of polynomial equations that are linear in enough parameters, and provide a Kac-Rice formula for the expected number of solutions of the system when the parameters follow continuous distributions. Combined with Monte Carlo integration, we apply the formula to partition the parameter region according to the number of solutions or find a region in parameter space where the system has the maximal number of solutions. The motivation stems from the study of steady states of chemical reaction networks and gives new tools for the open problem of identifying the parameter region where the network has at least two positive steady states. We illustrate with numerous examples that our approach successfully handles a larger number of parameters than exact methods.


title: Terracini Convexity

abstract: We present a generalization of the notion of neighborliness to non-polyhedral convex cones. Although a definition of neighborliness is available in the non-polyhedral case in the literature, it is fairly restrictive as it requires all the low-dimensional faces to be polyhedral. Our approach is more flexible and includes, for example, the cone of positive-semidefinite matrices as a special case (this cone is not neighborly in general). We term our generalization Terracini convexity due to its conceptual similarity with the conclusion of Terracini's lemma from algebraic geometry. Polyhedral cones are Terracini convex if and only if they are neighborly. More broadly, we derive many families of non-polyhedral Terracini convex cones based on neighborly cones, linear images of cones of positive semidefinite matrices, and derivative relaxations of Terracini convex hyperbolicity cones. As a demonstration of the utility of our framework in the non-polyhedral case, we give a characterization based on Terracini convexity of the tightness of semidefinite relaxations for certain inverse problems.


title: Deep4Air: A Novel Deep Learning Framework for Airport Airside Surveillance

abstract: An airport runway and taxiway (airside) area is a highly dynamic and complex environment featuring interactions between different types of vehicles (speed and dimension), under varying visibility and traffic conditions. Airport ground movements are deemed safety-critical activities, and safe-separation procedures must be maintained by Air Traffic Controllers (ATCs). Large airports with complicated runway-taxiway systems use advanced ground surveillance systems. However, these systems have inherent limitations and a lack of real-time analytics. In this paper, we propose a novel computer-vision based framework, namely "Deep4Air", which can not only augment the ground surveillance systems via the automated visual monitoring of runways and taxiways for aircraft location, but also provide real-time speed and distance analytics for aircraft on runways and taxiways. The proposed framework includes an adaptive deep neural network for efficiently detecting and tracking aircraft. The experimental results show an average precision of detection and tracking of up to 99.8% on simulated data with validations on surveillance videos from the digital tower at George Bush Intercontinental Airport. The results also demonstrate that "Deep4Air" can locate aircraft positions relative to the airport runway and taxiway infrastructure with high accuracy. Furthermore, aircraft speed and separation distance are monitored in real-time, providing enhanced safety management.


title: Large negative magnetoresistance in BaMn$_2$Bi$_2$ antiferromagnet

abstract: A very large negative magnetoresistance (LNMR) is observed in the insulating regime of the antiferromagnet BaMn$_2$Bi$_2$ when a magnetic field is applied perpendicular to the direction of the sublattice magnetization. High perpendicular magnetic field eventually suppresses the insulating behavior and allows BaMn$_2$Bi$_2$ to re-enter a metallic state. This effect is seemingly unrelated to any field induced magnetic phase transition, as measurements of magnetic susceptibility and specific heat did not find any anomaly as a function of magnetic fields at temperatures above $2\,\mathrm{K}$. The LNMR appears in both current-in-plane and current-out-of-plane settings, and Hall effects suggest that its origin lies in an extreme sensitivity of conduction processes of holelike carriers to the infinitesimal field-induced canting of the sublattice magnetization. The LNMR-induced metallic state may thus be associated with the breaking of the antiferromagnetic parity-time symmetry by perpendicular magnetic fields and/or the intricate multi-orbital electronic structure of BaMn$_2$Bi$_2$.


title: WISE J044232.92+322734.9: A star-forming galaxy at redshift 1.1 seen through a Galactic dust clump?

abstract: Physically unassociated background or foreground objects seen towards submillimetre sources are potential contaminants of both the studies of young stellar objects embedded in Galactic dust clumps and multiwavelength counterparts of submillimetre galaxies (SMGs). We employed the near-infrared and mid-infrared data from the Wide-field Infrared Survey Explorer (WISE) and the submillimetre data from the Planck satellite, and uncovered a source, namely WISE J044232.92+322734.9, whose WISE infrared colours suggest that it is a star-forming galaxy (SFG), and which is seen in projection towards the Planck-detected dust clump PGCC G169.20-8.96. We used the MAGPHYS+photo-$z$ spectral energy distribution code to derive the photometric redshift and physical properties of J044232.92. The redshift was derived to be $z_{\rm phot}=1.132^{+0.280}_{-0.165}$, while, for example, the stellar mass, IR (8-1 000 $\mu$m) luminosity, and star formation rate were derived to be $M_{\star}=4.6^{+4.7}_{-2.5}\times10^{11}$ M$_{\odot}$, $L_{\rm IR}=2.8^{+5.7}_{-1.5}\times10^{12}$ L$_{\odot}$, and ${\rm SFR}=191^{+580}_{-146}$ ${\rm M}_{\odot}$ yr$^{-1}$. The derived value of $L_{\rm IR}$ suggests that J044232.92 could be an ultraluminous infrared galaxy, and we found that it is consistent with a main sequence SFG at a redshift of 1.132. Moreover, the estimated physical properties of J044232.92 are comparable to those of SMGs. Further observations, in particular high-resolution (sub-)millimetre and radio continuum imaging, are needed to better constrain the redshift and physical properties of J044232.92 and to see if the source really is a galaxy seen through a Galactic dust clump, in particular an SMG population member at $z\sim1.1$.


title: Deep Learning for Line Intensity Mapping Observations: Information Extraction from Noisy Maps

abstract: Line intensity mapping (LIM) is a promising observational method to probe large-scale fluctuations of line emission from distant galaxies. Data from wide-field LIM observations allow us to study the large-scale structure of the universe as well as galaxy populations and their evolution. A serious problem with LIM is contamination by foreground/background sources and various noise contributions. We develop conditional generative adversarial networks (cGANs) that extract designated signals and information from noisy maps. We train the cGANs using 30,000 mock observation maps with assuming a Gaussian noise matched to the expected noise level of NASA's SPHEREx mission. The trained cGANs successfully reconstruct H{\alpha} emission from galaxies at a target redshift from observed, noisy intensity maps. Intensity peaks with heights greater than 3.5 {\sigma} noise are located with 60 % precision. The one-point probability distribution and the power spectrum are accurately recovered even in the noise-dominated regime. However, the overall reconstruction performance depends on the pixel size and on the survey volume assumed for the training data. It is necessary to generate training mock data with a sufficiently large volume in order to reconstruct the intensity power spectrum at large angular scales. Our deep-learning approach can be readily applied to observational data with line confusion and with noise.


title: Public Announcement Logic in HOL

abstract: A shallow semantical embedding for public announcement logic with relativized common knowledge is presented. This embedding enables the first-time automation of this logic with off-the-shelf theorem provers for classical higher-order logic. It is demonstrated (i) how meta-theoretical studies can be automated this way, and (ii) how non-trivial reasoning in the target logic (public announcement logic), required e.g. to obtain a convincing encoding and automation of the wise men puzzle, can be realized. Key to the presented semantical embedding -- in contrast, e.g., to related work on the semantical embedding of normal modal logics -- is that evaluation domains are modeled explicitly and treated as additional parameter in the encodings of the constituents of the embedded target logic, while they were previously implicitly shared between meta logic and target logic.


title: Combining Weak Distributive Laws: Application to Up-To Techniques

abstract: The coalgebraic modelling of alternating automata and of probabilistic automata has long been obstructed by the absence of distributive laws of the powerset monad over itself, respectively of the powerset monad over the finite distribution monad. This can be fixed using the framework of weak distributive laws. We extend this framework to the case when one of the monads is only a functor. We provide abstract compositionality results, a generalized determinization procedure, and systematic soundness of up-to techniques. Along the way, we apply these results to alternating automata as a motivating example. Another example is given by probabilistic automata, for which our results yield soundness of bisimulation up-to convex hull.


title: A variable coefficient multi-frequency lemma

abstract: We show a variable coefficient version of Bourgain's multi-frequency lemma. It can be used to obtain major arc estimates for a discrete Stein--Wainger type operator considered by Krause arXiv:1803.09431 and Roos arXiv:1907.00405.


title: Overcoming Data Sparsity in Group Recommendation

abstract: It has been an important task for recommender systems to suggest satisfying activities to a group of users in people's daily social life. The major challenge in this task is how to aggregate personal preferences of group members to infer the decision of a group. Conventional group recommendation methods applied a predefined strategy for preference aggregation. However, these static strategies are too simple to model the real and complex process of group decision-making, especially for occasional groups which are formed ad-hoc. Moreover, group members should have non-uniform influences or weights in a group, and the weight of a user can be varied in different groups. Therefore, an ideal group recommender system should be able to accurately learn not only users' personal preferences but also the preference aggregation strategy from data. In this paper, we propose a novel end-to-end group recommender system named CAGR (short for Centrality Aware Group Recommender"), which takes Bipartite Graph Embedding Model (BGEM), the self-attention mechanism and Graph Convolutional Networks (GCNs) as basic building blocks to learn group and user representations in a unified way. Specifically, we first extend BGEM to model group-item interactions, and then in order to overcome the limitation and sparsity of the interaction data generated by occasional groups, we propose a self-attentive mechanism to represent groups based on the group members. In addition, to overcome the sparsity issue of user-item interaction data, we leverage the user social networks to enhance user representation learning, obtaining centrality-aware user representations. We create three large-scale benchmark datasets and conduct extensive experiments on them. The experimental results show the superiority of our proposed CAGR by comparing it with state-of-the-art group recommender models.


title: Stability of the multi-solitons of the modified Korteweg-de Vries equation

abstract: We establish the nonlinear stability of $N$-soliton solutions of the modified Korteweg-de Vries (mKdV) equation. The $N$-soliton solutions are global solutions of mKdV behaving at (positive and negative) time infinity as sums of $1$-solitons with speeds $0<c_1<\cdots< c_N$.The proof relies on the variational characterization of $N$-solitons. We show that the $N$-solitons realize the local minimum of the $(N+1)$-th mKdV conserved quantity subject to fixed constraints on the $N$ first conserved quantities.To this aim, we construct a functional for which $N$-solitons are critical points, we prove that the spectral properties of the linearization of this functional around a $N$-soliton are preserved on the extended timeline, and we analyze the spectrum at infinity of linearized operators around $1$-solitons. The main new ingredients in our analysis are a new operator identity based on a generalized Sylvester law of inertia and recursion operators for the mKdV equation.


title: Algebraic curves admitting inner and outer Galois points

abstract: There are two purposes in this article. One is to present a criterion for the existence of a birational embedding into a projective plane with inner and outer Galois points for algebraic curves. Another is to classify plane curves of degree $d$ admitting an inner Galois point $P$ and an outer Galois point $Q$ with $G_PG_Q=G_P \rtimes G_Q$ or $G_P \ltimes G_Q$, under the assumption that the characteristic $p$ is zero or $p$ does not divide $d-1$.


title: Quantifying the impact of the Large Magellanic Cloud on the structure of the Milky Way's dark matter halo using Basis Function Expansions

abstract: Indications of disequilibrium throughout the Milky Way (MW) highlight the need for compact,flexible, non-parametric descriptions of phase--space distributions of galaxies. We present a new representation of the current Dark Matter (DM) distribution and potential derived from N-body simulations of the Milky Way and Large Magellanic Cloud (LMC) system using Basis Function Expansions (BFEs). We incorporate methods to maximize the physical signal in the representation. As a result, the simulations of $10^8$ DM particles representing the MW--LMC system can be described by 354 coefficients. We find that the LMC induces asymmetric perturbations (odd l, m) to the MW's halo, which are not well-described by oblate, prolate, or triaxial halos. Furthermore, the energy in high-order even modes (l,m $\geq$ 2) is similar to average triaxial halos found in cosmological simulations. As such, the response of the MW's halo to the LMC must be accounted for in order to recover the imprints of its assembly history. The LMC causes the outer halo ($\geq$ 30 kpc) to shift from the disk center of mass (COM) by $\sim$15-25 kpc at present day, manifesting as a dipole in the BFE and in the radial velocities of halo stars. The shift depends on the LMC's infall mass, the distortion of the LMC's halo and the MW halo response. Within 30 kpc, halo tracers are expected to orbit the COM of the MW's disk, regardless of LMC infall mass. The LMC's halo is also distorted by MW tides, we discuss the implications for its mass loss and the subsequent effects on current Magellanic satellites.


title: A variable metric mini-batch proximal stochastic recursive gradient algorithm with diagonal Barzilai-Borwein stepsize

abstract: Variable metric proximal gradient methods with different metric selections have been widely used in composite optimization. Combining the Barzilai-Borwein (BB) method with a diagonal selection strategy for the metric, the diagonal BB stepsize can keep low per-step computation cost as the scalar BB stepsize and better capture the local geometry of the problem. In this paper, we propose a variable metric mini-batch proximal stochastic recursive gradient algorithm VM-mSRGBB, which updates the metric using a new diagonal BB stepsize. The linear convergence of VM-mSRGBB is established for strongly convex, non-strongly convex and convex functions. Numerical experiments on standard data sets show that VM-mSRGBB is better than or comparable to some variance reduced stochastic gradient methods with best-tuned scalar stepsizes or BB stepsizes. Furthermore, the performance of VM-mSRGBB is superior to some advanced mini-batch proximal stochastic gradient methods.


title: An Analysis of Control Parameters of MOEA/D Under Two Different Optimization Scenarios

abstract: An unbounded external archive (UEA), which stores all nondominated solutions found during the search process, is frequently used to evaluate the performance of multi-objective evolutionary algorithms (MOEAs) in recent studies. A recent benchmarking study also shows that decomposition-based MOEA (MOEA/D) is competitive with state-of-the-art MOEAs when the UEA is incorporated into MOEA/D. However, a parameter study of MOEA/D using the UEA has not yet been performed. Thus, it is unclear how control parameter settings influence the performance of MOEA/D with the UEA. In this paper, we present an analysis of control parameters of MOEA/D under two performance evaluation scenarios. One is a final population scenario where the performance assessment of MOEAs is performed based on all nondominated solutions in the final population, and the other is a reduced UEA scenario where it is based on a pre-specified number of selected nondominated solutions from the UEA. Control parameters of MOEA/D investigated in this paper include the population size, scalarizing functions, and the penalty parameter of the penalty-based boundary intersection (PBI) function. Experimental results indicate that suitable settings of the three control parameters significantly depend on the choice of an optimization scenario. We also analyze the reason why the best parameter setting is totally different for each scenario.


title: Hypergraph Lambek Calculus

abstract: It is known that context-free grammars can be extended to generating graphs resulting in graph grammars; one of such fundamental approaches is hyperedge replacement grammars. On the other hand there are type-logical grammars which also serve to describe string languages. In this paper, we investigate how to extend the Lambek calculus ($\mathrm{L}$) and grammars based on it to graphs. The resulting approach is called hypergraph Lambek calculus ($\mathrm{HL}$). It is a logical sequential calculus whose sequents are graphs; it naturally extends the Lambek calculus and also allows one to embed its variants (commutative $\mathrm{L}$, $\mathrm{NL\diamondsuit}$, $\mathrm{L}_{\mathbf{1}}^\ast$). Besides, many properties of the Lambek calculus (cut elimination, counters, models) can be lifted to $\mathrm{HL}$. However, while Lambek grammars are equivalent to context-free grammars in the string case, hypergraph Lambek grammars are much more powerful than hyperedge replacement grammars. Particularly, the former can generate the language of all graphs without isolated nodes; the language of all bipartite graphs; finite intersections of languages generated by hyperedge replacement grammars. Nevertheless, the derivability problem in $\mathrm{HL}$ and the membership problem for grammars based on $\mathrm{HL}$ are NP-complete as well as the membership problem for hyperedge replacement grammars.


title: Discriminative and Generative Models for Anatomical Shape Analysison Point Clouds with Deep Neural Networks

abstract: We introduce deep neural networks for the analysis of anatomical shapes that learn a low-dimensional shape representation from the given task, instead of relying on hand-engineered representations. Our framework is modular and consists of several computing blocks that perform fundamental shape processing tasks. The networks operate on unordered point clouds and provide invariance to similarity transformations, avoiding the need to identify point correspondences between shapes. Based on the framework, we assemble a discriminative model for disease classification and age regression, as well as a generative model for the accruate reconstruction of shapes. In particular, we propose a conditional generative model, where the condition vector provides a mechanism to control the generative process. instance, it enables to assess shape variations specific to a particular diagnosis, when passing it as side information. Next to working on single shapes, we introduce an extension for the joint analysis of multiple anatomical structures, where the simultaneous modeling of multiple structures can lead to a more compact encoding and a better understanding of disorders. We demonstrate the advantages of our framework in comprehensive experiments on real and synthetic data. The key insights are that (i) learning a shape representation specific to the given task yields higher performance than alternative shape descriptors, (ii) multi-structure analysis is both more efficient and more accurate than single-structure analysis, and (iii) point clouds generated by our model capture morphological differences associated to Alzheimers disease, to the point that they can be used to train a discriminative model for disease classification. Our framework naturally scales to the analysis of large datasets, giving it the potential to learn characteristic variations in large populations.


title: Explainable Online Validation of Machine Learning Models for Practical Applications

abstract: We present a reformulation of the regression and classification, which aims to validate the result of a machine learning algorithm. Our reformulation simplifies the original problem and validates the result of the machine learning algorithm using the training data. Since the validation of machine learning algorithms must always be explainable, we perform our experiments with the kNN algorithm as well as with an algorithm based on conditional probabilities, which is proposed in this work. For the evaluation of our approach, three publicly available data sets were used and three classification and two regression problems were evaluated. The presented algorithm based on conditional probabilities is also online capable and requires only a fraction of memory compared to the kNN algorithm.


title: Including Everyone, Everywhere: Understanding Opportunities and Challenges of Geographic Gender-Inclusion in OSS

abstract: The gender gap is a significant concern facing the software industry as the development becomes more geographically distributed. Widely shared reports indicate that gender differences may be specific to each region. However, how complete can these reports be with little to no research reflective of the Open Source Software (OSS) process and communities software is now commonly developed in? Our study presents a multi-region geographical analysis of gender inclusion on GitHub. This mixed-methods approach includes quantitatively investigating differences in gender inclusion in projects across geographic regions and investigate these trends over time using data from contributions to 21,456 project repositories. We also qualitatively understand the unique experiences of developers contributing to these projects through a survey that is strategically targeted to developers in various regions worldwide. Our findings indicate that gender diversity is low across all parts of the world, with no substantial difference across regions. However, there has been statistically significant improvement in diversity worldwide since 2014, with certain regions such as Africa improving at faster pace. We also find that most motivations and barriers to contributions (e.g., lack of resources to contribute and poor working environment) were shared across regions, however, some insightful differences, such as how to make projects more inclusive, did arise. From these findings, we derive and present implications for tools that can foster inclusion in open source software communities and empower contributions from everyone, everywhere.


title: Deep Composer Classification Using Symbolic Representation

abstract: In this study, we train deep neural networks to classify composer on a symbolic domain. The model takes a two-channel two-dimensional input, i.e., onset and note activations of time-pitch representation, which is converted from MIDI recordings and performs a single-label classification. On the experiments conducted on MAESTRO dataset, we report an F1 value of 0.8333 for the classification of 13~classical composers.


title: Goal-Auxiliary Actor-Critic for 6D Robotic Grasping with Point Clouds

abstract: 6D robotic grasping beyond top-down bin-picking scenarios is a challenging task. Previous solutions based on 6D grasp synthesis with robot motion planning usually operate in an open-loop setting, which are sensitive to grasp synthesis errors. In this work, we propose a new method for learning closed-loop control policies for 6D grasping. Our policy takes a segmented point cloud of an object from an egocentric camera as input, and outputs continuous 6D control actions of the robot gripper for grasping the object. We combine imitation learning and reinforcement learning and introduce a goal-auxiliary actor-critic algorithm for policy learning. We demonstrate that our learned policy can be integrated into a tabletop 6D grasping system and a human-robot handover system to improve the grasping performance of unseen objects. Our videos and code can be found at https://sites.google.com/view/gaddpg .


title: The Complexity of Boolean State Separation (Technical Report)

abstract: For a Boolean type of nets $\tau$, a transition system $A$ is synthesizeable into a $\tau$-net $N$ if and only if distinct states of $A$ correspond to distinct markings of $N$, and $N$ prevents a transition firing if there is no related transition in $A$. The former property is called $\tau$-state separation property ($\tau$-SSP) while the latter -- $\tau$-event/state separation property ($\tau$-ESSP). $A$ is embeddable into the reachability graph of a $\tau$-net $N$ if and only if $A$ has the $\tau$-SSP. This paper presents a complete characterization of the computational complexity of \textsc{$\tau$-SSP} for all Boolean Petri net types.


title: Incorporating Machine Learning to Evaluate Solutions to the University Course Timetabling Problem

abstract: Evaluating solutions to optimization problems is arguably the most important step for heuristic algorithms, as it is used to guide the algorithms towards the optimal solution in the solution search space. Research has shown evaluation functions to some optimization problems to be impractical to compute and have thus found surrogate less expensive evaluation functions to those problems. This study investigates the extent to which supervised learning algorithms can be used to find approximations to evaluation functions for the university course timetabling problem. Up to 97 percent of the time, the traditional evaluation function agreed with the supervised learning regression model on the result of comparison of the quality of pair of solutions to the university course timetabling problem, suggesting that supervised learning regression models can be suitable alternatives for optimization problems' evaluation functions.


title: Neural Thompson Sampling

abstract: Thompson Sampling (TS) is one of the most effective algorithms for solving contextual multi-armed bandit problems. In this paper, we propose a new algorithm, called Neural Thompson Sampling, which adapts deep neural networks for both exploration and exploitation. At the core of our algorithm is a novel posterior distribution of the reward, where its mean is the neural network approximator, and its variance is built upon the neural tangent features of the corresponding neural network. We prove that, provided the underlying reward function is bounded, the proposed algorithm is guaranteed to achieve a cumulative regret of $\mathcal{O}(T^{1/2})$, which matches the regret of other contextual bandit algorithms in terms of total round number $T$. Experimental comparisons with other benchmark bandit algorithms on various data sets corroborate our theory.


title: Maximal benefits and possible detrimental effects of binary decision aids

abstract: Binary decision aids, such as alerts, are a simple and widely used form of automation. The formal analysis of a user's task performance with an aid sees the process as the combination of information from two detectors who both receive input about an event and evaluate it. The user's decisions are based on the output of the aid and on the information, the user obtains independently. We present a simple method for computing the maximal benefits a user can derive from a binary aid as a function of the user's and the aid's sensitivities. Combining the user and the aid often adds little to the performance the better detector could achieve alone. Also, if users assign non-optimal weights to the aid, performance may drop dramatically. Thus, the introduction of a valid aid can actually lower detection performance, compared to a more sensitive user working alone. Similarly, adding a user to a system with high sensitivity may lower its performance. System designers need to consider the potential adverse effects of introducing users or aids into systems.


title: Continuous close-range 3D object pose estimation

abstract: In the context of future manufacturing lines, removing fixtures will be a fundamental step to increase the flexibility of autonomous systems in assembly and logistic operations. Vision-based 3D pose estimation is a necessity to accurately handle objects that might not be placed at fixed positions during the robot task execution. Industrial tasks bring multiple challenges for the robust pose estimation of objects such as difficult object properties, tight cycle times and constraints on camera views. In particular, when interacting with objects, we have to work with close-range partial views of objects that pose a new challenge for typical view-based pose estimation methods. In this paper, we present a 3D pose estimation method based on a gradient-ascend particle filter that integrates new observations on-the-fly to improve the pose estimate. Thereby, we can apply this method online during task execution to save valuable cycle time. In contrast to other view-based pose estimation methods, we model potential views in full 6- dimensional space that allows us to cope with close-range partial objects views. We demonstrate the approach on a real assembly task, in which the algorithm usually converges to the correct pose within 10-15 iterations with an average accuracy of less than 8mm.


title: Rogers semilattices in the analytical hierarchy: The case of finite families

abstract: A numbering of a countable family $S$ is a surjective map from the set of natural numbers $\omega$ onto $S$. The paper studies Rogers semilattices, i.e. upper semilattices induced by the reducibility between numberings, for families $S\subset P(\omega)$. Working in set theory ZF+DC+PD, we obtain the following results on families from various levels of the analytical hierarchy. For a non-zero number $n$, by $E^1_n$ we denote $\Pi^1_n$ if $n$ is odd, and $\Sigma^1_n$ if $n$ is even. We show that for a finite family $S$ of $E^1_n$ sets, its Rogers $E^1_n$-semilattice has the greatest element if and only if $S$ contains the least element under set-theoretic inclusion. Furthermore, if $S$ does not have the $\subseteq$-least element, then the corresponding Rogers $E^1_n$-semilattice is upwards dense.


title: A Low Complexity Quantum Principal Component Analysis Algorithm

abstract: In this paper, we propose a low complexity quantum principal component analysis (qPCA) algorithm. Similar to the state-of-the-art qPCA, it achieves dimension reduction by extracting principal components of the data matrix, rather than all components of the data matrix, to quantum registers, so that samples of measurement required can be reduced considerably. However, the major advantage of our qPCA over the state-of-the-art qPCA is that it requires much less quantum gates. In addition, it is more accurate due to the simplification of the quantum circuit. We implement the proposed qPCA on the IBM quantum computing platform, and the experimental results are consistent with our expectations.


title: Parameterisation space for Cornell potential in a QCD potential model

abstract: We make a critical analysis on the free parameters of the Cornell potential $-4\alpha_{s}/3r+br+c$ and provide a parameterisation space for the strong coupling constant $\alpha_{s}$ and the constant shift $c$ for choosing linear part as perturbation in the potential model. In the analysis of heavy-light mesons $(D,D_{s},B,B_{s}~ \text{and} ~B_{c})$, we have found a wide range of values for the coupling constant i.e $0.20 \leq \alpha_{s}\leq 0.64$ with $-1.2 \leq c \leq -0.66$ which can be used to treat the confining part as perturbation.


title: Semi-classical approaches to heavy-ion reactions: fusion, rainbow, and glory

abstract: A semi-classical approximation has been a powerful tool in understanding the dynamics of low-energy heavy-ion reactions. Here we discuss two topics in this regard, for which Mahir Hussein was a world leading pioneer. The first topic is heavy-ion fusion reactions of neutron-rich nuclei, in which the breakup process of the projectile nucleus plays a crucial role. The second is rainbow and glory scattering, for which characteristic oscillatory patterns in differential cross sections can be well understood in terms of intereferences among several semi-classical trajectories.


title: An asymptotic representation formula for scattering by thin tubular structures and an application in inverse scattering

abstract: We consider the scattering of time-harmonic electromagnetic waves by a penetrable thin tubular scattering object in three-dimensional free space. We establish an asymptotic representation formula for the scattered wave away from the thin tubular scatterer as the radius of its cross-section tends to zero. The shape, the relative electric permeability and the relative magnetic permittivity of the scattering object enter this asymptotic representation formula by means of the center curve of the thin tubular scatterer and two electric and magnetic polarization tensors. We give an explicit characterization of these two three-dimensional polarization tensors in terms of the center curve and of the two two-dimensional polarization tensor for the cross-section of the scattering object. As an application we demonstrate how this formula may be used to evaluate the residual and the shape derivative in an efficient iterative reconstruction algorithm for an inverse scattering problem with thin tubular scattering objects. We present numerical results to illustrate our theoretical findings. Mathematics subject classifications (MSC2010): 35C20, (65N21, 78A46)


title: Assessing the reliability of the Raman peak counting method for the characterization of SWCNT diameter distributions: a cross-characterization with TEM

abstract: Resonant Raman spectroscopy is a widely used technique for single-walled carbon nanotube (SWCNT) characterization, in particular in the radial breathing mode (RBM) range which provides direct information on the structure of the nanotube in resonance. The RBM peak counting method, i.e. acquiring Raman spectrum grids on a substrate with a select set of discrete laser lines and counting RBM peaks as single nanotubes, is frequently used to characterize SWCNT growth samples, despite the many factors that can induce errors in the results. In this work, we cross-characterize the diameter distributions obtained through this methodology with diameter distributions obtained by counting SWCNT diameters in transmission electron microscopy (TEM) and discuss the different results and biases between the techniques. This study is performed on a broad diameter distribution sample, and on two chirality-enriched samples whose chirality distributions are determined by photoluminescence excitation spectroscopy (PLE) and statistical analysis of high resolution TEM (HRTEM) images. We show that the largest differences between the Raman peak counting and TEM diameter distributions stem from the chirality-dependence of SWCNT Raman cross-sections and the patchy vision offered by the use of only a few discrete excitation wavelengths. The effect of the substrate and TEM-related biases are also discussed.


title: Modeling all alternative solutions for highly renewable energy systems

abstract: As the world is transitioning towards highly renewable energy systems, advanced tools are needed to analyze such complex networks. Energy system design is, however, challenged by real-world objective functions consisting of a blurry mix of technical and socioeconomic agendas, with limitations that cannot always be clearly stated. As a result, it is highly likely that solutions which are techno-economically suboptimal will be preferable. Here, we present a method capable of determining the continuum containing all techno-economically near-optimal solutions, moving the field of energy system modeling from discrete solutions to a new era where continuous solution ranges are available. The presented method is applied to study a range of technical and socioeconomic metrics on a model of the European electricity system. The near-optimal region is found to be relatively flat allowing for solutions that are slightly more expensive than the optimum but better in terms of equality, land use, and implementation time.


title: Asymptotic upper bound for tangential speed of parabolic semigroups of holomorphic self-maps in the unit disc

abstract: We show that the tangential speed of a parabolic semigroup of holomorphic self-maps in the unit disc is asymptotically bounded from above by (1/2)logt, proving a conjecture by Bracci. In order to show the proof we need a result of "asymptotical monotonicity" of the tangential speed for proper pairs of parabolic semigroups with positive hyperbolic step.


title: Optical Manipulation of Domains in Chiral Topological Superconductors

abstract: Optical control of chirality in chiral superconductors bears potential for future topological quantum computing applications. When a chiral domain is written and erased by a laser spot, the Majorana modes around the domain can be manipulated on ultrafast time scales. Here we study topological superconductors with two chiral order parameters coupled via light fields by a time-dependent real-space Ginzburg-Landau approach. Continuous optical driving, or the application of supercurrent, hybridizes the two chiral order parameters, allowing one to induce and control the superconducting state beyond what is possible in equilibrium. We show that superconductivity can even be enhanced if the mutual coupling between two order parameters is sufficiently strong. Furthermore, we demonstrate that short optical pulses with spot size larger than a critical one can overcome a counteracting diffusion effect and write, erase, or move chiral domains. Surprisingly, these domains are found to be stable, which might enable optically programmable quantum computers in the future.


title: CAPTION: Correction by Analyses, POS-Tagging and Interpretation of Objects using only Nouns

abstract: Recently, Deep Learning (DL) methods have shown an excellent performance in image captioning and visual question answering. However, despite their performance, DL methods do not learn the semantics of the words that are being used to describe a scene, making it difficult to spot incorrect words used in captions or to interchange words that have similar meanings. This work proposes a combination of DL methods for object detection and natural language processing to validate image's captions. We test our method in the FOIL-COCO data set, since it provides correct and incorrect captions for various images using only objects represented in the MS-COCO image data set. Results show that our method has a good overall performance, in some cases similar to the human performance.


title: MEGATRON-CNTRL: Controllable Story Generation with External Knowledge Using Large-Scale Language Models

abstract: Existing pre-trained large language models have shown unparalleled generative capabilities. However, they are not controllable. In this paper, we propose MEGATRON-CNTRL, a novel framework that uses large-scale language models and adds control to text generation by incorporating an external knowledge base. Our framework consists of a keyword predictor, a knowledge retriever, a contextual knowledge ranker, and a conditional text generator. As we do not have access to ground-truth supervision for the knowledge ranker, we make use of weak supervision from sentence embedding. The empirical results show that our model generates more fluent, consistent, and coherent stories with less repetition and higher diversity compared to prior work on the ROC story dataset. We showcase the controllability of our model by replacing the keywords used to generate stories and re-running the generation process. Human evaluation results show that 77.5% of these stories are successfully controlled by the new keywords. Furthermore, by scaling our model from 124 million to 8.3 billion parameters we demonstrate that larger models improve both the quality of generation (from 74.5% to 93.0% for consistency) and controllability (from 77.5% to 91.5%).


title: Empirical Low-Altitude Air-to-Ground Spatial Channel Characterization for Cellular Networks Connectivity

abstract: Cellular-connected unmanned aerial vehicles (UAVs) have recently attracted a surge of interest in both academia and industry. Understanding the air-to-ground (A2G) propagation channels is essential to enable reliable and/or high-throughput communications for UAVs and protect the ground user equipments (UEs). In this contribution, a recently conducted measurement campaign for the A2G channels is introduced. A uniform circular array (UCA) with 16 antenna elements was employed to collect the downlink signals of two different Long Term Evolution (LTE) networks, at the heights of 0-40m in three different, namely rural, urban and industrial scenarios. The channel impulse responses (CIRs) have been extracted from the received data, and the spatial/angular parameters of the multipath components in individual channels were estimated according to a high-resolution-parameter estimation (HRPE) principle. Based on the HRPE results, clusters of multipath components were further identified. Finally, comprehensive spatial channel characteristics were investigated in the composite and cluster levels at different heights in the three scenarios.


title: Spontaneous vortex state in a superconductor/ferromagnet nanocomposite

abstract: The mechanism of the interplay between superconductivity and magnetism is one of the intriguing and challenging problems in physics. Theory has predicted that the ferromagnetic order can coexist with the superconducting order in the form of a spontaneous vortex phase in which magnetic vortices nucleate in the absence of an external field. However, there has been no rigorous demonstration of spontaneous vortices by bulk magnetic measurements. Here we show the results of experimental observations of spontaneous vortices using a superconductor/ferromagnet fractal nanocomposite, in which superconducting MgB2 and ferromagnetic nanograins are dispersedly embedded in the normal matrix to realize the remote electromagnetic interaction and also to induce a long-range Josephson coupling. We found from bulk magnetization measurements that the sample with nonzero remanent magnetization exhibits the magnetic behaviors which are fully consistent with a spontaneous vortex scenario predicted theoretically for magnetic inclusions in a superconducting material. The resulting spontaneous vortex state is in equilibrium and coexists surprisingly with a Meissner state (complete shielding of an external magnetic field). The present observation not only reveals the evolution process of the spontaneous vortices in superconductor/ferromagnet hybrids, but it also sheds light on the role of the fractal disorder and structural heterogeneity on the vortex nucleation under the influence of Josephson superconducting currents.


title: All You Need Is CONSTRUCT

abstract: In SPARQL, the query forms SELECT and CONSTRUCT have been the subject of several studies, both theoretical and practical. However, the composition of such queries and their interweaving when forming involved nested queries has not yet received much interest in the literature. We mainly tackle the problem of composing such queries. For this purpose, we introduce a language close to SPARQL where queries can be nested at will, involving either CONSTRUCT or SELECT query forms and provide a formal semantics for it. This semantics is based on a uniform interpretation of queries. This uniformity is due to an extension of the notion of RDF graphs to include isolated items such as variables. As a key feature of this work, we show how classical SELECT queries can be easily encoded as a particular case of CONSTRUCT queries.


title: Linear Classifier Combination via Multiple Potential Functions

abstract: A vital aspect of the classification based model construction process is the calibration of the scoring function. One of the weaknesses of the calibration process is that it does not take into account the information about the relative positions of the recognized objects in the feature space. To alleviate this limitation, in this paper, we propose a novel concept of calculating a scoring function based on the distance of the object from the decision boundary and its distance to the class centroid. An important property is that the proposed score function has the same nature for all linear base classifiers, which means that outputs of these classifiers are equally represented and have the same meaning. The proposed approach is compared with other ensemble algorithms and experiments on multiple Keel datasets demonstrate the effectiveness of our method. To discuss the results of our experiments, we use multiple classification performance measures and statistical analysis.


title: Multivariate Estimations of Equilibrium Climate Sensitivity from Short Transient Warming Simulations

abstract: One of the most used metrics to gauge the effects of climate change is the equilibrium climate sensitivity, defined as the long-term (equilibrium) temperature increase resulting from instantaneous doubling of atmospheric CO$_2$. Since global climate models cannot be fully equilibrated in practice, extrapolation techniques are used to estimate the equilibrium state from transient warming simulations. Because of the abundance of climate feedbacks - spanning a wide range of temporal scales - it is hard to extract long-term behaviour from short-time series; predominantly used techniques are only capable of detecting the single most dominant eigenmode, thus hampering their ability to give accurate long-term estimates. Here, we present an extension to those methods by incorporating data from multiple observables in a multi-component linear regression model. This way, not only the dominant but also the next-dominant eigenmodes of the climate system are captured, leading to better long-term estimates from short, non-equilibrated time series.


title: Resource Allocation for Large IRS-Assisted SWIPT Systems with Non-linear Energy Harvesting Model

abstract: In this paper, we investigate resource allocation algorithm design for large intelligent reflecting surface (IRS)-assisted simultaneous wireless information and power transfer (SWIPT) systems. To this end, we adopt a physics-based IRS model that, unlike the conventional IRS model, takes into account the impact of the incident and reflection angles of the impinging electromagnetic wave on the reflected signal. To facilitate efficient resource allocation design for large IRSs, we employ a scalable optimization framework, where the IRS is partitioned into several tiles and the phase shift elements of each tile are jointly designed to realize different transmission modes. Then, the beamforming vectors at the base station (BS) and the transmission mode selection of the tiles of the IRS are jointly optimized for minimization of the BS transmit power taking into account the quality-of-service requirements of both non-linear energy harvesting receivers and information decoding receivers. For handling the resulting non-convex optimization problem, we apply a penalty-based method, successive convex approximation, and semidefinite relaxation to develop a computationally efficient algorithm which asymptotically converges to a locally optimal solution of the considered problem. Our simulation results show that the proposed scheme enables considerable power savings compared to two baseline schemes. Moreover, our results also illustrate that the advocated physics-based model and scalable optimization framework for large IRSs allows us to strike a balance between system performance and computational complexity, which is vital for realizing large IRS-assisted communication systems.


title: Trivializing group actions on braided crossed tensor categories and graded braided tensor categories

abstract: For an abelian group $ A $, we study a close connection between braided crossed $ A $-categories with a trivialization of the $ A $-action and $ A $-graded braided tensor categories. Additionally, we prove that the obstruction to the existence of a trivialization of a categorical group action $T$ on a monoidal category $\mathcal{C}$ is given by an element $O(T)\in H^2(G,\operatorname{Aut}_\otimes(\operatorname{Id}_{\mathcal{C}}))$. In the case that $O(T)=0$, the set of obstructions form a torsor over $\operatorname{Hom}(G,\operatorname{Aut}_\otimes(\operatorname{Id}_{\mathcal{C}}))$, where $\operatorname{Aut}_\otimes(\operatorname{Id}_{\mathcal{C}})$ is the abelian group of tensor natural automorphisms of the identity. The cohomological interpretation of trivializations, together with the homotopical classification of (faithfully graded) braided $A$-crossed tensor categories developed in arXiv:0909.3140, allows us to provide a method for the construction of faithfully $A$-graded braided tensor categories. We work out two examples. First, we compute the obstruction to the existence of trivializations for the braided crossed category associated with a pointed semisimple tensor category. In the second example, we compute explicit formulas for the braided $\mathbb{Z}/2$-crossed structures over Tambara-Yamagami fusion categories and, consequently, a conceptual interpretation of the results in arXiv:math/0011037 about the classification of braidings over Tambara-Yamagami categories.


title: Nonsmoothness in Machine Learning: specific structure, proximal identification, and applications

abstract: Nonsmoothness is often a curse for optimization; but it is sometimes a blessing, in particular for applications in machine learning. In this paper, we present the specific structure of nonsmooth optimization problems appearing in machine learning and illustrate how to leverage this structure in practice, for compression, acceleration, or dimension reduction. We pay a special attention to the presentation to make it concise and easily accessible, with both simple examples and general results.


title: Systematic Orbifold Constructions of Schellekens' Vertex Operator Algebras from Niemeier Lattices

abstract: We present a systematic, rigorous construction of all 70 strongly rational, holomorphic vertex operator algebras $V$ of central charge 24 with non-zero weight-one space $V_1$ as cyclic orbifold constructions associated with the 24 Niemeier lattice vertex operator algebras $V_N$ and certain 226 short automorphisms in $\operatorname{Aut}(V_N)$. We show that up to algebraic conjugacy these automorphisms are exactly the generalised deep holes, as introduced in arXiv:1910.04947, of the Niemeier lattice vertex operator algebras with the additional property that their orders are equal to those of the corresponding outer automorphisms. Together with the constructions in arXiv:1708.05990 and arXiv:1910.04947 this gives three different uniform constructions of these vertex operator algebras, which are related through 11 algebraic conjugacy classes in $\operatorname{Co}_0$. Finally, by considering the inverse orbifold constructions associated with the 226 short automorphisms, we give the first systematic proof of the result that each strongly rational, holomorphic vertex operator algebra $V$ of central charge 24 with non-zero weight-one space $V_1$ is uniquely determined by the Lie algebra structure of $V_1$.


title: Multidimensional Index Modulation for 5G and Beyond Wireless Networks

abstract: This study examines the flexible utilization of existing IM techniques in a comprehensive manner to satisfy the challenging and diverse requirements of 5G and beyond services. After spatial modulation (SM), which transmits information bits through antenna indices, application of IM to orthogonal frequency division multiplexing (OFDM) subcarriers has opened the door for the extension of IM into different dimensions, such as radio frequency (RF) mirrors, time slots, codes, and dispersion matrices. Recent studies have introduced the concept of multidimensional IM by various combinations of one-dimensional IM techniques to provide higher spectral efficiency (SE) and better bit error rate (BER) performance at the expense of higher transmitter (Tx) and receiver (Rx) complexity. Despite the ongoing research on the design of new IM techniques and their implementation challenges, proper use of the available IM techniques to address different requirements of 5G and beyond networks is an open research area in the literature. For this reason, we first provide the dimensional-based categorization of available IM domains and review the existing IM types regarding this categorization. Then, we develop a framework that investigates the efficient utilization of these techniques and establishes a link between the IM schemes and 5G services, namely enhanced mobile broadband (eMBB), massive machine-type communications (mMTC), and ultra-reliable low-latency communication (URLLC). Additionally, this work defines key performance indicators (KPIs) to quantify the advantages and disadvantages of IM techniques in time, frequency, space, and code dimensions. Finally, future recommendations are given regarding the design of flexible IM-based communication systems for 5G and beyond wireless networks.


title: On the Achievable Rate Region of the $ K $-Receiver Broadcast Channels via Exhaustive Message Splitting

abstract: This paper focuses on $ K $-receiver discrete-time memoryless broadcast channels (DM-BCs) with private messages, where the transmitter wishes to convey $K$ private messages to $K$ receivers respectively. A general inner bound on the capacity region is proposed based on an exhaustive message splitting and a $K$-level modified Marton's coding. The key idea is to split every message into $ \sum_{j=1}^K {K\choose j} $ submessages each corresponding to a set of users who are assigned to recover them, and then send these submessages through codewords that are jointly typical with each other. To guarantee the joint typicality among all transmitted codewords, a sufficient condition on the subcodebooks sizes is derived through a newly establishing hierarchical covering lemma, which extends the 2-level multivariate covering lemma to the $K$-level case including $(2^{K}-1)$ random variables with more intricate dependence. As the number of auxiliary random variables and rate constraints both increase linearly with $(2^{K}-1)$, the standard Fourier-Motzkin elimination procedure becomes infeasible when $K$ is large. To tackle this problem, we obtain the final form of achievable rate region with a special observation of disjoint unions of sets that constitute the power set of $ \{1,\dots,K\}$. The proposed achievable rate region allows arbitrary input probability mass functions (pmfs) and improves over all previously known ones for $ K$-receiver ($K\geq 3$) BCs whose input pmfs should satisfy certain Markov chain(s).


title: Current Lightweight Cryptography Protocols in Smart City IoT Networks: A Survey

abstract: With the advent of advanced technology, IoT introduces a vast number of devices connecting with each other and collecting a sheer volume of data. Thus, the demands of IoT security is paramount. Cryptography is being used to secure the networks for authentication, confidentiality, data integrity and access control. However, due to the resource constraint nature of IoT devices, the traditional cryptographic protocols may not be suited in all IoT environments. Researchers, as a result, have been proposing various lightweight cryptographic algorithms and protocols. In this paper, we discuss the state of the art lightweight cryptographic protocols for IoT networks and present a comparative analysis of the existing protocols. In doing so, this paper has classified the most current algorithm into two parts, such as symmetric and asymmetric lightweight cryptography. Additionally, we consider several recent developed block cipher and stream cipher algorithms. Furthermore, various research challenges of lightweight cryptography have been addressed.


title: Morphological segmentation of hyperspectral images

abstract: The present paper develops a general methodology for the morphological segmentation of hyperspectral images, i.e., with an important number of channels. This approach, based on watershed, is composed of a spectral classification to obtain the markers and a vectorial gradient which gives the spatial information. Several alternative gradients are adapted to the different hyperspectral functions. Data reduction is performed either by Factor Analysis or by model fitting. Image segmentation is done on different spaces: factor space, parameters space, etc. On all these spaces the spatial/spectral segmentation approach is applied, leading to relevant results on the image.


title: Which *BERT? A Survey Organizing Contextualized Encoders

abstract: Pretrained contextualized text encoders are now a staple of the NLP community. We present a survey on language representation learning with the aim of consolidating a series of shared lessons learned across a variety of recent efforts. While significant advancements continue at a rapid pace, we find that enough has now been discovered, in different directions, that we can begin to organize advances according to common themes. Through this organization, we highlight important considerations when interpreting recent contributions and choosing which model to use.


title: Bridging the Gaps in Statistical Models of Protein Alignment

abstract: This work demonstrates how a complete statistical model quantifying the evolution of pairs of aligned proteins can be constructed from a time-parameterised substitution matrix and a time-parameterised 3-state alignment machine. All parameters of such a model can be inferred from any benchmark data-set of aligned protein sequences. This allows us to examine nine well-known substitution matrices on six benchmarks curated using various structural alignment methods; any matrix that does not explicitly model a "time"-dependent Markov process is converted to a corresponding base-matrix that does. In addition, a new optimal matrix is inferred for each of the six benchmarks. Using Minimum Message Length (MML) inference, all 15 matrices are compared in terms of measuring the Shannon information content of each benchmark. This has resulted in a new and clear overall best performed time-dependent Markov matrix, MMLSUM, and its associated 3-state machine, whose properties we have analysed in this work. For standard use, the MMLSUM series of (log-odds) \textit{scoring} matrices derived from the above Markov matrix, are available at https://lcb.infotech.monash.edu.au/mmlsum.


title: Effect of tensile stresses on bainitic isothermal transformation

abstract: The effects of tensile stresses on isothermal bainitic transformation were studied in the case of a 35MV7 steel. The modification of transformation kinetics and the presence of transformation plasticity is shown in a first step. Furthermore the effect of stress on the morphological modifications of the ferrite laths is illustrated. The role of the stress on these changes is analysed.


title: SST-BERT at SemEval-2020 Task 1: Semantic Shift Tracing by Clustering in BERT-based Embedding Spaces

abstract: Lexical semantic change detection (also known as semantic shift tracing) is a task of identifying words that have changed their meaning over time. Unsupervised semantic shift tracing, focal point of SemEval2020, is particularly challenging. Given the unsupervised setup, in this work, we propose to identify clusters among different occurrences of each target word, considering these as representatives of different word meanings. As such, disagreements in obtained clusters naturally allow to quantify the level of semantic shift per each target word in four target languages. To leverage this idea, clustering is performed on contextualized (BERT-based) embeddings of word occurrences. The obtained results show that our approach performs well both measured separately (per language) and overall, where we surpass all provided SemEval baselines.


title: Super-Nyquist Co-Prime Sensing

abstract: The theory of co-prime arrays has been studied in the past. Nyquist rate estimation of second order statistics using the combined difference set was demonstrated with low latency. This paper proposes a novel method to reconstruct the second order statistics at a rate that is twice the Nyquist rate using the same sub-Nyquist co-prime samplers. We analyse the difference set, and derive the closed-form expressions for the weight function and the bias of the correlogram estimate. The main lobe width of the bias window is approximately half of the width obtained using the prototype co-prime sampler. Since the proposed scheme employs the same rate prototype co-prime samplers; the number of samples acquired in one co-prime period and hardware cost are unaffected. Super-Nyquist estimation with multiple co-prime periods is also described. Furthermore, n-tuple or multi-level co-prime structure is presented from a super-Nyquist perspective. Here, estimation at a rate q times higher than Nyquist is possible, where q is the number of sub-samplers.


title: Origin of the mid-infrared peaks in the optical conductivity of LaMnO$_{3}$

abstract: We calculated the infrared conductivity spectrum of orbitally ordered LaMnO$_3$ in phonon frequency and overtone frequency ranges. We considered orbital exchange, Jahn-Teller electron-phonon coupling, and phonon--phonon coupling. The fundamental excitation of the phonon-coupled orbiton was only Raman active, not infrared active, while its overtone modes were both Raman and infrared active. Our calculations reproduced the small peaks near 1300 cm$^{-1}$ observed both in Raman scattering and infrared conductivity spectra, as consistent with previous experimental results.


title: Building Large Lexicalized Ontologies from Text: a Use Case in Automatic Indexing of Biotechnology Patents

abstract: This paper presents a tool, TyDI, and methods experimented in the building of a termino-ontology, i.e. a lexicalized ontology aimed at fine-grained indexation for semantic search applications. TyDI provides facilities for knowledge engineers and domain experts to efficiently collaborate to validate, organize and conceptualize corpus extracted terms. A use case on biotechnology patent search demonstrates TyDI's potential.


title: On the use of Traveling Waves for Pest/Vector elimination using the Sterile Insect Technique

abstract: The development of sustainable vector/pest control methods is of utmost importance to reduce the risk of vector-borne diseases and pest damages on crops. Among them, the Sterile Insect Technique (SIT) is a very promising one. In this paper, using diffusion operators, we extend a temporal SIT model, developed in a recent paper, into a partially degenerate reaction-diffusion SIT model. Adapting some theoretical results on traveling wave solutions for partially degenerate reaction-diffusion equations, we show the existence of mono-stable and bi-stable traveling-wave solutions for our SIT system. The dynamics of our system is driven by a SIT-threshold number above which the SIT control becomes effective and drives the system to elimination, using massive releases. When the amount of sterile males is lower than the SIT-threshold, the SIT model experiences a strong Allee effect such that a bi-stable traveling wave solution can exist and can also be used to derive an effective long term strategy, mixing massive and small releases. We illustrate some of our theoretical results with numerical simulations , and, also explore numerically spatial-localized SIT control strategies, using massive and small releases. We show that this "corridor" strategy can be efficient to block an invasion and eventually can be used to push back the front of a vector/pest invasion.


title: Parametric instability in a free evolving warped protoplanetary disc

abstract: Warped accretion discs of low viscosity are prone to hydrodynamic instability due to parametric resonance of inertial waves as confirmed by local simulations. Global simulations of warped discs, using either smoothed particle hydrodynamics (SPH) or grid-based codes, are ubiquitous but no such instability has been seen. Here we utilize a hybrid Godunov-type Lagrangian method to study parametric instability in global simulations of warped Keplerian discs at unprecedentedly high resolution (up to 120 million particles). In the global simulations, the propagation of the warp is well described by the linear bending-wave equations before the instability sets in. The ensuing turbulence, captured for the first time in a global simulation, damps relative orbital inclinations and leads to a decrease in the angular momentum deficit. As a result, the warp undergoes significant damping within one bending-wave crossing time. Observed protoplanetary disc warps are likely maintained by companions or aftermath of disc breaking.


title: Direct-channel option of the forward slope increase

abstract: The LHC data on the elastic scattering indicate that the forward slope increase is not consistent with the contributions of the simple Regge poles only with the linear Regge trajectories. The dynamics might be associated with unitarization in the direct channel of reaction. We discuss the problems of the Regge model and provide a respective illustration of the direct-channel option.


title: The Electron Proton Helium INstrument as an Example for a Space Weather Radiation Instrument

abstract: The near-Earth energetic particle environment has been monitored since the 1970's. With the increasing importance of quantifying the radiation risk for, e.g. for the human exploration of the Moon and Mars, it is essential to continue and further improve these measurements. The Electron Proton Helium INstrument (EPHIN) on-board SOHO continually provides these data sets to the solar science and space weather communities since 1995. Here, we introduce the numerous data products developed over the years and present space weather related applications. Important design features that have led to EPHINs success as well as lessons learned and possible improvements to the instrument are also discussed with respect to the next generation of particle detectors.


title: Cascaded Channel Estimation for IRS-assisted Mmwave Multi-antenna with Quantized Beamforming

abstract: In this letter, we optimize the channel estimator of the cascaded channel in an intelligent reflecting surface (IRS)-assisted millimeter wave (mmWave) multi-antenna system. In this system, the receiver is equipped with a hybrid architecture adopting quantized beamforming. Different from traditional multiple-input multiple-output (MIMO) systems, the design of channel estimation is challenging since the IRS is usually a passive array with limited signal processing capability. We derive the optimized channel estimator in a closed form by reformulating the problem of cascaded channel estimation in this system, leveraging the typical mean-squared error (MSE) criterion. Considering the presence of possible channel sparsity in mmWave channels, we generalize the proposed method by exploiting the channel sparsity for further performance enhancement and computational complexity reduction. Simulation results verify that the proposed estimator significantly outperforms the existing ones.


title: Weight and Gradient Centralization in Deep Neural Networks

abstract: Batch normalization is currently the most widely used variant of internal normalization for deep neural networks. Additional work has shown that the normalization of weights and additional conditioning as well as the normalization of gradients further improve the generalization. In this work, we combine several of these methods and thereby increase the generalization of the networks. The advantage of the newer methods compared to the batch normalization is not only increased generalization, but also that these methods only have to be applied during training and, therefore, do not influence the running time during use. Link to CUDA code https://atreus.informatik.uni-tuebingen.de/seafile/d/8e2ab8c3fdd444e1a135/


title: General adaptive rational interpolation with maximum order close to discontinuities

abstract: Adaptive rational interpolation has been designed in the context of image processing as a new nonlinear technique that avoids the Gibbs phenomenon when we approximate a discontinuous function. In this work, we present a generalization to the method giving explicit expressions for all the weights for any order of the algorithm. It has a similar behavior to weighted essentially non oscillatory (WENO) technique, however because of the design of the weights in this case is more simple, we propose a new way to construct them obtaining the maximum order near the discontinuities. Some experiments are performed to demonstrate our results and to compare them with standard methods.


title: Weighted energy estimates for the incompressible Navier-Stokes equations and applications to axisymmetric solutions without swirl

abstract: We consider a family of weights which permit to generalize the Leray procedure to obtain weak suitable solutions of the 3D incom-pressible Navier-Stokes equations with initial data in weighted L 2 spaces. Our principal result concerns the existence of regular global solutions when the initial velocity is an axisymmetric vector field without swirl such that both the initial velocity and its vorticity belong to L 2 ((1 + r 2) -- $\gamma$ 2 dx), with r = x 2 1 + x 2 2 and $\gamma$ $\in$ (0, 2).


title: Spin-polarized $\beta$-stable neutron star matter: the nuclear symmetry energy and GW170817 constraint

abstract: Magnetic field of rotating pulsar might be so strong that the equation of state (EOS) of neutron star (NS) matter is significantly affected by the spin polarization of baryons. In the present work, the EOS of the spin-polarized nuclear matter is investigated in the nonrelativistic Hartree-Fock formalism, using a realistic density dependent nucleon-nucleon interaction with its spin and spin-isospin dependence accurately adjusted to the Brueckner-Hartree-Fock results for the spin-polarized nuclear matter. The nuclear symmetry energy and proton fraction are found to increase significantly with the increasing spin polarization of baryons, leading to a larger probability of the direct Urca process in the cooling of magnetar. The EOS of the $\beta$-stable np$e\mu$ matter obtained at different spin polarizations of baryons is used as the input for the Tolman-Oppenheimer-Volkov equations to determine the hydrostatic configuration of NS. Based on the GW170817 constraint on the radius $R_{1.4}$ of NS with $M\approx 1.4_\odot$, our mean-field results show that up to $60~\%$ of baryons in the NS merger might be spin-polarized. This result supports the magnetar origin of the blue kilonova ejecta of GW170817 suggested by Metzger et al., and the spin polarization of baryons needs, therefore, to be properly treated in the many-body calculation of the EOS of NS matter before comparing the calculated NS mass and radius with those constrained by the multi-messenger GW170817 observation.


title: Multiple subglacial water bodies below the south pole of Mars unveiled by new MARSIS data

abstract: The detection of liquid water by the Mars Advanced Radar for Subsurface and Ionosphere Sounding (MARSIS) at the base of the south polar layered deposits in Ultimi Scopuli has reinvigorated the debate about the origin and stability of liquid water under present-day Martian conditions. To establish the extent of subglacial water in this region, we acquired new data, achieving extended radar coverage over the study area. Here, we present and discuss the results obtained by a new method of analysis of the complete MARSIS dataset, based on signal processing procedures usually applied to terrestrial polar ice sheets. Our results strengthen the claim of the detection of a liquid water body at Ultimi Scopuli and indicate the presence of other wet areas nearby. We suggest that the waters are hypersaline perchlorate brines, known to form at Martian polar regions and thought to survive for an extended period of time on a geological scale at below-eutectic temperatures.


title: Stochastic Analysis of Satellite Broadband by Mega-Constellations with Inclined LEOs

abstract: As emerging massive constellations are intended to provide seamless connectivity for remote areas using hundreds of small low Earth orbit (LEO) satellites, new methodologies have great importance to study the performance of these networks. In this paper, we derive both downlink and uplink analytical expressions for coverage probability and data rate of an inclined LEO constellation under general fading, regardless of exact satellites' positions. Our solution involves two phases as we, first, abstract the network into a uniformly distributed network. Secondly, we obtain a new parameter, effective number of satellites, for every user's latitude which compensates for the performance mismatch between the actual and uniform constellations. In addition to exact derivation of the network performance metrics, this study provides insight into selecting the constellation parameters, e.g., the total number of satellites, altitude, and inclination angle.


title: Angle-dependence of interlayer coupling in twisted transition metal dichalcogenide heterobilayers

abstract: We reveal by first-principles calculations that the interlayer binding in a twisted MoS2/MoTe2 heterobilayer decreases with increasing twist angle, due to the increase of the interlayer overlapping degree, a geometric quantity describing well the interlayer steric effect. The binding energy is found to be a Gaussian-like function of twist angle. The resistance to rotation, an analogue to the interlayer sliding barrier, can also be defined accordingly. In sharp contrast to the case of MoS2 homobilayer, here the energy band gap reduces with increasing twist angle. We find a remarkable interlayer charge transfer from MoTe2 to MoS2 which enlarges the band gap, but this charge transfer weakens with greater twisting and interlayer overlapping degree. Our discovery provides a solid basis in twistronics and practical instruction in band structure engineering of van der Waals heterostructures.


title: Rotated Ring, Radial and Depth Wise Separable Radial Convolutions

abstract: Simple image rotations significantly reduce the accuracy of deep neural networks. Moreover, training with all possible rotations increases the data set, which also increases the training duration. In this work, we address trainable rotation invariant convolutions as well as the construction of nets, since fully connected layers can only be rotation invariant with a one-dimensional input. On the one hand, we show that our approach is rotationally invariant for different models and on different public data sets. We also discuss the influence of purely rotational invariant features on accuracy. The rotationally adaptive convolution models presented in this work are more computationally intensive than normal convolution models. Therefore, we also present a depth wise separable approach with radial convolution. Link to CUDA code https://atreus.informatik.uni-tuebingen.de/seafile/d/8e2ab8c3fdd444e1a135/


title: Band structure and topological phases of Pb$_{1-x-y}$Sn$_x$Mn$_y$Te by ab initio calculations

abstract: The change in the composition of Pb$_{1-x}$Sn$_x$Te IV-VI semiconductor or in its lattice parameter can drive a transition from the topologically trivial to the topological crystalline insulator (TCI), crossing a region where the alloy is in the Weyl semimetal phase. Incorporation of the magnetic Mn ions induces strong perturbations of the electronic structure, which act on both orbital and spin variables. Our first principles calculations show that the presence of Mn shifts the TCI and the Weyl region towards higher Sn contents in Pb$_{1-x}$Sn$_x$Te. When the Mn spin polarization is finite, the spin perturbation, like the orbital part, induces changes in band energies comparable to the band gap, which widens the Weyl area. The effect opens a possibility of driving transitions between various topological phases of the system by magnetic field or by the spontaneous Mn magnetization. We also propose a new method to calculate topological indices for systems with a finite spin polarization defined based on the concept of the Chern number. These valid topological characteristics enable an identification of the three distinct topological phases of the Pb$_{1-x-y}$Sn$_x$Mn$_y$Te alloy.


title: Non-Riemannian Cosmology: The role of Shear Hypermomentum

abstract: We consider the usual Einstein-Hilbert action in a Metric-Affine setup and in the presence of a Perfect Hyperfluid. In order to decode the role of shear hypermomentum, we impose vanishing spin and dilation parts on the sources and allow only for non-vanishing shear. We then consider an FLRW background and derive the generalized Friedmann equations in the presence of shear hypermomentum. By providing one equation of state among the shear variables we study the cases for which shear has an accelerating/decelerating effect on Universe's expansion. In particular, we see that shear offers a possibility to prevent the initial singularity formation. We also provide some exact solutions in the shear dominated era and discuss the physical significance of the shear current.


title: High precision half-life measurement of $^{95}$Ru, $^{95}$Tc and $^{95m}$Tc with $\gamma$-spectroscopy

abstract: The precise knowledge of the half-life of the reaction product is of crucial importance for a nuclear reaction cross section measurement carried out with the activation technique. The cross section of the $^{92}$Mo($\alpha$,n)$^{95}$Ru reaction was measured recently using this experimental approach. The preliminary results indicated that the literature half-life of $^{95}$Ru, derived about half a century ago, is overestimated. Therefore, the half-lives of $^{95}$Ru and its daughter isotope $^{95}$Tc and $^{95m}$Tc have been measured with high precision using $\gamma$-spectroscopy. The results are t$_{1/2}$=1.6033 $\pm$ 0.0044 h for $^{95}$Ru, t$_{1/2}$ = 19.258 $\pm$ 0.026 h for $^{95}$Tc and t$_{1/2}$ = 61.96 $\pm$ 0.24 d for $^{95m}$Tc. The precision of the half-life values has been increased, consequently the recently measured $^{92}$Mo($\alpha$,n)$^{95}$Ru activation cross section will become more precise.


title: Relaxation dynamics of the optically driven nonequilibrium states in the electron- and hole-doped topological-insulator materials $(Bi_{1-x}Sb_{x})_{2}Te_{3}$

abstract: We report on time-resolved mid-infrared-pump terahertz-transmission-probe studies of the topological-insulator materials $(Bi_{1-x}Sb_{x})_{2}Te_{3}$, in which by varying x charge carriers are chemically tuned to be of n-type or p-type. Relaxation dynamics is found to be different in various aspects for transitions below or above the bandgap, which are selectively excited by changing the pump-pulse energy. For the below-bandgap excitation, an exponential decay of the pump-probe signals is observed, which exhibits linear dependence on the pump-pulse fluence. In contrast, the relaxation dynamics for the above-bandgap excitation is characterized by a compressed exponential decay and nonlinear fluence dependence at high pump flunences, which reflects interaction of the excited nonequilibrium states.


title: Linear magnetization dependence and large intrinsic anomalous Hall effect in Fe78Si9B13 metallic glasses

abstract: The origin of anomalous Hall effect (AHE) in ferromagnetic metallic glasses (MGs) is not yet understood completely. Here, the AHE is explored in Fe78Si9B13 MGs. We find the behavior of resistivity at low temperature seems to be more likely due to structure effect rather than Kondo-type effect. More importantly, we firstly find the primitive experiment anomalous Hall conductivity ({\sigma}AH) without separation of extrinsic contribution has a linear magnetization (Mz) dependence when temperature is changing, which is another feature of intrinsic mechanism and indicates intrinsic contribution is dominated. Furthermore, the {\sigma}AH normalized by Mz is independent of longitudinal conductivity ({\sigma}xx), which shows the characteristic of dissipationless intrinsic mechanism. We suggest the intrinsic contribution can be understood from the density of Berry curvature integrated over occupied energies proposed for aperiodic materials recently, and the linear magnetization dependence can be understood qualitatively from the fluctuations of spin orientation and the proportional relationship between Berry curvature and magnetization. Moreover, based on the recent theory report of topological amorphous metals, we make a prediction that the large intrinsic {\sigma}AH (616 S/cm) in Fe78Si9B13 MGs implies some topological properties of MGs waiting for further discovery.


title: Understanding Approximate Fisher Information for Fast Convergence of Natural Gradient Descent in Wide Neural Networks

abstract: Natural Gradient Descent (NGD) helps to accelerate the convergence of gradient descent dynamics, but it requires approximations in large-scale deep neural networks because of its high computational cost. Empirical studies have confirmed that some NGD methods with approximate Fisher information converge sufficiently fast in practice. Nevertheless, it remains unclear from the theoretical perspective why and under what conditions such heuristic approximations work well. In this work, we reveal that, under specific conditions, NGD with approximate Fisher information achieves the same fast convergence to global minima as exact NGD. We consider deep neural networks in the infinite-width limit, and analyze the asymptotic training dynamics of NGD in function space via the neural tangent kernel. In the function space, the training dynamics with the approximate Fisher information are identical to those with the exact Fisher information, and they converge quickly. The fast convergence holds in layer-wise approximations; for instance, in block diagonal approximation where each block corresponds to a layer as well as in block tri-diagonal and K-FAC approximations. We also find that a unit-wise approximation achieves the same fast convergence under some assumptions. All of these different approximations have an isotropic gradient in the function space, and this plays a fundamental role in achieving the same convergence properties in training. Thus, the current study gives a novel and unified theoretical foundation with which to understand NGD methods in deep learning.


title: Towards the classification of symplectic linear quotient singularities admitting a symplectic resolution

abstract: Over the past two decades, there has been much progress on the classification of symplectic linear quotient singularities V/G admitting a symplectic (equivalently, crepant) resolution of singularities. The classification is almost complete but there is an infinite series of groups in dimension 4 - the symplectically primitive but complex imprimitive groups - and 10 exceptional groups up to dimension 10, for which it is still open. In this paper, we treat the remaining infinite series and prove that for all but possibly 39 cases there is no symplectic resolution. We thereby reduce the classification problem to finitely many open cases. We furthermore prove non-existence of a symplectic resolution for one exceptional group, leaving 39+9=48 open cases in total. We do not expect any of the remaining cases to admit a symplectic resolution.


title: Hierarchical multigrid approaches for the finite cell method on uniform and multi-level hp-refined grids

abstract: This contribution presents a hierarchical multigrid approach for the solution of large-scale finite cell problems on both uniform grids and multi-level hp-discretizations. The proposed scheme leverages the hierarchical nature of the basis functions utilized in the finite cell method and the multi-level hp-method, which is attributed to the use of high-order integrated Legendre basis functions and overlay meshes, to yield a simple and elegant multigrid scheme. This simplicity is reflected in the fact that all restriction and prolongation operators reduce to binary matrices that do not need to be explicitly constructed. The coarse spaces are constructed over the different polynomial orders and refinement levels of the immersed discretization. Elementwise and patchwise additive Schwarz smoothing techniques are used to mitigate the influence of the cut cells leading to convergence rates that are independent of the cut configuration, mesh size and in certain scenarios even the polynomial order. The multigrid approach is applied to second-order problems arising from the Poisson equation and linear elasticity. A series of numerical examples demonstrate the applicability of the scheme for solving large immersed systems with multiple millions and even billions of unknowns on massively parallel machines.